MOSSPH Release Rss Feed

Updated Release: 2007.5 (Mar 09, 2009)

JohnKoz — Tue, 21 Jul 2009 20:17:33 GMT

For the latest source code please go to the Source Code tab and download the most recent release.

In this release I added support for creating and returning security descriptors, check out the <SECURITY> element in the TestData.xml.
Don’t forget to create an Active Directory (or local SAM) account for each user you list in your TestData.xml.

Please refer to the release notes for the previous releases in the past few weeks for additional notes on all the great improvements made this year.
You should be able to access the current codebase from the "Source Code" tab.

Happy crawling!

-John

Released: 2007.5 (Mar 09, 2009)

Tue, 21 Jul 2009 20:17:33 GMT

Updated Release: 2007.5 (Mar 09, 2009)

JohnKoz — Wed, 18 Mar 2009 17:26:40 GMT

In this release I added support for creating and returning security descriptors, check out the <SECURITY> element in the TestData.xml.
Don’t forget to create an Active Directory (or local SAM) account for each user you list in your TestData.xml.

Please refer to the release notes for the previous releases in the past few weeks for additional notes on all the great improvements made this year.
You should be able to access the current codebase from the "Source Code" tab.

Happy crawling!

-John

Released: 2007.5 (Mar 09, 2009)

Wed, 18 Mar 2009 17:26:40 GMT

Created Release: 2007.5 (Mar 09, 2009)

JohnKoz — Mon, 09 Mar 2009 11:09:38 GMT

Released: 2007.5 (Mar 09, 2009)

Mon, 09 Mar 2009 11:09:38 GMT

Updated Release: 2007.4 (Feb 18, 2009)

johnkoz — Wed, 18 Feb 2009 22:24:05 GMT

This release builds on the previous (2007.3) and provides a few more valuable enhancements that I’ve seen users ask about or find challenging. In addition to all the bullet items of the 2007.3 release there is the following additions:

More efficient incremental crawling – the accessor now chunks a container’s URLs with the date/time using the DIRLINK_WITH_TIME ID. In this way accessors won’t even be created by the gatherer if the date is not newer than the last crawl. (see http://msdn.microsoft.com/en-us/library/aa965720.aspx)
Container URLs now return a date last modified as well, so if the container has not changed its URLs don’t need to be emitted.
Support for custom property data types other than string. It now supports integers, floating point, etc. Just take a look at the PROPVARIANT_UNION structure for a complete list.
I’ve cleaned up much of the PROPVARIANT, PROPSPEC, etc code so that its smaller and easier to extend. I’ve also revisited the ‘using’ directives in the interface source files to make them more complete, accurate and documented.
I’ve switched FILETIME back to a local structure again, looks like I was mistaken about it being marked for COM visibility in the .NET framework.

At this point I think it’s pretty solid in terms of functionality and layout, let me know if you have any further suggestions.

Please access the new source using the "Source" tab. I haven't modified any of the documentation, so if you still need that please refer to release 2007.2.
As before, good luck and happy crawling!

-John

Released: 2007.4 (Feb 18, 2009)

Wed, 18 Feb 2009 22:24:04 GMT

More efficient incremental crawling – the accessor now chunks a container’s URLs with the date/time using the DIRLINK_WITH_TIME ID. In this way accessors won’t even be created by the gatherer if the date is not newer than the last crawl. (see http://msdn.microsoft.com/en-us/library/aa965720.aspx)
Container URLs now return a date last modified as well, so if the container has not changed its URLs don’t need to be emitted.
Support for custom property data types other than string. It now supports integers, floating point, etc. Just take a look at the PROPVARIANT_UNION structure for a complete list.
I’ve cleaned up much of the PROPVARIANT, PROPSPEC, etc code so that its smaller and easier to extend. I’ve also revisited the ‘using’ directives in the interface source files to make them more complete, accurate and documented.
I’ve switched FILETIME back to a local structure again, looks like I was mistaken about it being marked for COM visibility in the .NET framework.

Reviewed: 2007.3 (Feb 17, 2009)

charlieli — Wed, 18 Feb 2009 06:40:31 GMT

Rated 4 Stars (out of 5) - 12

Updated Release: 2007.3 (Feb 11, 2009)

johnkoz — Wed, 11 Feb 2009 21:14:09 GMT

This release includes several fixes and enhancements that makes building a Protocol Handler even easier than before. If you’ve tried to use the sample and gave up, take a look at the new sample as the new improvements may get you past some of the difficulties you encountered:

XML based test content source – once compiled and installed this version will actually crawl content! I’ve created an XML file that is used as a content source (TestData.xml) and this serves as nested containers and items. Learn by example as to where to place what code based on where I’ve injected the XML specific code. Then turn on tracing and see exactly what a typical output should be. All XML specific code in the ContentEnumerator class is bracketed with #regions, including the usual TODO comments. Play around with the TestData.xml to:

Add custom properties
Experiment with the last modified date/time’s for incremental crawling.
Change the content to see modified documents reflected in the search results.
Note: the content of a pretend document is written locally to a temporary file and that filename is crawled.

PreserveSig – the interfaces are now decorated with the PreserveSig attribute which eliminates all the kluge around throwing exceptions to return HR codes. All methods which needed to return an HRESULT now do so and the implementer need only consider what HRESULT to return, not HOW to return it. This has the effect of eliminating the annoying error messages in the crawl log.
IContentEnumerator – it’s easier than ever to abstract your custom logic away from the sample. With the introduction of IContentEnumerator the communications between the ProtocolHandler/Accessor class and the ContentEnumerator are more formal, thus allowing you to have multiple ContentEnumerators for different content sources or for experimentation (such as the supplied XML source). Note: the ContentEnumerator class no longer inherits from Uri.
Support for custom properties – the ContentEnumerator class now exposes a property that can be populated with an array of custom properties for the container or item. There should be no need to create a custom IFilter to chunk the custom properties to the gatherer. I’ve also cleaned up the existing properties and grouped them together into classes for more readability.
FILETIME – it seems the .NET Framework was fixed so that the ComTypes.FILETIME is marked for interop. That means I can remove my local declaration of the data type and use the Framework’s. This has the side effect of fixing the high/low word bug.

Please access the new source using the "Source" tab. I haven't modified any of the documentation, so if you still need that please refer to release 2007.2.
Let me know how it goes. Good luck and happy crawling!

Released: 2007.3 (Feb 11, 2009)

Wed, 11 Feb 2009 21:14:09 GMT

XML based test content source – once compiled and installed this version will actually crawl content! I’ve created an XML file that is used as a content source (TestData.xml) and this serves as nested containers and items. Learn by example as to where to place what code based on where I’ve injected the XML specific code. Then turn on tracing and see exactly what a typical output should be. All XML specific code in the ContentEnumerator class is bracketed with #regions, including the usual TODO comments. Play around with the TestData.xml to:

Add custom properties
Experiment with the last modified date/time’s for incremental crawling.
Change the content to see modified documents reflected in the search results.
Note: the content of a pretend document is written locally to a temporary file and that filename is crawled.

PreserveSig – the interfaces are now decorated with the PreserveSig attribute which eliminates all the kluge around throwing exceptions to return HR codes. All methods which needed to return an HRESULT now do so and the implementer need only consider what HRESULT to return, not HOW to return it. This has the effect of eliminating the annoying error messages in the crawl log.
IContentEnumerator – it’s easier than ever to abstract your custom logic away from the sample. With the introduction of IContentEnumerator the communications between the ProtocolHandler/Accessor class and the ContentEnumerator are more formal, thus allowing you to have multiple ContentEnumerators for different content sources or for experimentation (such as the supplied XML source). Note: the ContentEnumerator class no longer inherits from Uri.
Support for custom properties – the ContentEnumerator class now exposes a property that can be populated with an array of custom properties for the container or item. There should be no need to create a custom IFilter to chunk the custom properties to the gatherer. I’ve also cleaned up the existing properties and grouped them together into classes for more readability.
FILETIME – it seems the .NET Framework was fixed so that the ComTypes.FILETIME is marked for interop. That means I can remove my local declaration of the data type and use the Framework’s. This has the side effect of fixing the high/low word bug.

UPDATED RELEASE: 2007.2 (Feb 06, 2008)

Thu, 07 Feb 2008 01:46:28 GMT

This is my second release of the MOSS 2007 version, first release here on CodePlex.
It contains a couple of bug fixes and some new comment headers in the source files.
Also, I updated a bunch of the logging calls to the more updated enter/leave methods.

UPDATED RELEASE: 2007.2 (Feb 06, 2008)

Thu, 07 Feb 2008 01:38:48 GMT