conceptClassifier for Office 365 Platform



conceptClassifier for Office 365 is currently the only solution in the market that enhances search, automatically identifies documents of record, secures confidential information from unauthorized access, provides intelligent migration, and improves any business process that utilizes metadata.

 

 

Office 365 can provide a strong return on investment and enable ubiquitous access for end users regardless of where they are located. Moving to a cloud environment, even a hybrid environment, poses challenges with regard to applying a consistent information governance strategy across all environments. conceptClassifier for Office 365 enables effective management of unstructured content by enforcing and extending enterprises’ on-premise information governance policies within the cloud environment. Metadata driven policy actions on content used in migration, identifying and securing sensitive information, or in the automatic declaration of documents of record, are capabilities added to the Office 365 platform. conceptClassifier for Office 365  provides management of the term sets, synchronizing the Term Store with the corporate taxonomies in the conceptTaxonomyManager component, and auto-classifying content to enable effective management of unstructured content by applying the same information governance policies in all environments.

What are the key features?

  • Operational alignment enables information governance and continuity of business processes for all enterprise content
  • Framework architecture that is installed once and re-used to improve business processes such as search, records management, migration, and data privacy
  • Feature rich solution that extends Office 365 by adding robust information governance capabilities to Office 365
  • Intelligent migration capabilities to analyze content based on organizationally defined descriptors and vocabularies, automatically classify the content to taxonomies or the SharePoint Term Store, and automatically apply organizationally defined workflows
  • Cloud ready and has been deployed in hybrid as well as cloud only environments
  • Enterprise enabled and easily deployed and managed, providing one source to manage all unstructured and semi-structured content
  • 365 view of all content regardless of where it resides including file shares, SharePoint, and web sites

What are the key outcomes?

conceptClassifier for Office 365 is currently the only product available that addresses the challenges in Office 365 including the following:

  • Eliminates manual tagging
  • Auto classifies content regardless of where it resides
  • Enables concept based searching using Office 365 search
  • Intelligently migrates content from SharePoint to the cloud as well as from file stores and diverse repositories
  • Fully compatible with SharePoint 2013 and maintains Globally Unique Identifiers (GUIDs) during migration
  • Automatically declares documents of record and routes to the records management application for disposition
  • Detects and automatically secures unknown privacy exposures in real time as content is created or ingested
  • Functions simultaneously and bi-synchronously with the Term Store


conceptClassifier for SharePoint Online & Office 365 Technology Differentiators

Platform Matrix

The following table provides an overview of all Concept Searching technology platforms and the components available in each platform.

Core Components conceptClassifier for SharePoint Platform conceptClassifier for Office 365 Platform conceptClassifier Platform Concept Searching Technology Platform
conceptClassifier for SharePoint 2013 conceptClassifier for SharePoint 2010 conceptClassifier for SharePoint 2007
Compound Term Processing Engine – licensed for concept extraction only yes yes yes yes yes Full search functionality included
conceptClassifier yes yes yes yes yes yes
conceptTaxonomyManager yes yes yes yes yes yes
conceptSearch no no no no no yes
SharePoint Feature Set yes yes yes yes no yes
SharePoint Connector yes yes yes yes no yes
APIs, custom controls, demonstration source code no no no no yes yes
conceptSQL no no no no no yes
Proprietary controls for SharePoint 2007 no no yes no no yes
Optional Components conceptClassifier for SharePoint 2013 conceptClassifier for SharePoint Platform conceptClassifier for SharePoint 2010 conceptClassifier for SharePoint 2007 conceptClassifier for Office 365 Platform conceptClassifier Platform Concept Searching Technology Platform
conceptTaxonomyWorkflow yes yes no yes yes yes
conceptSearch yes yes yes yes yes Included in Base Product
conceptSQL yes yes yes yes yes Included in Base Product
Content Enrichment Service for SharePoint 2013 yes no no no no yes
FAST Pipeline Stage for SharePoint 2010 yes yes no no no yes
conceptContentTypeUpdater yes US only yes US only yes US only no no no
Additional Classification Servers yes yes yes yes yes yes
Additional Front End Web Servers yes yes yes N/A yes yes

Features

conceptClassifier for Office 365 fully supports and integrates with Office 365. The table below illustrates the functionality and features available in SharePoint and Office 365. The conceptClassifier for Office 365 column illustrates the features that are available in the conceptClassifier for Office 365 product that add additional value  in an Office 365 environment. For a detailed comparison of features that are found in SharePoint and conceptClassifier for SharePoint, please visit our conceptClassifier for SharePoint page.

For more information on a specific feature please use the hover function over the specific Feature/Function.

Feature/Function SharePoint 2010 SharePoint 2013 Office 365 conceptClassifier for Office 365
Taxonomy/Term Store Functionality
Taxonomy Rollback yes no no yes
Multi-language yes yes yes yes
Text mining to identify candidate terms no no no yes
Relationship Definition no no no yes
Concept Mapping no no no yes
Taxonomy Navigation yes-through the term set yes-through the term set yes-through the term set yes-through the term set
Import, combine, organize and harmonize taxonomy models no no no yes
Polyhierarchy Support Partial Partial Partial yes
Distributed taxonomy management no no no yes
Synonym support yes yes yes yes
Instant feedback on taxonomy changes no no no yes
Controlled Vocabularies Can be loaded into the Term Store Can be loaded into the Term Store Can be loaded into the Term Store Can be loaded into the Term Store
Ability to automatically suggest classification clues for term set terms no no no yes
Security no no no yes
Microsoft Platform Integration N/A N/A N/A yes
Manual tagging yes yes yes yes
Automatic tagging of content within and outside of SharePoint with conceptual metadata no no no yes
Classifies all SharePoint content, libraries, blogs, wikis, and threads lists yes manual Yes manual  no yes
Auto-classification from SharePoint and other Microsoft repositories such as Windows Server 2008, 2012 no no no yes
Native integration with the SharePoint Term Store with no need to import/export N/A N/A N/A yes (index and classify)
Automatic classification of content inside and outside of SharePoint no no no yes
Indexer embedded within conceptClassifier and conceptTaxonomyManager no no no yes
Automatic generation of compound terms no no no yes
Integrated with Refinement Panel no yes no yes
Managed by Subject Matter Experts no no no yes
Maintenance of term set GUIDs between environments no no no yes
Automatic content type updating no no no yes
Search integration yes yes yes yes
Search improvements via the refinement panel via taxonomy integration no no N/A yes
Intelligent Metadata Enabled Solutions (Information Governance and Compliance)
Records Identification no no no yes
Data privacy and information security no no no yes
Taxonomy workflow no no no yes
Intelligent migration no no no yes

Technology Specifications

conceptClassifier for Office 365 is based on an open architecture with all APIs based on XML and Web Services. Transparent access to system internals including the statistical profile of terms, is standard. The base platform is installed as a feature set and comprises the following components.

Base Components in conceptClassifier for Office 365

  • conceptClassifier

Both automated and manual classification is supported to one or more term sets within the Term Store and across content hubs.

  • conceptTaxonomyManager

This is an advanced enterprise class, easy-to-use taxonomy and term set development and management tool. It integrates natively with the SharePoint Term Store reading and writing in real-time ensuring that the taxonomy/term set definition is maintained in only one place, the SharePoint Term Store. Designed for use by Subject Matter Experts, the Term Store and/or taxonomy is easily developed, tested, and refined.

Term Set Migration tools are also a component of conceptTaxonomyManager that enable term sets to be developed on one server (e.g. on-premise server) and then migrated to another server (e.g. Office 365 server) in an incremental fashion and preserving all GUID’s. This is a key requirement in migration.

  • conceptSearch Compound Term Indexing Engine

Licensed for the sole use of building and refining the taxonomy/term set the engine provides automatic semantic metadata generation that extracts multi-word terms or concepts along with keywords and acronyms. conceptSearch is an enterprise search engine and is sold as a separate product.

Typical Recommended Base Configuration

  • Windows 2008 Server configured for 64 bit processing, with IIS and ASP.NET (v2) installed
  • Any modern 64 bit CPU
  • Windows 2003/2008/2012 x64 Edition
  • 8GB RAM (recommended)
  • .NET Framework V3.5/4.0
  • Access to SQLServer (2005 or later) or Oracle (9i or later)
  • IIS 6 with Metabase enabled
  • MS Office 2010 64 bit iFilter pack. Adobe or Foxit PDF 64 bit iFilter pack
  • High speed disk, Raid Array or SAN

Classification Server
1 conceptClassifier Server

Additional Classification Servers (Optional)
Provides scalability of classification to increase speed of classification throughput especially when classification on the fly is an important requirement.

Front End Web Servers
No limitations

Supports

  • SharePoint 2013
  • SQL Server 2005, 2008, 2012
  • On-premise, cloud, or hybrid environments

 

Optional Products 

conceptSQL

This product provides the ability to define a document structure based on information held in a Microsoft SQL Server or Oracle database. A document can include any number of text and metadata fields and can span multiple tables if required. conceptSQL supports SQL 2005, SQL 2008, and SQL 2012. A powerful but easy to use configuration tool is supplied eliminating the need for any programming. Templates are provided for out-of-the-box support for Documentum, Hummingbird and Worksite/Interwoven DMS.

conceptTaxonomyWorkflow

conceptTaxonomyWorkflow can perform an action on a document following a classification decision when certain criteria are met. The workflow source type works in SharePoint 2007, 2010, and 2013, as well as all document types, including FILE and HTTP. This product is available in a SharePoint and non-SharePoint environments and has a plugin architecture enabling clients and integration partners to easily build plugins for both content sources and destination sources

Additional Classification Servers

Provides scalability of classification to increase speed of classification throughput especially when classification on the fly is an important requirement.

Application Requirements

All the functions you need to start gaining control over your unstructured content are included in the base conceptClassifier for SharePoint product. Our clients have discovered is the unique and varied uses of the technology to solve a wide variety of content management challenges. Below is a list of the base platform and optional products that are needed to solve your particular business process challenge and leverage your SharePoint investment. Why wait? Improve your business processes and positively impact your bottom line starting today.

Search Engine Integration

Functionality provided via conceptClassifier for Office 365 to integrate with Office 365 search.

Required Products: conceptClassifier for Office 365

Intelligent Document Classification

Functionality provided via conceptClassifier for Office 365, classifies documents based upon concepts and multi-word terms that form a concept. Automatic and/or manual classification is included. Content can be classified not only from within Office 365 and SharePoint but also from diverse repositories including file shares, Exchange public folders, and websites. All content can be classified on the fly, in real time and classified to one or more taxonomies. Knowledge workers with appropriate security rights can also classify content in real time on a one off basis.

Required Product: conceptClassifier for Office 365

Taxonomy Management and Term Store Integration

With the Term Store functionality in SharePoint, organizations can develop a metadata model using out-of-the-box SharePoint capabilities. conceptClassifier for Office 365 provides native integration with the Term Store and the Managed Metadata Service application, where changes in the Term Store will be automatically available in the taxonomy component, and any changes in the taxonomy component will be immediately available in the Term Store. A compelling advantage is the ability to consistently apply semantic metadata to content and auto-classify it to the taxonomy, or optionally the Term Store metadata model. This solves the challenges of applying the metadata to a large corpus of documents, and eliminates the need for the end user community to correctly tag content. Utilizing the taxonomy component, the taxonomies can be tested, validated, and managed, which is not a function provided by Office 365.

Required Product: conceptClassifier for Office 365

Intelligent Migration

Using conceptClassifier for Office 365, an intelligent approach to migration can be achieved. As content is migrated, it is analyzed for organizationally defined descriptors and vocabularies, which will automatically classify the content to taxonomies, or optionally the SharePoint Term Store, and automatically apply organizationally defined workflows to process the content to the appropriate repository for review and disposition.

Required Products:  conceptClassifier for Office 365 conceptTaxonomyWorkflow conceptSQL if migrating from other SQL databases

Intelligent Records Management

The ability to intelligently identify, tag, and migrate documents of record to either a staging library and/or a records management solution is a key component to driving and managing an effective information governance strategy. Taxonomy management, automatic declaration of documents of record, auto-classification, and semantic metadata generation are provided via conceptClassifier for Office 365 and conceptTaxonomyWorkflow.

Required Products: conceptClassifier for Office 365 conceptTaxonomyWorkflow

Data Privacy

Taxonomy, classification, and metadata generation are provided via conceptClassifier for Office 365. Using organizationally defined descriptors and vocabulary content that is ingested or created that contains the descriptors and vocabulary will be automatically tagged and routed to a secure repository for disposition.

Required Products: conceptClassifier for Office 365 conceptTaxonomyWorkflow conceptSQL if working with other SQL data sources

eDiscovery, Litigation Support, and FOIA Requests

Taxonomy, classification, and metadata generation are provided via conceptClassifier for Office 365 as well as integration with eDiscovery capabilities available in Office 365.

Required Products: conceptClassifier for Office 365 conceptTaxonomyWorkflow conceptSQL if working with other SQL data sources

Text Analytics

Taxonomy, classification, and metadata generation are provided via conceptClassifier for Office 365. A third party business intelligence or reporting tool is required to view the data in the desired format.

Required Product: conceptClassifier for Office 365

Social Networking

Taxonomy, classification, and metadata generation are provided via conceptClassifier for Office 365. Integration with social networking tools can be accomplished if the tools are available in .NET or via SharePoint functionality.

Required Product: conceptClassifier for Office 365

Business Process Workflow

conceptTaxonomyWorkflow serves as a strategic tool, managing migration activities and content type application across multiple SharePoint and non-SharePoint farms, and is platform agnostic. This add-on component delivers value specifically in migration, data privacy, records management, or in any application or business process that requires workflow capabilities.

conceptClassifier for Office 365 Benefits

Why You Need conceptClassifier for Office 365

Office 365 provides a wealth of benefits, specifically to large enterprises. Clients are embracing conceptClassifier for Office 365 because it is the only product available in the market that delivers a comprehensive solution for Office 365. conceptClassifier for Office 365 was designed to mirror the functionality in Concept Searching’s award winning conceptClassifier for SharePoint and solve the same challenges. A client with over 170,000 global users of Office 365 and SharePoint needed to address migration, records identification, data privacy, search, and enterprise wide information governance. conceptClassifier for Office 365 was the only product available that could address all their requirements.

*

  • Office 365 has no ability to automatically create and store classification metadata
  • Office 365 has no auto-classification capabilities
  • Office 365 has no ability to provide intelligent migration capabilities based on the semantic metadata within content, identify previously undeclared documents of record, unidentified privacy exposures, or information that should be archived or deleted
  • Office 365 has no ability to maintain GUID’s during migration
  • Office 365 has no ability to generate semantic metadata and surface it to the Office 365 search engine to improve search results
  • Office 365 has no ability to automatically tag content with vocabulary or retention codes for records management
  • Office 365 cannot identify organizationally defined confidential or data privacy information and automatically secure it from unauthorized access
  • Office 365 has limited ability without the structure to provide granular identification of people, content recommendations, and organizational knowledge assets to finely tune social networking applications

 

Leveraging Your Cloud Investment

  • Eliminates traditional migration issues resulting in the intelligent migration of all content and the development of an enterprise metadata repository
  • Reduces support requirements across on-premise and cloud environments
  • One technology platform to address all content management challenges in a hybrid or cloud environment
  • Does not require highly trained specialists, outside resources, nor knowledge of any programming language
  • Easily integrated with business processes using conceptTaxonomyWorkflow
  • Synchronizes the SharePoint Term Store across cloud and on-premise environments in real time
  • Rapidly deployed
  • Highly scalable
  • Taxonomies can be managed by Subject Matter Experts

Leveraging Your Business Investment

  • Delivers intelligent migration capabilities eliminating budget over-runs and end user testing, and minimizes resources and time needed to accomplish objectives
  • Automatically enforces information governance enterprise wide
  • Reduces corporate risk and costs associated with eDiscovery
  • Protects confidential and privacy information regardless of how it was ingested, and optionally in real-time
  • Ensures all records are declared regardless of where they reside or how they were ingested
  • Adaptable to meet compliance and industry/federal mandates transparently to the end users
  • Improves the search experience across environments
  • Enables concept based searching
  • Eliminates end user tagging, ensuring content integrity is maintained throughout the enterprise

Concept Searching has a current Enterprise Authority to Operate (ATO) US Air Force, a current Enterprise Certificate of Networthiness (CoN) US Army, and has been deployed on the SIPR, NIPR, and DISA networks. 

 

Market, Technology, and Business Differentiators

conceptClassifier for Office 365 as well as conceptClassifier for SharePoint remain industry unique not only due to the technology but for the ability for clients to deploy an enterprise wide information governance plan through the development of an enterprise metadata repository. Leveraging their investment, reducing resources, and eliminating time to market, they are able to use one set of technologies to improve search, records management, data privacy, and migration. With the exploding amount of unstructured and semi-structured content, these challenges have been escalated to a business priority. They can no longer be ignored, and can typically be improved.

*

Compound Term Processing

Concept Searching’s industry unique compound term processingtechnology delivers outcomes that are not achieved by any other classification engine. Compound term processing means that Concept Searching’s statistical engine can understand, out-of-the-box, the incremental value of keywords, multi-word fragments, and compound terms. As a result, it can identify concepts resident within an organization’s own information repositories that are highly correlated to particular topics. With the identification of these highly correlated topics in the form of keywords, multi-word fragments and compound terms the result is automatically generated intelligent metadata that is unique to the organization. By using these compound terms in any application that requires metadata, the outcomes are highly accurate, because the ambiguity inherent in single words is no longer an issue.

A search for ‘triple heart bypass’ will locate documents about this topic even if this precise phrase is not contained in any document. A concept search using compound term processing can extract the key concepts, in this case “triple heart bypass” and use these concepts to retrieve relevant documents containing concepts such as ‘heart surgery’, ‘coronary artery bypass’, or ‘open heart surgery’.

Industry Unique Taxonomy Management Features

conceptTaxonomyManager remains unique in the industry in features that provide the ability to rapidly and easily change the taxonomy as the organizational needs and requirements change. This is important as a taxonomy must remain fluid as opposed to static and must be managed in a way that facilitates change. The easy to use taxonomy and automatic classification tools create the framework to classify content based on concepts to one or more nodes in the taxonomy or multiple taxonomies. The conceptTaxonomyManager component is included in the base product in all platforms.

Ease of Use conceptTaxonomyManager is a simple yet powerful tool with an intuitive user interface designed for Subject Matter Experts (SME) without the need for IT, Information Scientists, or specific application skills, to build, maintain and validate taxonomies for the enterprise. This feature has been shown to reduce taxonomy development by up to 80% (client source data).

Automatic Clue Suggestion Eliminating complex Boolean rules and the need for training sets the taxonomy nodes can be automatically generated from the compound terms found in the document corpus. The Subject Matter Expert (SME) has full control of the terms to be used as well as the weighting of the term based on its relevancy. This enables a much more robust taxonomy as the terms are suggested based on the organization’s own content and can offer the SME new terms from the relevant documents that may not have been identified. The Clues can also be assigned a score or weight, either positive or negative to improve the classification. Clues can also be assigned a Type.

Document Movement Feedback Automatic document movement feedback enables the SME to see the cause and effect on changing the clue weightings for a node in the taxonomy. The user can also search within the refined node and bring back documents from the whole corpus now classified against the node. The system will indicate if the change has increased the score, reduced the score as well as identify documents that will no longer be classified and the new documents that will be classified.

Distributed Taxonomy Management This feature is a requirement for organizations that have many taxonomy operators, extremely large collections of documents, and where taxonomy management is a critical business process. This feature can be implemented on any number of servers and several taxonomy managers can be assigned to a server to ensure the level of throughput needed. Real time locking mechanisms are used to make nodes of the taxonomy inaccessible to other taxonomy managers while the node is being edited. The taxonomy managers can visually see when a node is locked and who has locked it as well as when it becomes available. The Distributed Taxonomy Management feature is totally transparent to the end user and all locking and unlocking of the nodes by the taxonomy managers are coordinated by the central server.

Security and RollbackThe product provides a full security model enabling lock down of nodes, branches, and complete taxonomies to particular users and/or groups of users. Also supports rollback to the previous state.

conceptTaxonomyWorkflow

conceptTaxonomyWorkflow is a powerful add-on product to automate manual business processes. conceptTaxonomyWorkflow serves as a strategic tool managing migration activities and content type application across multiple SharePoint and non-SharePoint farms and is also platform agnostic. This add-on component delivers value specifically in migration, data privacy, records management or any application or business process that requires workflow capabilities. It is required to apply an action on a document and optionally, automatically apply a content type and route to the appropriate repository for disposition.

Intelligent Metadata Enabled Solutions

Concept Searching is the only available solution that addresses the challenges in managing unstructured and semi-structured data in SharePoint and non SharePoint environments. Our Intelligent Metadata Enabled Solutions address the following challenges with one set of technologies, leverages an enterprises investment in SharePoint, and reduces resources to maintain and manage the solution. *
Enterprise Search enables concept based searching by providing the search engine index with the compound terms and semantic metadata.

Records Management is improved through the elimination of end user tagging, automatic declaration of records, and taxonomy workflow capabilities.

Data Privacy and the protection of confidential data as defined by the organization is identified in real-time and routed to a secure repository for disposition.

Intelligent Migration is accomplished through the identification and auto-classification of the unstructured or semi-structured data to one or more taxonomies.

Text Analytics can be performed on the corpus of information as well as from diverse repositories to extract granular information for further analysis.

Social Networking and collaboration applications gain structure and the ability to retrieve highly relevant and granular information.

eDiscovery and FOIA time and costs are reduced through identification of highly detailed information and conceptually similar information that typically would not be found.