From marvin.scaff at Innovaro.com Fri Nov 5 11:52:19 2010 From: marvin.scaff at Innovaro.com (Marvin Scaff) Date: Fri, 5 Nov 2010 11:52:19 -0400 Subject: [Kim-discussion] Fwd: KIM web client connection References: <26A8AC45-5534-475A-955D-5A7E20BE89B1@scaff.net> Message-ID: <64E8CF65-D363-4AB9-AF61-31C1140EF35E@innovaro.com> > > We have deployed kim-platform-3.0-RC4 on a ubuntu machine. Its web client has been deployed on another machine under tomcat. kim_connection.properties with the following content has also been placed > com.ontotext.kim.KIMConstants.RMI_HOST=192? > com.ontotext.kim.KIMConstants.RMI_PORT=1099 > > The client tries to connect to localhost RMI service and complains that it could not find the service. How can we configure this web client to connect to a remote KIM instance? > > Our custom written web application connects to the remote KIM instance fine using the same properties file. {Fullname} | Mobile: This message may contain confidential information and is intended only for this recipient. If you are not the named addressee you should not disseminate, distribute or copy this e-mail. Please notify the sender immediately if you have received this e-mail by mistake and delete this e-mail from your system. Finally, the recipient should check this e-mail and any attachments for the presence of viruses. The company accepts no liability for any damage caused by any virus transmitted by this e-mail. -------------- next part -------------- An HTML attachment was scrubbed... URL: From borislav.popov at ontotext.com Fri Nov 5 12:16:00 2010 From: borislav.popov at ontotext.com (borislav popov) Date: Fri, 5 Nov 2010 18:16:00 +0200 Subject: [Kim-discussion] Fwd: KIM web client connection In-Reply-To: <64E8CF65-D363-4AB9-AF61-31C1140EF35E@innovaro.com> References: <26A8AC45-5534-475A-955D-5A7E20BE89B1@scaff.net> <64E8CF65-D363-4AB9-AF61-31C1140EF35E@innovaro.com> Message-ID: <8D1CBF35-B0FB-4D3E-A975-9A304EC458E1@ontotext.com> Hi Marvin, Philip & somebody else if necessary will look at your issue now. b On Nov 5, 2010, at 5:52 PM, Marvin Scaff wrote: > >> >> We have deployed kim-platform-3.0-RC4 on a ubuntu machine. Its web >> client has been deployed on another machine under tomcat. >> kim_connection.properties with the following content has also been >> placed >> com.ontotext.kim.KIMConstants.RMI_HOST=192? >> com.ontotext.kim.KIMConstants.RMI_PORT=1099 >> >> The client tries to connect to localhost RMI service and complains >> that it could not find the service. How can we configure this web >> client to connect to a remote KIM instance? >> >> Our custom written web application connects to the remote KIM >> instance fine using the same properties file. > > {Fullname} | Mobile: > This message may contain confidential information and is intended > only for this recipient. If you are not the named addressee you > should not disseminate, distribute or copy this e-mail. Please > notify the sender immediately if you have received this e-mail by > mistake and delete this e-mail from your system. Finally, the > recipient should check this e-mail and any attachments for the > presence of viruses. The company accepts no liability for any damage > caused by any virus transmitted by this e-mail. > > > _______________________________________________ > Kim-discussion mailing list > Kim-discussion at ontotext.com > http://ontotext.com/mailman/listinfo/kim-discussion -------------- next part -------------- An HTML attachment was scrubbed... URL: From boyan.kukushev at sirma.bg Fri Nov 5 12:49:54 2010 From: boyan.kukushev at sirma.bg (Boyan Kukushev) Date: Fri, 5 Nov 2010 19:49:54 +0300 Subject: [Kim-discussion] Fwd: KIM web client connection In-Reply-To: <64E8CF65-D363-4AB9-AF61-31C1140EF35E@innovaro.com> References: <26A8AC45-5534-475A-955D-5A7E20BE89B1@scaff.net> <64E8CF65-D363-4AB9-AF61-31C1140EF35E@innovaro.com> Message-ID: <201011051849.54197.boyan.kukushev@sirma.bg> Hello Marvin, Actually, the connection settings for the default KIM web client (KIM.war) can not be configured through 'kim_connection.properties', but using the file your-tomcat-home/webapps/KIM/WEB-INF/classes/kwebui.config If your KIM server is deployed on another machine, you have to change the 'kim-rmi-host' parameter in that file to point to the machine's address. For example: - the default configuration in 'kwebui.config' is kim-rmi-host localhost kim-rmi-port 1099 - your KIM server is deployed on a machine having 192.168.1.200 as its internal network address Therefore, you should change the 'kim-rmi-host' parameter as follows: kim-rmi-host 192.168.1.200 Similarly, if you have modified the KIM RMI port parameter in your KIM server configuration files, you should change the 'kim-rmi-host' to the new port. I hope that this will have your problem solved! Regards, Boyan Kukushev KIM Platform developer, KIM team On Fri November 5 2010 17:52:19 Marvin Scaff wrote: > > > > > We have deployed kim-platform-3.0-RC4 on a ubuntu machine. Its web client has been deployed on another machine under tomcat. kim_connection.properties with the following content has also been placed > > com.ontotext.kim.KIMConstants.RMI_HOST=192? > > com.ontotext.kim.KIMConstants.RMI_PORT=1099 > > > > The client tries to connect to localhost RMI service and complains that it could not find the service. How can we configure this web client to connect to a remote KIM instance? > > > > Our custom written web application connects to the remote KIM instance fine using the same properties file. > > > {Fullname} | Mobile: > This message may contain confidential information and is intended only for this recipient. If you are not the named addressee you should not disseminate, distribute or copy this e-mail. Please notify the sender immediately if you have received this e-mail by mistake and delete this e-mail from your system. Finally, the recipient should check this e-mail and any attachments for the presence of viruses. The company accepts no liability for any damage caused by any virus transmitted by this e-mail. > > > > -- Boyan Kukushev Software Engineer / Java Developer Ontotext AD @ Sirma Group Corp. From Anton.Andreev at ontotext.com Mon Nov 8 03:29:03 2010 From: Anton.Andreev at ontotext.com (Anton Andreev) Date: Mon, 08 Nov 2010 10:29:03 +0200 Subject: [Kim-discussion] Fwd: Re: SwiftOWLIM registration request Message-ID: <4CD7B4CF.7050405@ontotext.com> Dear Ms. Radenkovic, I am forwarding your request to the KIM-discussion mailing list: KIM-discussion at ontotext.com. My KIM colleagues will better answer your technical questions as I deal more with OWLIM. Best regards, Anton -- Anton Andreev Account Manager Ontotext AD Tel: +359 2 875 81 17 Fax:+359 2 975 32 26 email:anton.andreev at ontotext.com www.ontotext.com -------- Original Message -------- Subject: Re: SwiftOWLIM registration request Date: Sun, 7 Nov 2010 20:26:05 +0100 From: Sonja D. Radenkovic To: Anton Andreev Dear Mr Andreev, I have to use KIM in eclipse maeven project for the annotation of resources. Could you, please, help me to configure KIM for that purpose?Till now I've done the following things: 1. Download and install Apache Tomcat 6.0.24 2. Download and install KIM 3 platform 3. Download and install SwiftOWLIM 4. Extend the KIM ontology and knowledge base I still don't know how to include KIM in my eclipse maeven project, since I can't include .jar files there. I need the information related to adding the KIM dependencies in Maeven, but I couldn't find it on the Web. Any information would be useful... Regards, Sonja -- Mr Sonja D. Radenkovic, Lecturer High Economic Professional School Pec-Leposavic 38218 Leposavic Serbia Email: sonjafon at gmail.com URL: http://www.goodoldai.org/sonja_radenkovic 2010/11/2 Sonja D. Radenkovic > Dear Mr Andreev, Danica is my friend from GOOD OLD AI research network (http://www.goodoldai.org/people). I think that she prepares her Ph.D. thesis working on the GATE project at the University of Sheffield. I'm sure that you've had a good experience in collaboration with Danica... Thank you for offering the help. I will accept it :). This time I'm trying to configure KIM for the annotation of documents, but I still have some problems. If I can't solve it in the next day or two, I will ask you to help me... Best regards, Sonja 2010/11/1 Anton Andreev > Dear Ms. Radenkovic, I also know Ms. Danica Damljanovic. She has visited our office in Ontotext last year.. If you have any questions related to OWLIM, do not hesitate to contact me. Cheers, Anton -- Anton Andreev Account Manager Ontotext AD Tel: +359 2 875 81 17 Fax:+359 2 975 32 26 email:anton.andreev at ontotext.com www.ontotext.com On 30.10.2010 ?. 02:41 ?., Sonja D. Radenkovic wrote: > Dear Mr Andreev, > > Can you please confirm if this is your LinkedIn profile: > http://www.linkedin.com/in/sonjadradenkovic ? Thank you. > You're right. This is my Linkedln profile. > > Sincerely, > Sonja Radenkovic > > On Wed, Oct 27, 2010 at 12:48 PM, Anton Andreev > > wrote: > > Dear Ms. Radenkovic, > > Thank you very much for your interest in SwiftOWLIM. Can > you please confirm if this is your LinkedIn profile: > http://www.linkedin.com/in/sonjadradenkovic ? Thank you. > > You can download the latest SwiftOWLIM distribution here: > http://download.ontotext.com/owlim/fc3cb600-7184-4973-97a9-3b97f83e76e7/swiftowlim-3.3.2738.zip > > > Please read the SwiftOWLIM licence agreement: > http://www.ontotext.com/owlim/OWLIMLicenceAgreement.html > > In order to get an appreciation for the level of activity > in the OWLIM community, we recommend that you subscribe to > the OWLIM-discussion mailing list at: > http://ontotext.com/mailman/listinfo/OWLIM-discussion This > mailing list has a public archive available at: > http://www.mail-archive.com/owlim-discussion at ontotext.com/maillist.html > > Also, we would very much appreciate a little bit more > information about how you intend to use SwiftOWLIM, i.e. > size of datasets, inference complexity, application > scenarios, etc. This information helps us to understand > our customers better and ultimately helps us to improve > our software and services. > > If you have any further questions, please do not hesitate > to contact us at: OWLIM-info at ontotext.com > . > > We hope you will find SwiftOWLIM useful and we would be > happy to receive your feedback! > > Best regards, > Anton Andreev > > -- > Anton Andreev > Account Manager > Ontotext AD > Tel: +359 2 875 81 17 > Fax:+359 2 975 32 26 > email: anton.andreev at ontotext.com > > www.ontotext.com > > > On 27.10.2010 ?. 13:03 ?., sonjafon at gmail.com > wrote: > > Name: Sonja Radenkovic > Job Position: > Affiliation/organization: > E-mail address: sonjafon at gmail.com > > Phone number: > Purpose of use: > Field of interest: > General project description: > > > > > > > -- > Mr Sonja D. Radenkovic, Lecturer > High Economic Professional School Pec-Leposavic > 38218 Leposavic > Serbia > Email: sonjafon at gmail.com > URL: http://www.goodoldai.org/sonja_radenkovic -- Mr Sonja D. Radenkovic, Lecturer High Economic Professional School Pec-Leposavic 38218 Leposavic Serbia Email: sonjafon at gmail.com URL: http://www.goodoldai.org/sonja_radenkovic -------------- next part -------------- An HTML attachment was scrubbed... URL: From philip.alexiev at ontotext.com Mon Nov 8 04:15:19 2010 From: philip.alexiev at ontotext.com (Philip Alexiev @ Ontotext) Date: Mon, 8 Nov 2010 11:15:19 +0200 Subject: [Kim-discussion] Fwd: Re: SwiftOWLIM registration request In-Reply-To: <4CD7B4CF.7050405@ontotext.com> References: <4CD7B4CF.7050405@ontotext.com> Message-ID: <09A55EE4-F801-4D06-93B4-C4FBD9A31ECF@ontotext.com> Hello Sonja There is no easy answer to this question. Platforms as complex as KIM always come with a complex dependency tree. Apart from that some of the jars in the lib/ folder are also developed by Ontotext and can not be found in the public maven repository. One solution to this would be to track the jars from lib/ in the public maven repository (http://mvnrepository.com/) . The ones you can't find are most probably developed by us . You can add them manually as artifacts to your internal maven repository. hth, Philip Alexiev Software Engineer, KIM team On Nov 8, 2010, at 10:29 AM, Anton Andreev wrote: > Dear Ms. Radenkovic, > > I am forwarding your request to the KIM-discussion mailing list: KIM-discussion at ontotext.com. My KIM colleagues will better answer your technical questions as I deal more with OWLIM. > > Best regards, > Anton > > -- > Anton Andreev > Account Manager > Ontotext AD > Tel: +359 2 875 81 17 > Fax:+359 2 975 32 26 > email: anton.andreev at ontotext.com > www.ontotext.com > > -------- Original Message -------- > Subject: Re: SwiftOWLIM registration request > Date: Sun, 7 Nov 2010 20:26:05 +0100 > From: Sonja D. Radenkovic > To: Anton Andreev > > Dear Mr Andreev, > > I have to use KIM in eclipse maeven project for the annotation of resources. Could you, please, help me to configure KIM for that purpose? Till now I?ve done the following things: > Download and install Apache Tomcat 6.0.24 > Download and install KIM 3 platform > Download and install SwiftOWLIM > Extend the KIM ontology and knowledge base > I still don?t know how to include KIM in my eclipse maeven project, since I can?t include .jar files there. I need the information related to adding the KIM dependencies in Maeven, but I couldn?t find it on the Web. Any information would be useful? > > Regards, > Sonja > -- > Mr Sonja D. Radenkovic, Lecturer > High Economic Professional School Pec-Leposavic > 38218 Leposavic > Serbia > Email: sonjafon at gmail.com > URL: http://www.goodoldai.org/sonja_radenkovic > > > > 2010/11/2 Sonja D. Radenkovic > Dear Mr Andreev, > > Danica is my friend from GOOD OLD AI research network (http://www.goodoldai.org/people). I think that she prepares her Ph.D. thesis working on the GATE project at the University of Sheffield. I'm sure that you've had a good experience in collaboration with Danica... > > Thank you for offering the help. I will accept it :). This time I'm trying to configure KIM for the annotation of documents, but I still have some problems. If I can't solve it in the next day or two, I will ask you to help me... > > Best regards, > Sonja > > 2010/11/1 Anton Andreev > > Dear Ms. Radenkovic, > > I also know Ms. Danica Damljanovic. She has visited our office in Ontotext last year.. > > If you have any questions related to OWLIM, do not hesitate to contact me. > > Cheers, > Anton > > > -- > Anton Andreev > Account Manager > Ontotext AD > Tel: +359 2 875 81 17 > Fax:+359 2 975 32 26 > email: anton.andreev at ontotext.com > www.ontotext.com > > On 30.10.2010 ?. 02:41 ?., Sonja D. Radenkovic wrote: >> >> Dear Mr Andreev, >> >> Can you please confirm if this is your LinkedIn profile: http://www.linkedin.com/in/sonjadradenkovic ? Thank you. >> You're right. This is my Linkedln profile. >> >> Sincerely, >> Sonja Radenkovic >> >> On Wed, Oct 27, 2010 at 12:48 PM, Anton Andreev wrote: >> Dear Ms. Radenkovic, >> >> Thank you very much for your interest in SwiftOWLIM. Can you please confirm if this is your LinkedIn profile: http://www.linkedin.com/in/sonjadradenkovic ? Thank you. >> >> You can download the latest SwiftOWLIM distribution here: http://download.ontotext.com/owlim/fc3cb600-7184-4973-97a9-3b97f83e76e7/swiftowlim-3.3.2738.zip >> >> Please read the SwiftOWLIM licence agreement: http://www.ontotext.com/owlim/OWLIMLicenceAgreement.html >> >> In order to get an appreciation for the level of activity in the OWLIM community, we recommend that you subscribe to the OWLIM-discussion mailing list at: http://ontotext.com/mailman/listinfo/OWLIM-discussion This mailing list has a public archive available at: http://www.mail-archive.com/owlim-discussion at ontotext.com/maillist.html >> >> Also, we would very much appreciate a little bit more information about how you intend to use SwiftOWLIM, i.e. size of datasets, inference complexity, application scenarios, etc. This information helps us to understand our customers better and ultimately helps us to improve our software and services. >> >> If you have any further questions, please do not hesitate to contact us at: OWLIM-info at ontotext.com. >> >> We hope you will find SwiftOWLIM useful and we would be happy to receive your feedback! >> >> Best regards, >> Anton Andreev >> >> -- >> Anton Andreev >> Account Manager >> Ontotext AD >> Tel: +359 2 875 81 17 >> Fax:+359 2 975 32 26 >> email: anton.andreev at ontotext.com >> www.ontotext.com >> >> >> On 27.10.2010 ?. 13:03 ?., sonjafon at gmail.com wrote: >> Name: Sonja Radenkovic >> Job Position: >> Affiliation/organization: >> E-mail address: sonjafon at gmail.com >> Phone number: >> Purpose of use: >> Field of interest: >> General project description: >> >> >> >> >> >> -- >> Mr Sonja D. Radenkovic, Lecturer >> High Economic Professional School Pec-Leposavic >> 38218 Leposavic >> Serbia >> Email: sonjafon at gmail.com >> URL: http://www.goodoldai.org/sonja_radenkovic > > > > > > -- > Mr Sonja D. Radenkovic, Lecturer > High Economic Professional School Pec-Leposavic > 38218 Leposavic > Serbia > Email: sonjafon at gmail.com > URL: http://www.goodoldai.org/sonja_radenkovic > > > > > _______________________________________________ > Kim-discussion mailing list > Kim-discussion at ontotext.com > http://ontotext.com/mailman/listinfo/kim-discussion -------------- next part -------------- An HTML attachment was scrubbed... URL: From YVERMILLION at lmi.org Mon Nov 8 15:28:28 2010 From: YVERMILLION at lmi.org (VERMILLION, Bonnie) Date: Mon, 8 Nov 2010 15:28:28 -0500 Subject: [Kim-discussion] question about gate within KIM Message-ID: Is there a way to add a ontology CREOLE plug-in within KIM so that an external ontology can be loaded? Thank you, Bonnie Vermillion Yvonne Vermillion [cid:image001.jpg at 01CB7F59.949E2480] 2000 Corporate Ridge McLean, VA 22102-7805 (571)633-7830 P Complex Problems. Practical Solutions. www.lmi.org -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.jpg Type: image/jpeg Size: 899 bytes Desc: image001.jpg URL: From philip.alexiev at ontotext.com Tue Nov 9 03:27:50 2010 From: philip.alexiev at ontotext.com (Philip Alexiev @ Ontotext) Date: Tue, 9 Nov 2010 10:27:50 +0200 Subject: [Kim-discussion] question about gate within KIM In-Reply-To: References: Message-ID: Hi Yvonne, In order to use a new ontology it is good to map it to your top ontology classes. http://ontotext.com/kim/doc/KimDocs-3.0-EN/ExtendInformationExtraction.html This is a good guide showing how you can do this. tht Philip Alexiev Software Engineer, KIM team On Nov 8, 2010, at 10:28 PM, VERMILLION, Bonnie wrote: > Is there a way to add a ontology CREOLE plug-in within KIM so that an external ontology can be loaded? > > Thank you, > Bonnie Vermillion > > Yvonne Vermillion > > > > 2000 Corporate Ridge > McLean, VA 22102-7805 > (571)633-7830 P > > Complex Problems. Practical Solutions. > www.lmi.org > > > > _______________________________________________ > Kim-discussion mailing list > Kim-discussion at ontotext.com > http://ontotext.com/mailman/listinfo/kim-discussion -------------- next part -------------- An HTML attachment was scrubbed... URL: From borislav.popov at ontotext.com Tue Nov 9 04:01:55 2010 From: borislav.popov at ontotext.com (borislav popov) Date: Tue, 9 Nov 2010 11:01:55 +0200 Subject: [Kim-discussion] question about gate within KIM In-Reply-To: References: Message-ID: <83E46363-DAA5-4E7E-96FD-32B8B633E102@ontotext.com> Hi Bonnie, actually your request and philip's answer point in different directions. The ontology plugin in GATE provides partial coverage of what is available in Sesame 2 and/or OWLIM 3 as semantic repository APIs. It is not used in KIM - there you have the direct integration with Sesame-compatible repository, incl. our OWLIM. For client application of KIM - there is also a higher level API accessible on the same level as our search or doc-related functionality. In a KIM context the extension of the default ontology is explained in the documentation piece provided by philip. There are certain things to take into account to ensure the mapping to the default ontology is right and the modeling paradigms of your ontology are compatible with the extraction pipeline - to bootstrap automatic recognition of new entities, given the ontology comes with entity descriptions / knowledge base as well. you can tell us more about your experiments - so that we can suggest the route more accurately. If you consider it confidential - you may also avoid the discussion list, which is public and write directly to us as we have NDA already. all the best borislav On Nov 9, 2010, at 10:27 AM, Philip Alexiev @ Ontotext wrote: > Hi Yvonne, > > In order to use a new ontology it is good to map it to your top > ontology classes. > > http://ontotext.com/kim/doc/KimDocs-3.0-EN/ExtendInformationExtraction.html > > This is a good guide showing how you can do this. > > tht > Philip Alexiev > Software Engineer, KIM team > > > > > On Nov 8, 2010, at 10:28 PM, VERMILLION, Bonnie wrote: > >> Is there a way to add a ontology CREOLE plug-in within KIM so that >> an external ontology can be loaded? >> >> Thank you, >> Bonnie Vermillion >> >> Yvonne Vermillion >> >> >> >> 2000 Corporate Ridge >> McLean, VA 22102-7805 >> (571)633-7830 P >> >> Complex Problems. Practical Solutions. >> www.lmi.org >> >> >> >> _______________________________________________ >> Kim-discussion mailing list >> Kim-discussion at ontotext.com >> http://ontotext.com/mailman/listinfo/kim-discussion > > _______________________________________________ > Kim-discussion mailing list > Kim-discussion at ontotext.com > http://ontotext.com/mailman/listinfo/kim-discussion -------------- next part -------------- An HTML attachment was scrubbed... URL: From YVERMILLION at lmi.org Tue Nov 9 07:35:12 2010 From: YVERMILLION at lmi.org (VERMILLION, Bonnie) Date: Tue, 9 Nov 2010 07:35:12 -0500 Subject: [Kim-discussion] question about gate within KIM In-Reply-To: References: Message-ID: Thank you Phillip! Bonnie Vermillion From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at ontotext.com] Sent: Tuesday, November 09, 2010 3:28 AM To: VERMILLION, Bonnie Cc: kim-discussion at ontotext.com Subject: Re: [Kim-discussion] question about gate within KIM Hi Yvonne, In order to use a new ontology it is good to map it to your top ontology classes. http://ontotext.com/kim/doc/KimDocs-3.0-EN/ExtendInformationExtraction.html This is a good guide showing how you can do this. tht Philip Alexiev Software Engineer, KIM team On Nov 8, 2010, at 10:28 PM, VERMILLION, Bonnie wrote: Is there a way to add a ontology CREOLE plug-in within KIM so that an external ontology can be loaded? Thank you, Bonnie Vermillion Yvonne Vermillion 2000 Corporate Ridge McLean, VA 22102-7805 (571)633-7830 P Complex Problems. Practical Solutions. www.lmi.org _______________________________________________ Kim-discussion mailing list Kim-discussion at ontotext.com http://ontotext.com/mailman/listinfo/kim-discussion -------------- next part -------------- An HTML attachment was scrubbed... URL: From YVERMILLION at lmi.org Tue Nov 9 07:38:25 2010 From: YVERMILLION at lmi.org (VERMILLION, Bonnie) Date: Tue, 9 Nov 2010 07:38:25 -0500 Subject: [Kim-discussion] question about gate within KIM In-Reply-To: <83E46363-DAA5-4E7E-96FD-32B8B633E102@ontotext.com> References: <83E46363-DAA5-4E7E-96FD-32B8B633E102@ontotext.com> Message-ID: Thank you Borislav! I'll let you know if I need further assistance! Bonnie Vermillion Yvonne Vermillion [cid:image001.jpg at 01CB7FE1.15469EF0] 2000 Corporate Ridge McLean, VA 22102-7805 (571)633-7830 P Complex Problems. Practical Solutions. www.lmi.org From: borislav popov [mailto:borislav.popov at ontotext.com] Sent: Tuesday, November 09, 2010 4:02 AM To: VERMILLION, Bonnie Cc: kim-discussion; philip Subject: Re: [Kim-discussion] question about gate within KIM Hi Bonnie, actually your request and philip's answer point in different directions. The ontology plugin in GATE provides partial coverage of what is available in Sesame 2 and/or OWLIM 3 as semantic repository APIs. It is not used in KIM - there you have the direct integration with Sesame-compatible repository, incl. our OWLIM. For client application of KIM - there is also a higher level API accessible on the same level as our search or doc-related functionality. In a KIM context the extension of the default ontology is explained in the documentation piece provided by philip. There are certain things to take into account to ensure the mapping to the default ontology is right and the modeling paradigms of your ontology are compatible with the extraction pipeline - to bootstrap automatic recognition of new entities, given the ontology comes with entity descriptions / knowledge base as well. you can tell us more about your experiments - so that we can suggest the route more accurately. If you consider it confidential - you may also avoid the discussion list, which is public and write directly to us as we have NDA already. all the best borislav On Nov 9, 2010, at 10:27 AM, Philip Alexiev @ Ontotext wrote: Hi Yvonne, In order to use a new ontology it is good to map it to your top ontology classes. http://ontotext.com/kim/doc/KimDocs-3.0-EN/ExtendInformationExtraction.html This is a good guide showing how you can do this. tht Philip Alexiev Software Engineer, KIM team On Nov 8, 2010, at 10:28 PM, VERMILLION, Bonnie wrote: Is there a way to add a ontology CREOLE plug-in within KIM so that an external ontology can be loaded? Thank you, Bonnie Vermillion Yvonne Vermillion 2000 Corporate Ridge McLean, VA 22102-7805 (571)633-7830 P Complex Problems. Practical Solutions. www.lmi.org _______________________________________________ Kim-discussion mailing list Kim-discussion at ontotext.com http://ontotext.com/mailman/listinfo/kim-discussion _______________________________________________ Kim-discussion mailing list Kim-discussion at ontotext.com http://ontotext.com/mailman/listinfo/kim-discussion -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.jpg Type: image/jpeg Size: 899 bytes Desc: image001.jpg URL: From heapifyman at gmail.com Thu Nov 11 12:24:51 2010 From: heapifyman at gmail.com (heapifyman) Date: Thu, 11 Nov 2010 18:24:51 +0100 Subject: [Kim-discussion] How to add com.ontotext.platform-api.jar to artifactory Message-ID: <4CDC26E3.8010405@gmail.com> Good evening everyone. I have a little problem trying to use the maven artefacts for the KIM Java RMI API as is suggested to use here: http://ontotext.com/kim/doc/KimDocs-3.0-EN/KIMJavaRMIAPI.html The first problem was, that the kim-api depends on com.ontotext.platform-api, which is not available in the public maven repo. I had to extract that from the downloaded KIM platform zip file and install it manually in my maven repo (which is artifactory). Next problem is: platform-api in turn includes "com.ontotext.platform" as its parent. Unfortunately, I cannot find this artefact in any of the public maven repositories nor in the KIM platform zip file. Thus my maven build fails because the parent pom cannot be resolved. I'd appreciate any tips about how to proceed? Best regards. P.S.: My recommendation would be that the kim-api's dependencies should be available in the public maven repository. Otherwise it does not make much sense to provide instructions like: "maven users can just reference the kim-api artifact from our public repository" in the documentation. -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 259 bytes Desc: OpenPGP digital signature URL: From Anton.Andreev at ontotext.com Fri Nov 12 03:44:42 2010 From: Anton.Andreev at ontotext.com (Anton Andreev) Date: Fri, 12 Nov 2010 10:44:42 +0200 Subject: [Kim-discussion] Fwd: Help requested Message-ID: <4CDCFE7A.6030904@ontotext.com> Hello Mel, I am forwarding your questions to the KIM discussion mailing list. The KIM team receives this mailing list and they will assist you. Regards, Anton Andreev -------- Original Message -------- Subject: Help requested Date: Thu, 11 Nov 2010 08:43:54 -0800 (PST) From: Melroy Rodrigues To: info at ontotext.com I have downloaded KIM. However, I have a few questions. I need to extract safety related information from certain texts documents and online. How would I go about doing so? I would need to create an ontology and user the Populator to add that ontology into KIM's backend? what next, how do I run my documents through KIM so that the relevant information is extracted. Also I need to programmaticaly work with the extracted entities. How would I do that. Finally is KIM's ontology module support semi supervised learning? Thanks Mel -------------- next part -------------- An HTML attachment was scrubbed... URL: From philip.alexiev at ontotext.com Fri Nov 12 05:07:40 2010 From: philip.alexiev at ontotext.com (Philip Alexiev @ Ontotext) Date: Fri, 12 Nov 2010 12:07:40 +0200 Subject: [Kim-discussion] Fwd: Help requested In-Reply-To: <4CDCFE7A.6030904@ontotext.com> References: <4CDCFE7A.6030904@ontotext.com> Message-ID: Hi Mel, KIM comes with a good set of documentation which will help you. A good place to start is the Quick Start Guide. It is a short tour through the common process of using KIM - downloading, installing, setting up, populating, searching . If you want to customize the information extraction process, the system documentation will be of great use: http://ontotext.com/kim/doc/KimDocs-3.0-EN/HomePage.html . Basically, you have two options for the ontology. You can replace the ontology in KIM completely with your own. Or, it may be more useful to map the new ontology to PROTON and reuse the knowledge already in the system. The extent of the mapping depends on how much of your ontology may be covered by PROTON - KIM's default ontology (http://proton.semanticweb.org/) . After this generally you would want to populate the system with some documents (using the populator tool) . Populating a document performs IE over it and stores the document and the entities mentioned in it in the semantic and document repositories. KIM's API provides functionality to access the documents and entities you have created. You can check it at (http://nmwiki.ontotext.com/kim-javadoc/index.html) About the semi-supervised learning - we haven't had such a use case, but we have the infrastructure to support it. Hope this helps Philip Alexiev Software Engineer, KIM team > > -------- Original Message -------- > Subject: Help requested > Date: Thu, 11 Nov 2010 08:43:54 -0800 (PST) > From: Melroy Rodrigues > To: info at ontotext.com > > I have downloaded KIM. However, I have a few questions. I need to extract safety related information from certain texts documents and online. How would I go about doing so? > > I would need to create an ontology and user the Populator to add that ontology into KIM's backend? what next, how do I run my documents through KIM so that the relevant information is extracted. Also I need to programmaticaly work with the extracted entities. How would I do that. Finally is KIM's ontology module support semi supervised learning? > > Thanks > Mel > > > > _______________________________________________ > Kim-discussion mailing list > Kim-discussion at ontotext.com > http://ontotext.com/mailman/listinfo/kim-discussion -------------- next part -------------- An HTML attachment was scrubbed... URL: From philip.alexiev at ontotext.com Fri Nov 12 05:59:03 2010 From: philip.alexiev at ontotext.com (Philip Alexiev @ Ontotext) Date: Fri, 12 Nov 2010 12:59:03 +0200 Subject: [Kim-discussion] How to add com.ontotext.platform-api.jar to artifactory In-Reply-To: <4CDC26E3.8010405@gmail.com> References: <4CDC26E3.8010405@gmail.com> Message-ID: <4A2B5AF8-8E12-4884-A9C4-CE071FE6F2DC@ontotext.com> Hi You can add an option to the platform-api dependency in the pom: optional This will stop maven from trying to download it. We will see which is the best way to handle this in our repository. hth, Philip On Nov 11, 2010, at 7:24 PM, heapifyman wrote: > > Good evening everyone. > > I have a little problem trying to use the maven artefacts for the KIM > Java RMI API as is suggested to use here: > http://ontotext.com/kim/doc/KimDocs-3.0-EN/KIMJavaRMIAPI.html > > The first problem was, that the kim-api depends on > com.ontotext.platform-api, which is not available in the public maven > repo. I had to extract that from the downloaded KIM platform zip file > and install it manually in my maven repo (which is artifactory). > > Next problem is: > platform-api in turn includes "com.ontotext.platform" as its parent. > Unfortunately, I cannot find this artefact in any of the public maven > repositories nor in the KIM platform zip file. > > Thus my maven build fails because the parent pom cannot be resolved. > > I'd appreciate any tips about how to proceed? > > Best regards. > > P.S.: My recommendation would be that the kim-api's dependencies should > be available in the public maven repository. Otherwise it does not make > much sense to provide instructions like: > "maven users can just reference the kim-api artifact from our public > repository" > in the documentation. > > > > _______________________________________________ > Kim-discussion mailing list > Kim-discussion at ontotext.com > http://ontotext.com/mailman/listinfo/kim-discussion From philip.alexiev at ontotext.com Fri Nov 12 11:18:59 2010 From: philip.alexiev at ontotext.com (Philip Alexiev @ Ontotext) Date: Fri, 12 Nov 2010 18:18:59 +0200 Subject: [Kim-discussion] How to add com.ontotext.platform-api.jar to artifactory In-Reply-To: <4CDD5ABB.3050400@gmail.com> References: <4CDC26E3.8010405@gmail.com> <4A2B5AF8-8E12-4884-A9C4-CE071FE6F2DC@ontotext.com> <4CDD3AD4.4040305@gmail.com> <4CDD5ABB.3050400@gmail.com> Message-ID: Yes you are right. I guess it was not deeply tested. We have deployed the channel_iface_impl_stub to the public repository. Also you will have to include the aduna repository. Here is the pom snippet that will help you: aduna Aduna Main Repository http://repo.aduna-software.org/maven2/releases public Ontotext Public http://maven.ontotext.com/archiva/repository/public Please write if you still have problems. We tested it with a clean local repository and everything should be OK. All the best Philip On Nov 12, 2010, at 5:18 PM, heapifyman wrote: > > Ah, one more thing: > > I assume the org.openrdf.util.rmirouting.channel_iface_impl_stub > dependency cannot be excluded? > I can add this manually to my repo but for ease of use it would be good > to make this available in the public repo or also mention in the > documentation that one has to deploy it manually. > > Best regards, > Philip > > Am 12.11.2010 15:54, schrieb Philip Alexiev @ Ontotext: >> Hi Philip, >> >> This is the case. platform-api is needed by kim-api, only for a part that is still experimental (the jms part). This means that you can go without it. So you can exclude it from the dependency. In your pom you can add kim-api like this: >> >> >> com.ontotext.kim >> kim-api >> 3.0-RC4 >> >> >> com.ontotext >> platform-api >> >> >> >> >> This will get kim-api without platform-api. And you will have no problems compiling and running your client, as you don't actually use the JMS part. >> >> Apologies for the unclarity. We will update the documentation to reflect our conversation. Thank you for your patience. >> >> All the best, >> Philip >> >> >> On Nov 12, 2010, at 3:02 PM, heapifyman wrote: >> >>> Am 12.11.2010 11:59, schrieb Philip Alexiev @ Ontotext: >>>> Hi >>> >>> Hello, >>> >>>> >>>> You can add an option to the platform-api dependency in the pom: >>>> >>>> optional >>> >>> I'm not sure I understand. I only have kim-api version 3.0-RC4 as a >>> dependency in my pom and the public ontotext maven repository as repository: >>> >>> >>> com.ontotext.kim >>> kim-api >>> 3.0-RC4 >>> >>> >>> >>> repo-ontotext >>> Ontotext Maven Repository >>> http://maven.ontotext.com/archiva/repository/public/ >>> >>> false >>> >>> >>> >>> So the kim-api jar and pom are automatically downloaded by maven from there. >>> >>> But the kim-api pom has a dependency for com.ontotext.platform-api >>> version 0.6 defined but platform-api is not in above listed public >>> repository. I can take the platform-api jar from the kim server >>> distribution zip and add it manually to my local maven repository. >>> But platform-api has as parent pom referenced: com.ontotext.platform >>> version 0.6 >>> >>> This is neither in the public maven repository nor in the distribution >>> zip file and cannot be resolved by maven. >>> >>> Long story short, I believe you have to declare the platform-api >>> dependency in kim-api as optional or provide both platform-api and its >>> parent platform in your public maven repo. >>> >>> Or maybe I misunderstood something. >>> >>> Best, >>> Philip >>> >>>> >>>> This will stop maven from trying to download it. >>>> >>>> We will see which is the best way to handle this in our repository. >>>> >>>> hth, >>>> Philip >>>> >>>> On Nov 11, 2010, at 7:24 PM, heapifyman wrote: >>>> >>>>> >>>>> Good evening everyone. >>>>> >>>>> I have a little problem trying to use the maven artefacts for the KIM >>>>> Java RMI API as is suggested to use here: >>>>> http://ontotext.com/kim/doc/KimDocs-3.0-EN/KIMJavaRMIAPI.html >>>>> >>>>> The first problem was, that the kim-api depends on >>>>> com.ontotext.platform-api, which is not available in the public maven >>>>> repo. I had to extract that from the downloaded KIM platform zip file >>>>> and install it manually in my maven repo (which is artifactory). >>>>> >>>>> Next problem is: >>>>> platform-api in turn includes "com.ontotext.platform" as its parent. >>>>> Unfortunately, I cannot find this artefact in any of the public maven >>>>> repositories nor in the KIM platform zip file. >>>>> >>>>> Thus my maven build fails because the parent pom cannot be resolved. >>>>> >>>>> I'd appreciate any tips about how to proceed? >>>>> >>>>> Best regards. >>>>> >>>>> P.S.: My recommendation would be that the kim-api's dependencies should >>>>> be available in the public maven repository. Otherwise it does not make >>>>> much sense to provide instructions like: >>>>> "maven users can just reference the kim-api artifact from our public >>>>> repository" >>>>> in the documentation. >>>>> >>>>> >>>>> >>>>> _______________________________________________ >>>>> Kim-discussion mailing list >>>>> Kim-discussion at ontotext.com >>>>> http://ontotext.com/mailman/listinfo/kim-discussion >>>> >>> >>> >> > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From philip.alexiev at ontotext.com Tue Nov 16 13:46:02 2010 From: philip.alexiev at ontotext.com (Philip Alexiev @ Ontotext) Date: Tue, 16 Nov 2010 20:46:02 +0200 Subject: [Kim-discussion] question about gate within KIM In-Reply-To: References: <83E46363-DAA5-4E7E-96FD-32B8B633E102@ontotext.com> <25B94943-AFED-46DC-A827-0452C3506530@ontotext.com> <1EE46E0D-41AB-42FE-B077-654E683885E9@ontotext.com> <787EE2AB-D3BF-4AED-B748-31D39E0492DF@ontotext.com> Message-ID: Hi Bonnie I guess my editor has put some strange character there. Just copy-paste it in a simple text editor (notepad) and save it. This should save only the readable characters. hth Philip On Nov 16, 2010, at 6:55 PM, VERMILLION, Bonnie wrote: > Hi Phillip, > I?m getting an error from the query file in red below: > > Can you let me know what to do to correct it? > > Thank you, > Bonnie > > 1:52:51 [INFO] 2371[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - Labels are loaded from aliases. > 11:52:51 [DEBUG] 2480[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - classes cache contains 321 items. here is the first: http://proton.semanticweb.org/2006/05/protonu#AirplaneModel > 11:52:51 [DEBUG] 2776[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - direct subs cache contains 321 items. here is the first: http://proton.semanticweb.org/2006/05/protonu#AirplaneModel=[] > 11:52:51 [DEBUG] 2776[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - all subs cache contains 321 items. here is the first: http://proton.semanticweb.org/2006/05/protonu#AirplaneModel=[http://proton.semanticweb.org/2006/05/protonu#AirplaneModel] > 11:52:51 [DEBUG] 2776[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - supers cache contains 321 items. here is the first: http://proton.semanticweb.org/2006/05/protonu#AirplaneModel=[http://proton.semanticweb.org/2006/05/protonu#AirplaneModel, http://www.w3.org/2000/01/rdf-schema#Resource, http://proton.semanticweb.org/2006/05/protont#ProductModel, http://proton.semanticweb.org/2006/05/protont#Object, http://proton.semanticweb.org/2006/05/protons#Entity] > 11:52:51 [INFO] 2792[ComponentStarter-Thread-2](KIM_SERVICE) - Waking Up GATE... > 11:52:51 [INFO] 3276[ComponentStarter-Thread-2](KIM_SERVICE) - GATE is AWAKE. > 11:52:51 [INFO] 3291[ComponentStarter-Thread-2](KIM_SERVICE) - Loading C:\KIM\kim-platform-3.0-RC4\context\default\resources\IE.gapp > 11:52:55 [INFO] 7176[ComponentStarter-Thread-2](gate.LargeKBGazetteer) - Replaced $relpath$ in gazetteer parameters with C:\KIM\kim-platform-3.0-RC4\context\default\resources/ > 11:52:55 [INFO] 7207[ComponentStarter-Thread-2](model.KimDictionaryFeederImpl) - Loading of trusted entities from Sesame > 11:52:55 [DEBUG] 7207[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - Executing evaluateQuery('select lbl, i, dc > from > {i} {lbl}, > {i} serql:directType {dc}, > {i} {} > ','null', listener) > 11:52:55 [DEBUG] 7207[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - org.openrdf.query.MalformedQueryException: Lexical error at line 1, column 8. Encountered: "\u00a0" (160), after : "" > 11:52:55 [DEBUG] 7238[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - org.openrdf.query.MalformedQueryException: Lexical error at line 1, column 8. Encountered: "\u00a0" (160), after : "" > 11:52:55 [INFO] 7238[ComponentStarter-Thread-2](model.KimDictionaryFeederImpl) - The loading of the Static Dictionary finished > 11:52:58 [INFO] 10046[ComponentStarter-Thread-2](KIM_SERVICE) - Get EntityAPI. > 11:52:58 [DEBUG] 10046[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - Executing evaluateQuery('select COUNTRY,ADJ from {COUNTRY} {ADJ}','SeRQL', listener) > 11:52:58 [INFO] 10077[ComponentStarter-Thread-2](ig.RelationExtractors) - Total external relations successfuly loaded : 0 out of 0 supplied. > 11:52:58 [INFO] 10108[ComponentStarter-Thread-2](KIM_SERVICE) - SemanticAnnotationAPI loaded on Tue Nov 16 11:52:58 EST 2010 > 11:52:58 [INFO] 10108[ComponentStarter-Thread-2](NERC) - GATE pipelines=1 > 11:52:58 [INFO] 10124[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - KIMDocument Feature Schema loaded from Configuration file. > 11:52:58 [INFO] 10140[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - KIMDocument Feature Schema loaded from Configuration file. > 11:52:58 [INFO] 10140[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - KIMDocument Feature Schema loaded from Configuration file. > 11:52:59 [INFO] 10342[ComponentStarter-Thread-2](KIM_SERVICE) - CORE Index Addon: class com.ontotext.kim.coredb.CachingCoreWrapper > 11:52:59 [INFO] 10358[ComponentStarter-Thread-2](KIM_SERVICE) - Loaded extension: com.ontotext.kim.coredb.management.RdfCoreAdminExt > 11:52:59 [INFO] 10374[ComponentStarter-Thread-2](KIM_SERVICE) - Loaded extension: com.ontotext.kim.util.FactoryImpl > 11:52:59 [INFO] 10374[ComponentStarter-Thread-2](KIM_SERVICE) - Loaded extension: com.ontotext.kim.util.console.ConsoleTasksExtension > 11:52:59 [INFO] 10389[ComponentStarter-Thread-2](KIM_SERVICE) - Loaded extension: com.ontotext.kim.gate.TeamwareAdapter > 11:52:59 [INFO] 10389[ComponentStarter-Thread-2](KIM_SERVICE) - Loaded extension: com.ontotext.kim.rss.KimRssDatabase > 11:52:59 [INFO] 10405[ComponentStarter-Thread-2](KIM_SERVICE) - KIM Server startup ended! > > From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at ontotext.com] > Sent: Tuesday, November 16, 2010 10:29 AM > To: VERMILLION, Bonnie > Cc: borislav popov; Matthew Petrillo; WILSON, Greg; ENUGU, Reddy (Independent Contractor) > Subject: Re: [Kim-discussion] question about gate within KIM > > Hi Bonnie, > > From the output of you have sent me, I conclude that you have not cleared the cache after changing the configuration. The cache lives in KIM/context/default/populated. Remove the entire directory clear it. > > Now if you want the gazetteer to entirely use your ontology instead of KIM's , you should have some things in mind. > > The gazetteer resource has a setup option FeedSetupPath, which is a path where it searches for a file named query.txt . In your case the path is KIM/config/ . This file contains a query in serql or sparql and is responsible for filling the dictionary of the gazetteer. The query should return exactly 3 characteristics of each entity you would like to put in the dictionary: > * the label of the entity > * the instance URI of the entity > * the direct class this entity is instance of > > If the gazetteer does not find such a file, it uses this query: > > select LA, I, DC from > ( > {TI} rdf:type {}, > {I} {TI}, > {I} rdf:type {}, > {I} serql:directType {DC}, > {I} {} rdfs:label {LA}; > [ {IG}] > ) UNION ( > {I} {}, > {I} serql:directType {DC}, > {I} {LA} > ) > WHERE > IG = NULL > AND isLiteral(LA) > AND DC != > AND NOT LA = "" > > > If you set the semantic repository logger level to DEBUG you could see this in the log. Just change in KIM/config/log.prop : > log4j.category.SEMANTIC_REPOSITORY = , aSEMANTIC_REPOSITORY > to > log4j.category.SEMANTIC_REPOSITORY = DEBUG, aSEMANTIC_REPOSITORY > > > You could create a file KIM/config/query.txt and provide a simpler query like: > > select lbl, i, dc > from > {i} {lbl}, > {i} serql:directType {dc}, > {i} {} > > Now the instances of Actor and its subclasses will be recognized in the text. > > Note: One thing that puzzled me when I looked at your screenshots, is that Role was a subclass of Actor. The relation here should be Actor hasRole Role I think. > > To be able to see your classes in KIM's web interface, you should actually mark them as visible. This happens by providing the triples like this to your RDF: > "" . > > you can see KIM's visibility configuration in KIM/context/default/kb/visibility.nt . > > > Please notify me of your progress, so that I can help further > Philip > > On Nov 16, 2010, at 3:07 PM, VERMILLION, Bonnie wrote: > > > Thanks Phillip. > > At some point we may have lists such as specific Codes that have a list of values that would be suitable for a gazetteer list. > > For now what we want to do is turn off Proton (which I think I have done since there are references to Person, Organization or Location in the ontology shown in KIM. So, I?m not sure where the ontology that is now listed in KIM is coming from . But we need to turn it off so that when we load a sample ontology, it just shows the ontology we are loading. > > Please see the attached screen shots attached. > > Thank you, > Bonnie > > From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at ontotext.com] > Sent: Tuesday, November 16, 2010 3:26 AM > To: VERMILLION, Bonnie > Cc: borislav popov; Matthew Petrillo; WILSON, Greg; ENUGU, Reddy (Independent Contractor) > Subject: Re: [Kim-discussion] question about gate within KIM > > Hi Bonnie, > > I guess you would want to run only a gazetteer with your ontology, to observe which entities are recognized? Will this help you? > > Philip > > On Nov 16, 2010, at 5:05 AM, VERMILLION, Bonnie wrote: > > > > Phillip, > > I was able to follow the document that you provided in order to load a sample ontology, but because Proton and Annie are still running, the results are not clear. How can I turn off Proton and Annie? > > Thank you, > Bonnie > > From: VERMILLION, Bonnie > Sent: Tuesday, November 09, 2010 11:08 AM > To: 'Philip Alexiev @ Ontotext' > Cc: borislav popov; Matthew Petrillo; WILSON, Greg; ENUGU, Reddy (Independent Contractor) > Subject: RE: [Kim-discussion] question about gate within KIM > > Thanks Phillip. Great explanation! > > For the ontology I am trying to load we have both classes and instances. Though we do have one ontology that only has classes. > > I?ll let you know the result after following your response. > > Thank you, > Bonnie > > From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at ontotext.com] > Sent: Tuesday, November 09, 2010 10:54 AM > To: VERMILLION, Bonnie > Cc: borislav popov; Matthew Petrillo; WILSON, Greg; ENUGU, Reddy (Independent Contractor) > Subject: Re: [Kim-discussion] question about gate within KIM > > Hi Bonnie, > > The act of extending the ontology alone, does not add value to your IE. It will only store those entities in the semantic repository. In order for those entities to be included in the LKB gazetteer dictionary, they have to meet 3 conditions: > are of a type that is a subclass of protons:Entity > have at least one alias > are marked as Trusted > That way the gazetteer will create Lookup annotations when he meets one of those in the text. Later you can transform them using Jape rules. > > Does your owl file contain instances or only classes? In the general case you need instances to be recognized in the texts. > > It is a good idea to map some of your classes to PROTON only if you find they are expressing the same concept. Otherwise just subclass your top classes to protons:Entity . > > ?Include the new files in the import section of owlim? > OWLIM's configuration resides in KIM/config/owlim.ttl . There is a owlim:imports section there. Add your custom files there. The path is relative to KIM/context/default/ . If you have already ran KIM, some cache will exist. In this case you will have to clear the cache in order for the changes to take effect. To do this, perform the following steps: > * stop KIM > * delete KIM/context/default/populated/ (NOTE:this will clear all the cache, including the documents in the document repository). > * start KIM > > All the best, > Philip > > On Nov 9, 2010, at 5:22 PM, VERMILLION, Bonnie wrote: > > > Thanks Phillip. > > We have several ontologies that we created in Prot?g?. So we have the .owl files. > > I?m following the documentation that you pointed me to ? > Create a sub-folder in the KIM context folder. It will be used as storage for all the RDF data for this task. > For example, create $KIM_HOME/context/default/kb/dbpedia/. > We recommend this location but you can put your RDF data anywhere in the KIM context folder. > Put dbpedia_3.5.1.owl , containing the DBpedia taxonomy, in $KIM_HOME/context/default/kb/dbpedia/ > Put dbpedia_instances.nt , containing the actual objects description, in $KIM_HOME/context/default/kb/dbpedia/ > Include the new files in the import section of owlim ( $KIM_HOME/config/owlim.ttl ): > I created a subfolder und the kb directory and copied an .owl file created in Prot?g?. > I?m not sure how to create the .nt file, and the ontology that I?m using does not have Person, Organization or Place domains ? so there is nothing to align with Proton. > I?m also not sure what is meant by ? ?Include the new files in the import section of owlim? > Thanks for your expertise! > Bonnie > > > From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at ontotext.com] > Sent: Tuesday, November 09, 2010 9:37 AM > To: VERMILLION, Bonnie > Cc: borislav popov; Matthew Petrillo; WILSON, Greg; ENUGU, Reddy (Independent Contractor) > Subject: Re: [Kim-discussion] question about gate within KIM > > Hi Bonnie, > > Gate embedded in KIM functions the same way. A difference is that not all the plugins available in GATE developer are directly available in KIM too. You can check the KIM/plugins/ folder. Generally if you import the Ontology plugin you should be able to use the Ontology language resources as you intend to. > > I am sure that if you provide some more information about what you want to achieve, we will be able to provide more meaningful support. A simple usecase will help a lot. > > All the best, > Philip > > On Nov 9, 2010, at 4:03 PM, VERMILLION, Bonnie wrote: > > > > > > Thanks, Borislov. I will try following the document Phillip mentioned. I guess I was thinking that Gate within KIM would function as it does independently ? that is to use Prot?g? to create an ontology and then load the ontology by indicating a CREOLE ?ontology? plug-in and then a Sesame or OWLIM ontology language resource can be used to load the ontology created from Prot?g?. Sorry for the poor explanation. > > I?ll report back! > > Thank you, > Bonnie > > From: borislav popov [mailto:borislav.popov at ontotext.com] > Sent: Tuesday, November 09, 2010 8:40 AM > To: VERMILLION, Bonnie > Cc: Matthew Petrillo; WILSON, Greg; ENUGU, Reddy (Independent Contractor); philip > Subject: Re: [Kim-discussion] question about gate within KIM > > Hi Bonnie, > i will keep philip posted as well on this one. > the page philip sent explains how to do this loading & mapping of the new ontology to the default one in KIM (PROTON). This is not exactly a user friendly task - as it is more for administrators of the kim server. > Generally this is a task you do initially and the demonstration UIs are not targeted to these people, but the end users. > In GATE you can play with loading the ontology if this is helpful to get a better feeling of the data. > Regarding: the last sentence of loading the ontology and not the rdf triples - i did not really get it - as ontologies are usually expressed in triples. if you want to avoid loading the instance data - it is handy if they come in separate files. > > philip please add if i missed something > b > > > On Nov 9, 2010, at 3:03 PM, VERMILLION, Bonnie wrote: > > > > > > > Borislav, > > Thank you for your response! > > After looking at the documentation that Philip referred to, I agree that it is not necessary what I am looking for. > > What I?m trying to do is to import (if this is possible) an ontology similar to loading an ontology from Prot?g? in to Gate based on the fact that I have select an ontology processing resource that was loaded as a CREOLE plug-in. However, in KIM, there is no such plug-in within the inherent GATE tool. Can I add this CREOLE plug-in to Gate within KIM? Or is there another way to accomplish loading the ontology without having to load the RDF triples as well. > > Thank you in advance for your assistance! > Bonnie Vermillion > > Yvonne Vermillion > > > > 2000 Corporate Ridge > McLean, VA 22102-7805 > (571)633-7830 P > > > > > > > Complex Problems. Practical Solutions. > www.lmi.org > > > > From: borislav popov [mailto:borislav.popov at ontotext.com] > Sent: Tuesday, November 09, 2010 4:02 AM > To: VERMILLION, Bonnie > Cc: kim-discussion; philip > Subject: Re: [Kim-discussion] question about gate within KIM > > Hi Bonnie, > actually your request and philip's answer point in different directions. The ontology plugin in GATE provides partial coverage of what is available in Sesame 2 and/or OWLIM 3 as semantic repository APIs. > It is not used in KIM - there you have the direct integration with Sesame-compatible repository, incl. our OWLIM. For client application of KIM - there is also a higher level API accessible on the same level as our search or doc-related functionality. > In a KIM context the extension of the default ontology is explained in the documentation piece provided by philip. > There are certain things to take into account to ensure the mapping to the default ontology is right and the modeling paradigms of your ontology are compatible with the extraction pipeline - to bootstrap automatic recognition of new entities, given the ontology comes with entity descriptions / knowledge base as well. > you can tell us more about your experiments - so that we can suggest the route more accurately. If you consider it confidential - you may also avoid the discussion list, which is public and write directly to us as we have NDA already. > all the best > borislav > > > On Nov 9, 2010, at 10:27 AM, Philip Alexiev @ Ontotext wrote: > > > > > > > > Hi Yvonne, > > In order to use a new ontology it is good to map it to your top ontology classes. > > http://ontotext.com/kim/doc/KimDocs-3.0-EN/ExtendInformationExtraction.html > > This is a good guide showing how you can do this. > > tht > Philip Alexiev > Software Engineer, KIM team > > > > > On Nov 8, 2010, at 10:28 PM, VERMILLION, Bonnie wrote: > > > > > > > > Is there a way to add a ontology CREOLE plug-in within KIM so that an external ontology can be loaded? > > Thank you, > Bonnie Vermillion > > Yvonne Vermillion > > > > 2000 Corporate Ridge > McLean, VA 22102-7805 > (571)633-7830 P > > > > > > > > Complex Problems. Practical Solutions. > www.lmi.org > > > > _______________________________________________ > Kim-discussion mailing list > Kim-discussion at ontotext.com > http://ontotext.com/mailman/listinfo/kim-discussion > > _______________________________________________ > Kim-discussion mailing list > Kim-discussion at ontotext.com > http://ontotext.com/mailman/listinfo/kim-discussion > > > > > > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From YVERMILLION at lmi.org Tue Nov 16 14:02:50 2010 From: YVERMILLION at lmi.org (VERMILLION, Bonnie) Date: Tue, 16 Nov 2010 14:02:50 -0500 Subject: [Kim-discussion] question about gate within KIM References: <83E46363-DAA5-4E7E-96FD-32B8B633E102@ontotext.com> <25B94943-AFED-46DC-A827-0452C3506530@ontotext.com> <1EE46E0D-41AB-42FE-B077-654E683885E9@ontotext.com> <787EE2AB-D3BF-4AED-B748-31D39E0492DF@ontotext.com> Message-ID: Also Phillip - the visibility error is from me trying to put the visibility statements in the visibility.nt file From: VERMILLION, Bonnie Sent: Tuesday, November 16, 2010 2:00 PM To: 'Philip Alexiev @ Ontotext' Cc: borislav popov; Matthew Petrillo; WILSON, Greg; ENUGU, Reddy (Independent Contractor); KIM Server mailing-list Subject: RE: [Kim-discussion] question about gate within KIM I got it working, but now no Entities display. See attached Thanks, Phillip - getting there with your help! Bonnie From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at ontotext.com] Sent: Tuesday, November 16, 2010 1:46 PM To: VERMILLION, Bonnie Cc: borislav popov; Matthew Petrillo; WILSON, Greg; ENUGU, Reddy (Independent Contractor); KIM Server mailing-list Subject: Re: [Kim-discussion] question about gate within KIM Hi Bonnie I guess my editor has put some strange character there. Just copy-paste it in a simple text editor (notepad) and save it. This should save only the readable characters. hth Philip On Nov 16, 2010, at 6:55 PM, VERMILLION, Bonnie wrote: Hi Phillip, I'm getting an error from the query file in red below: Can you let me know what to do to correct it? Thank you, Bonnie 1:52:51 [INFO] 2371[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - Labels are loaded from aliases. 11:52:51 [DEBUG] 2480[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - classes cache contains 321 items. here is the first: http://proton.semanticweb.org/2006/05/protonu#AirplaneModel 11:52:51 [DEBUG] 2776[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - direct subs cache contains 321 items. here is the first: http://proton.semanticweb.org/2006/05/protonu#AirplaneModel=[] 11:52:51 [DEBUG] 2776[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - all subs cache contains 321 items. here is the first: http://proton.semanticweb.org/2006/05/protonu#AirplaneModel=[http://proton.semanticweb.org/2006/05/protonu#AirplaneModel] 11:52:51 [DEBUG] 2776[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - supers cache contains 321 items. here is the first: http://proton.semanticweb.org/2006/05/protonu#AirplaneModel=[http://proton.semanticweb.org/2006/05/protonu#AirplaneModel, http://www.w3.org/2000/01/rdf-schema#Resource, http://proton.semanticweb.org/2006/05/protont#ProductModel, http://proton.semanticweb.org/2006/05/protont#Object, http://proton.semanticweb.org/2006/05/protons#Entity] 11:52:51 [INFO] 2792[ComponentStarter-Thread-2](KIM_SERVICE) - Waking Up GATE... 11:52:51 [INFO] 3276[ComponentStarter-Thread-2](KIM_SERVICE) - GATE is AWAKE. 11:52:51 [INFO] 3291[ComponentStarter-Thread-2](KIM_SERVICE) - Loading C:\KIM\kim-platform-3.0-RC4\context\default\resources\IE.gapp 11:52:55 [INFO] 7176[ComponentStarter-Thread-2](gate.LargeKBGazetteer) - Replaced $relpath$ in gazetteer parameters with C:\KIM\kim-platform-3.0-RC4\context\default\resources/ 11:52:55 [INFO] 7207[ComponentStarter-Thread-2](model.KimDictionaryFeederImpl) - Loading of trusted entities from Sesame 11:52:55 [DEBUG] 7207[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - Executing evaluateQuery('select lbl, i, dc from {i} {lbl}, {i} serql:directType {dc}, {i} {} ','null', listener) 11:52:55 [DEBUG] 7207[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - org.openrdf.query.MalformedQueryException: Lexical error at line 1, column 8. Encountered: "\u00a0" (160), after : "" 11:52:55 [DEBUG] 7238[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - org.openrdf.query.MalformedQueryException: Lexical error at line 1, column 8. Encountered: "\u00a0" (160), after : "" 11:52:55 [INFO] 7238[ComponentStarter-Thread-2](model.KimDictionaryFeederImpl) - The loading of the Static Dictionary finished 11:52:58 [INFO] 10046[ComponentStarter-Thread-2](KIM_SERVICE) - Get EntityAPI. 11:52:58 [DEBUG] 10046[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - Executing evaluateQuery('select COUNTRY,ADJ from {COUNTRY} {ADJ}','SeRQL', listener) 11:52:58 [INFO] 10077[ComponentStarter-Thread-2](ig.RelationExtractors) - Total external relations successfuly loaded : 0 out of 0 supplied. 11:52:58 [INFO] 10108[ComponentStarter-Thread-2](KIM_SERVICE) - SemanticAnnotationAPI loaded on Tue Nov 16 11:52:58 EST 2010 11:52:58 [INFO] 10108[ComponentStarter-Thread-2](NERC) - GATE pipelines=1 11:52:58 [INFO] 10124[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - KIMDocument Feature Schema loaded from Configuration file. 11:52:58 [INFO] 10140[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - KIMDocument Feature Schema loaded from Configuration file. 11:52:58 [INFO] 10140[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - KIMDocument Feature Schema loaded from Configuration file. 11:52:59 [INFO] 10342[ComponentStarter-Thread-2](KIM_SERVICE) - CORE Index Addon: class com.ontotext.kim.coredb.CachingCoreWrapper 11:52:59 [INFO] 10358[ComponentStarter-Thread-2](KIM_SERVICE) - Loaded extension: com.ontotext.kim.coredb.management.RdfCoreAdminExt 11:52:59 [INFO] 10374[ComponentStarter-Thread-2](KIM_SERVICE) - Loaded extension: com.ontotext.kim.util.FactoryImpl 11:52:59 [INFO] 10374[ComponentStarter-Thread-2](KIM_SERVICE) - Loaded extension: com.ontotext.kim.util.console.ConsoleTasksExtension 11:52:59 [INFO] 10389[ComponentStarter-Thread-2](KIM_SERVICE) - Loaded extension: com.ontotext.kim.gate.TeamwareAdapter 11:52:59 [INFO] 10389[ComponentStarter-Thread-2](KIM_SERVICE) - Loaded extension: com.ontotext.kim.rss.KimRssDatabase 11:52:59 [INFO] 10405[ComponentStarter-Thread-2](KIM_SERVICE) - KIM Server startup ended! From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at ontotext.com] Sent: Tuesday, November 16, 2010 10:29 AM To: VERMILLION, Bonnie Cc: borislav popov; Matthew Petrillo; WILSON, Greg; ENUGU, Reddy (Independent Contractor) Subject: Re: [Kim-discussion] question about gate within KIM Hi Bonnie, >From the output of you have sent me, I conclude that you have not cleared the cache after changing the configuration. The cache lives in KIM/context/default/populated. Remove the entire directory clear it. Now if you want the gazetteer to entirely use your ontology instead of KIM's , you should have some things in mind. The gazetteer resource has a setup option FeedSetupPath, which is a path where it searches for a file named query.txt . In your case the path is KIM/config/ . This file contains a query in serql or sparql and is responsible for filling the dictionary of the gazetteer. The query should return exactly 3 characteristics of each entity you would like to put in the dictionary: * the label of the entity * the instance URI of the entity * the direct class this entity is instance of If the gazetteer does not find such a file, it uses this query: select LA, I, DC from ( {TI} rdf:type {}, {I} {TI}, {I} rdf:type {}, {I} serql:directType {DC}, {I} {} rdfs:label {LA}; [ {IG}] ) UNION ( {I} {}, {I} serql:directType {DC}, {I} {LA} ) WHERE IG = NULL AND isLiteral(LA) AND DC != AND NOT LA = "" If you set the semantic repository logger level to DEBUG you could see this in the log. Just change in KIM/config/log.prop : log4j.category.SEMANTIC_REPOSITORY = , aSEMANTIC_REPOSITORY to log4j.category.SEMANTIC_REPOSITORY = DEBUG, aSEMANTIC_REPOSITORY You could create a file KIM/config/query.txt and provide a simpler query like: select lbl, i, dc from {i} {lbl}, {i} serql:directType {dc}, {i} {} Now the instances of Actor and its subclasses will be recognized in the text. Note: One thing that puzzled me when I looked at your screenshots, is that Role was a subclass of Actor. The relation here should be Actor hasRole Role I think. To be able to see your classes in KIM's web interface, you should actually mark them as visible. This happens by providing the triples like this to your RDF: "" . you can see KIM's visibility configuration in KIM/context/default/kb/visibility.nt . Please notify me of your progress, so that I can help further Philip On Nov 16, 2010, at 3:07 PM, VERMILLION, Bonnie wrote: Thanks Phillip. At some point we may have lists such as specific Codes that have a list of values that would be suitable for a gazetteer list. For now what we want to do is turn off Proton (which I think I have done since there are references to Person, Organization or Location in the ontology shown in KIM. So, I'm not sure where the ontology that is now listed in KIM is coming from . But we need to turn it off so that when we load a sample ontology, it just shows the ontology we are loading. Please see the attached screen shots attached. Thank you, Bonnie From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at ontotext.com] Sent: Tuesday, November 16, 2010 3:26 AM To: VERMILLION, Bonnie Cc: borislav popov; Matthew Petrillo; WILSON, Greg; ENUGU, Reddy (Independent Contractor) Subject: Re: [Kim-discussion] question about gate within KIM Hi Bonnie, I guess you would want to run only a gazetteer with your ontology, to observe which entities are recognized? Will this help you? Philip On Nov 16, 2010, at 5:05 AM, VERMILLION, Bonnie wrote: Phillip, I was able to follow the document that you provided in order to load a sample ontology, but because Proton and Annie are still running, the results are not clear. How can I turn off Proton and Annie? Thank you, Bonnie From: VERMILLION, Bonnie Sent: Tuesday, November 09, 2010 11:08 AM To: 'Philip Alexiev @ Ontotext' Cc: borislav popov; Matthew Petrillo; WILSON, Greg; ENUGU, Reddy (Independent Contractor) Subject: RE: [Kim-discussion] question about gate within KIM Thanks Phillip. Great explanation! For the ontology I am trying to load we have both classes and instances. Though we do have one ontology that only has classes. I'll let you know the result after following your response. Thank you, Bonnie From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at ontotext.com] Sent: Tuesday, November 09, 2010 10:54 AM To: VERMILLION, Bonnie Cc: borislav popov; Matthew Petrillo; WILSON, Greg; ENUGU, Reddy (Independent Contractor) Subject: Re: [Kim-discussion] question about gate within KIM Hi Bonnie, The act of extending the ontology alone, does not add value to your IE. It will only store those entities in the semantic repository. In order for those entities to be included in the LKB gazetteer dictionary, they have to meet 3 conditions: * are of a type that is a subclass of protons:Entity * have at least one alias * are marked as Trusted That way the gazetteer will create Lookup annotations when he meets one of those in the text. Later you can transform them using Jape rules. Does your owl file contain instances or only classes? In the general case you need instances to be recognized in the texts. It is a good idea to map some of your classes to PROTON only if you find they are expressing the same concept. Otherwise just subclass your top classes to protons:Entity . 'Include the new files in the import section of owlim' OWLIM's configuration resides in KIM/config/owlim.ttl . There is a owlim:imports section there. Add your custom files there. The path is relative to KIM/context/default/ . If you have already ran KIM, some cache will exist. In this case you will have to clear the cache in order for the changes to take effect. To do this, perform the following steps: * stop KIM * delete KIM/context/default/populated/ (NOTE:this will clear all the cache, including the documents in the document repository). * start KIM All the best, Philip On Nov 9, 2010, at 5:22 PM, VERMILLION, Bonnie wrote: Thanks Phillip. We have several ontologies that we created in Prot?g?. So we have the .owl files. I'm following the documentation that you pointed me to - * Create a sub-folder in the KIM context folder. It will be used as storage for all the RDF data for this task. For example, create $KIM_HOME/context/default/kb/dbpedia/. We recommend this location but you can put your RDF data anywhere in the KIM context folder. * Put dbpedia_3.5.1.owl , containing the DBpedia taxonomy, in $KIM_HOME/context/default/kb/dbpedia/ * Put dbpedia_instances.nt , containing the actual objects description, in $KIM_HOME/context/default/kb/dbpedia/ * Include the new files in the import section of owlim ( $KIM_HOME/config/owlim.ttl ): I created a subfolder und the kb directory and copied an .owl file created in Prot?g?. I'm not sure how to create the .nt file, and the ontology that I'm using does not have Person, Organization or Place domains - so there is nothing to align with Proton. I'm also not sure what is meant by - 'Include the new files in the import section of owlim' Thanks for your expertise! Bonnie From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at ontotext.com] Sent: Tuesday, November 09, 2010 9:37 AM To: VERMILLION, Bonnie Cc: borislav popov; Matthew Petrillo; WILSON, Greg; ENUGU, Reddy (Independent Contractor) Subject: Re: [Kim-discussion] question about gate within KIM Hi Bonnie, Gate embedded in KIM functions the same way. A difference is that not all the plugins available in GATE developer are directly available in KIM too. You can check the KIM/plugins/ folder. Generally if you import the Ontology plugin you should be able to use the Ontology language resources as you intend to. I am sure that if you provide some more information about what you want to achieve, we will be able to provide more meaningful support. A simple usecase will help a lot. All the best, Philip On Nov 9, 2010, at 4:03 PM, VERMILLION, Bonnie wrote: Thanks, Borislov. I will try following the document Phillip mentioned. I guess I was thinking that Gate within KIM would function as it does independently - that is to use Prot?g? to create an ontology and then load the ontology by indicating a CREOLE 'ontology' plug-in and then a Sesame or OWLIM ontology language resource can be used to load the ontology created from Prot?g?. Sorry for the poor explanation. I'll report back! Thank you, Bonnie From: borislav popov [mailto:borislav.popov at ontotext.com] Sent: Tuesday, November 09, 2010 8:40 AM To: VERMILLION, Bonnie Cc: Matthew Petrillo; WILSON, Greg; ENUGU, Reddy (Independent Contractor); philip Subject: Re: [Kim-discussion] question about gate within KIM Hi Bonnie, i will keep philip posted as well on this one. the page philip sent explains how to do this loading & mapping of the new ontology to the default one in KIM (PROTON). This is not exactly a user friendly task - as it is more for administrators of the kim server. Generally this is a task you do initially and the demonstration UIs are not targeted to these people, but the end users. In GATE you can play with loading the ontology if this is helpful to get a better feeling of the data. Regarding: the last sentence of loading the ontology and not the rdf triples - i did not really get it - as ontologies are usually expressed in triples. if you want to avoid loading the instance data - it is handy if they come in separate files. philip please add if i missed something b On Nov 9, 2010, at 3:03 PM, VERMILLION, Bonnie wrote: Borislav, Thank you for your response! After looking at the documentation that Philip referred to, I agree that it is not necessary what I am looking for. What I'm trying to do is to import (if this is possible) an ontology similar to loading an ontology from Prot?g? in to Gate based on the fact that I have select an ontology processing resource that was loaded as a CREOLE plug-in. However, in KIM, there is no such plug-in within the inherent GATE tool. Can I add this CREOLE plug-in to Gate within KIM? Or is there another way to accomplish loading the ontology without having to load the RDF triples as well. Thank you in advance for your assistance! Bonnie Vermillion Yvonne Vermillion 2000 Corporate Ridge McLean, VA 22102-7805 (571)633-7830 P Complex Problems. Practical Solutions. www.lmi.org From: borislav popov [mailto:borislav.popov at ontotext.com] Sent: Tuesday, November 09, 2010 4:02 AM To: VERMILLION, Bonnie Cc: kim-discussion; philip Subject: Re: [Kim-discussion] question about gate within KIM Hi Bonnie, actually your request and philip's answer point in different directions. The ontology plugin in GATE provides partial coverage of what is available in Sesame 2 and/or OWLIM 3 as semantic repository APIs. It is not used in KIM - there you have the direct integration with Sesame-compatible repository, incl. our OWLIM. For client application of KIM - there is also a higher level API accessible on the same level as our search or doc-related functionality. In a KIM context the extension of the default ontology is explained in the documentation piece provided by philip. There are certain things to take into account to ensure the mapping to the default ontology is right and the modeling paradigms of your ontology are compatible with the extraction pipeline - to bootstrap automatic recognition of new entities, given the ontology comes with entity descriptions / knowledge base as well. you can tell us more about your experiments - so that we can suggest the route more accurately. If you consider it confidential - you may also avoid the discussion list, which is public and write directly to us as we have NDA already. all the best borislav On Nov 9, 2010, at 10:27 AM, Philip Alexiev @ Ontotext wrote: Hi Yvonne, In order to use a new ontology it is good to map it to your top ontology classes. http://ontotext.com/kim/doc/KimDocs-3.0-EN/ExtendInformationExtraction.html This is a good guide showing how you can do this. tht Philip Alexiev Software Engineer, KIM team On Nov 8, 2010, at 10:28 PM, VERMILLION, Bonnie wrote: Is there a way to add a ontology CREOLE plug-in within KIM so that an external ontology can be loaded? Thank you, Bonnie Vermillion Yvonne Vermillion 2000 Corporate Ridge McLean, VA 22102-7805 (571)633-7830 P Complex Problems. Practical Solutions. www.lmi.org _______________________________________________ Kim-discussion mailing list Kim-discussion at ontotext.com http://ontotext.com/mailman/listinfo/kim-discussion _______________________________________________ Kim-discussion mailing list Kim-discussion at ontotext.com http://ontotext.com/mailman/listinfo/kim-discussion -------------- next part -------------- An HTML attachment was scrubbed... URL: From philip.alexiev at ontotext.com Tue Nov 16 14:12:45 2010 From: philip.alexiev at ontotext.com (Philip Alexiev @ Ontotext) Date: Tue, 16 Nov 2010 21:12:45 +0200 Subject: [Kim-discussion] question about gate within KIM In-Reply-To: References: <83E46363-DAA5-4E7E-96FD-32B8B633E102@ontotext.com> <25B94943-AFED-46DC-A827-0452C3506530@ontotext.com> <1EE46E0D-41AB-42FE-B077-654E683885E9@ontotext.com> <787EE2AB-D3BF-4AED-B748-31D39E0492DF@ontotext.com> Message-ID: <26B7D3B5-BDD7-443D-86A9-37BF7657C856@ontotext.com> Hi Bonnie, I think I will save you a lot of time if you send me the ontology so that I can play with it. Is it possible? It seems the query does not return any results. I can not say what should be the exact query without knowledge of the ontology. All the best Philip On Nov 16, 2010, at 8:59 PM, VERMILLION, Bonnie wrote: > I got it working, but now no Entities display. > > See attached > > Thanks, Phillip ? getting there with your help! > Bonnie > > From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at ontotext.com] > Sent: Tuesday, November 16, 2010 1:46 PM > To: VERMILLION, Bonnie > Cc: borislav popov; Matthew Petrillo; WILSON, Greg; ENUGU, Reddy (Independent Contractor); KIM Server mailing-list > Subject: Re: [Kim-discussion] question about gate within KIM > > Hi Bonnie > > I guess my editor has put some strange character there. Just copy-paste it in a simple text editor (notepad) and save it. This should save only the readable characters. > > hth > Philip > > > On Nov 16, 2010, at 6:55 PM, VERMILLION, Bonnie wrote: > > > Hi Phillip, > I?m getting an error from the query file in red below: > > Can you let me know what to do to correct it? > > Thank you, > Bonnie > > 1:52:51 [INFO] 2371[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - Labels are loaded from aliases. > 11:52:51 [DEBUG] 2480[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - classes cache contains 321 items. here is the first: http://proton.semanticweb.org/2006/05/protonu#AirplaneModel > 11:52:51 [DEBUG] 2776[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - direct subs cache contains 321 items. here is the first: http://proton.semanticweb.org/2006/05/protonu#AirplaneModel=[] > 11:52:51 [DEBUG] 2776[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - all subs cache contains 321 items. here is the first: http://proton.semanticweb.org/2006/05/protonu#AirplaneModel=[http://proton.semanticweb.org/2006/05/protonu#AirplaneModel] > 11:52:51 [DEBUG] 2776[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - supers cache contains 321 items. here is the first: http://proton.semanticweb.org/2006/05/protonu#AirplaneModel=[http://proton.semanticweb.org/2006/05/protonu#AirplaneModel, http://www.w3.org/2000/01/rdf-schema#Resource, http://proton.semanticweb.org/2006/05/protont#ProductModel, http://proton.semanticweb.org/2006/05/protont#Object, http://proton.semanticweb.org/2006/05/protons#Entity] > 11:52:51 [INFO] 2792[ComponentStarter-Thread-2](KIM_SERVICE) - Waking Up GATE... > 11:52:51 [INFO] 3276[ComponentStarter-Thread-2](KIM_SERVICE) - GATE is AWAKE. > 11:52:51 [INFO] 3291[ComponentStarter-Thread-2](KIM_SERVICE) - Loading C:\KIM\kim-platform-3.0-RC4\context\default\resources\IE.gapp > 11:52:55 [INFO] 7176[ComponentStarter-Thread-2](gate.LargeKBGazetteer) - Replaced $relpath$ in gazetteer parameters with C:\KIM\kim-platform-3.0-RC4\context\default\resources/ > 11:52:55 [INFO] 7207[ComponentStarter-Thread-2](model.KimDictionaryFeederImpl) - Loading of trusted entities from Sesame > 11:52:55 [DEBUG] 7207[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - Executing evaluateQuery('select lbl, i, dc > from > {i} {lbl}, > {i} serql:directType {dc}, > {i} {} > ','null', listener) > 11:52:55 [DEBUG] 7207[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - org.openrdf.query.MalformedQueryException: Lexical error at line 1, column 8. Encountered: "\u00a0" (160), after : "" > 11:52:55 [DEBUG] 7238[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - org.openrdf.query.MalformedQueryException: Lexical error at line 1, column 8. Encountered: "\u00a0" (160), after : "" > 11:52:55 [INFO] 7238[ComponentStarter-Thread-2](model.KimDictionaryFeederImpl) - The loading of the Static Dictionary finished > 11:52:58 [INFO] 10046[ComponentStarter-Thread-2](KIM_SERVICE) - Get EntityAPI. > 11:52:58 [DEBUG] 10046[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - Executing evaluateQuery('select COUNTRY,ADJ from {COUNTRY} {ADJ}','SeRQL', listener) > 11:52:58 [INFO] 10077[ComponentStarter-Thread-2](ig.RelationExtractors) - Total external relations successfuly loaded : 0 out of 0 supplied. > 11:52:58 [INFO] 10108[ComponentStarter-Thread-2](KIM_SERVICE) - SemanticAnnotationAPI loaded on Tue Nov 16 11:52:58 EST 2010 > 11:52:58 [INFO] 10108[ComponentStarter-Thread-2](NERC) - GATE pipelines=1 > 11:52:58 [INFO] 10124[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - KIMDocument Feature Schema loaded from Configuration file. > 11:52:58 [INFO] 10140[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - KIMDocument Feature Schema loaded from Configuration file. > 11:52:58 [INFO] 10140[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - KIMDocument Feature Schema loaded from Configuration file. > 11:52:59 [INFO] 10342[ComponentStarter-Thread-2](KIM_SERVICE) - CORE Index Addon: class com.ontotext.kim.coredb.CachingCoreWrapper > 11:52:59 [INFO] 10358[ComponentStarter-Thread-2](KIM_SERVICE) - Loaded extension: com.ontotext.kim.coredb.management.RdfCoreAdminExt > 11:52:59 [INFO] 10374[ComponentStarter-Thread-2](KIM_SERVICE) - Loaded extension: com.ontotext.kim.util.FactoryImpl > 11:52:59 [INFO] 10374[ComponentStarter-Thread-2](KIM_SERVICE) - Loaded extension: com.ontotext.kim.util.console.ConsoleTasksExtension > 11:52:59 [INFO] 10389[ComponentStarter-Thread-2](KIM_SERVICE) - Loaded extension: com.ontotext.kim.gate.TeamwareAdapter > 11:52:59 [INFO] 10389[ComponentStarter-Thread-2](KIM_SERVICE) - Loaded extension: com.ontotext.kim.rss.KimRssDatabase > 11:52:59 [INFO] 10405[ComponentStarter-Thread-2](KIM_SERVICE) - KIM Server startup ended! > > From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at ontotext.com] > Sent: Tuesday, November 16, 2010 10:29 AM > To: VERMILLION, Bonnie > Cc: borislav popov; Matthew Petrillo; WILSON, Greg; ENUGU, Reddy (Independent Contractor) > Subject: Re: [Kim-discussion] question about gate within KIM > > Hi Bonnie, > > From the output of you have sent me, I conclude that you have not cleared the cache after changing the configuration. The cache lives in KIM/context/default/populated. Remove the entire directory clear it. > > Now if you want the gazetteer to entirely use your ontology instead of KIM's , you should have some things in mind. > > The gazetteer resource has a setup option FeedSetupPath, which is a path where it searches for a file named query.txt . In your case the path is KIM/config/ . This file contains a query in serql or sparql and is responsible for filling the dictionary of the gazetteer. The query should return exactly 3 characteristics of each entity you would like to put in the dictionary: > * the label of the entity > * the instance URI of the entity > * the direct class this entity is instance of > > If the gazetteer does not find such a file, it uses this query: > > select LA, I, DC from > ( > {TI} rdf:type {}, > {I} {TI}, > {I} rdf:type {}, > {I} serql:directType {DC}, > {I} {} rdfs:label {LA}; > [ {IG}] > ) UNION ( > {I} {}, > {I} serql:directType {DC}, > {I} {LA} > ) > WHERE > IG = NULL > AND isLiteral(LA) > AND DC != > AND NOT LA = "" > > > If you set the semantic repository logger level to DEBUG you could see this in the log. Just change in KIM/config/log.prop : > log4j.category.SEMANTIC_REPOSITORY = , aSEMANTIC_REPOSITORY > to > log4j.category.SEMANTIC_REPOSITORY = DEBUG, aSEMANTIC_REPOSITORY > > > You could create a file KIM/config/query.txt and provide a simpler query like: > > select lbl, i, dc > from > {i} {lbl}, > {i} serql:directType {dc}, > {i} {} > > Now the instances of Actor and its subclasses will be recognized in the text. > > Note: One thing that puzzled me when I looked at your screenshots, is that Role was a subclass of Actor. The relation here should be Actor hasRole Role I think. > > To be able to see your classes in KIM's web interface, you should actually mark them as visible. This happens by providing the triples like this to your RDF: > "" . > > you can see KIM's visibility configuration in KIM/context/default/kb/visibility.nt . > > > Please notify me of your progress, so that I can help further > Philip > > On Nov 16, 2010, at 3:07 PM, VERMILLION, Bonnie wrote: > > > > Thanks Phillip. > > At some point we may have lists such as specific Codes that have a list of values that would be suitable for a gazetteer list. > > For now what we want to do is turn off Proton (which I think I have done since there are references to Person, Organization or Location in the ontology shown in KIM. So, I?m not sure where the ontology that is now listed in KIM is coming from . But we need to turn it off so that when we load a sample ontology, it just shows the ontology we are loading. > > Please see the attached screen shots attached. > > Thank you, > Bonnie > > From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at ontotext.com] > Sent: Tuesday, November 16, 2010 3:26 AM > To: VERMILLION, Bonnie > Cc: borislav popov; Matthew Petrillo; WILSON, Greg; ENUGU, Reddy (Independent Contractor) > Subject: Re: [Kim-discussion] question about gate within KIM > > Hi Bonnie, > > I guess you would want to run only a gazetteer with your ontology, to observe which entities are recognized? Will this help you? > > Philip > > On Nov 16, 2010, at 5:05 AM, VERMILLION, Bonnie wrote: > > > > > Phillip, > > I was able to follow the document that you provided in order to load a sample ontology, but because Proton and Annie are still running, the results are not clear. How can I turn off Proton and Annie? > > Thank you, > Bonnie > > From: VERMILLION, Bonnie > Sent: Tuesday, November 09, 2010 11:08 AM > To: 'Philip Alexiev @ Ontotext' > Cc: borislav popov; Matthew Petrillo; WILSON, Greg; ENUGU, Reddy (Independent Contractor) > Subject: RE: [Kim-discussion] question about gate within KIM > > Thanks Phillip. Great explanation! > > For the ontology I am trying to load we have both classes and instances. Though we do have one ontology that only has classes. > > I?ll let you know the result after following your response. > > Thank you, > Bonnie > > From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at ontotext.com] > Sent: Tuesday, November 09, 2010 10:54 AM > To: VERMILLION, Bonnie > Cc: borislav popov; Matthew Petrillo; WILSON, Greg; ENUGU, Reddy (Independent Contractor) > Subject: Re: [Kim-discussion] question about gate within KIM > > Hi Bonnie, > > The act of extending the ontology alone, does not add value to your IE. It will only store those entities in the semantic repository. In order for those entities to be included in the LKB gazetteer dictionary, they have to meet 3 conditions: > are of a type that is a subclass of protons:Entity > have at least one alias > are marked as Trusted > That way the gazetteer will create Lookup annotations when he meets one of those in the text. Later you can transform them using Jape rules. > > Does your owl file contain instances or only classes? In the general case you need instances to be recognized in the texts. > > It is a good idea to map some of your classes to PROTON only if you find they are expressing the same concept. Otherwise just subclass your top classes to protons:Entity . > > ?Include the new files in the import section of owlim? > OWLIM's configuration resides in KIM/config/owlim.ttl . There is a owlim:imports section there. Add your custom files there. The path is relative to KIM/context/default/ . If you have already ran KIM, some cache will exist. In this case you will have to clear the cache in order for the changes to take effect. To do this, perform the following steps: > * stop KIM > * delete KIM/context/default/populated/ (NOTE:this will clear all the cache, including the documents in the document repository). > * start KIM > > All the best, > Philip > > On Nov 9, 2010, at 5:22 PM, VERMILLION, Bonnie wrote: > > > Thanks Phillip. > > We have several ontologies that we created in Prot?g?. So we have the .owl files. > > I?m following the documentation that you pointed me to ? > Create a sub-folder in the KIM context folder. It will be used as storage for all the RDF data for this task. > For example, create $KIM_HOME/context/default/kb/dbpedia/. > We recommend this location but you can put your RDF data anywhere in the KIM context folder. > Put dbpedia_3.5.1.owl , containing the DBpedia taxonomy, in $KIM_HOME/context/default/kb/dbpedia/ > Put dbpedia_instances.nt , containing the actual objects description, in $KIM_HOME/context/default/kb/dbpedia/ > Include the new files in the import section of owlim ( $KIM_HOME/config/owlim.ttl ): > I created a subfolder und the kb directory and copied an .owl file created in Prot?g?. > I?m not sure how to create the .nt file, and the ontology that I?m using does not have Person, Organization or Place domains ? so there is nothing to align with Proton. > I?m also not sure what is meant by ? ?Include the new files in the import section of owlim? > Thanks for your expertise! > Bonnie > > > From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at ontotext.com] > Sent: Tuesday, November 09, 2010 9:37 AM > To: VERMILLION, Bonnie > Cc: borislav popov; Matthew Petrillo; WILSON, Greg; ENUGU, Reddy (Independent Contractor) > Subject: Re: [Kim-discussion] question about gate within KIM > > Hi Bonnie, > > Gate embedded in KIM functions the same way. A difference is that not all the plugins available in GATE developer are directly available in KIM too. You can check the KIM/plugins/ folder. Generally if you import the Ontology plugin you should be able to use the Ontology language resources as you intend to. > > I am sure that if you provide some more information about what you want to achieve, we will be able to provide more meaningful support. A simple usecase will help a lot. > > All the best, > Philip > > On Nov 9, 2010, at 4:03 PM, VERMILLION, Bonnie wrote: > > > > > > > Thanks, Borislov. I will try following the document Phillip mentioned. I guess I was thinking that Gate within KIM would function as it does independently ? that is to use Prot?g? to create an ontology and then load the ontology by indicating a CREOLE ?ontology? plug-in and then a Sesame or OWLIM ontology language resource can be used to load the ontology created from Prot?g?. Sorry for the poor explanation. > > I?ll report back! > > Thank you, > Bonnie > > From: borislav popov [mailto:borislav.popov at ontotext.com] > Sent: Tuesday, November 09, 2010 8:40 AM > To: VERMILLION, Bonnie > Cc: Matthew Petrillo; WILSON, Greg; ENUGU, Reddy (Independent Contractor); philip > Subject: Re: [Kim-discussion] question about gate within KIM > > Hi Bonnie, > i will keep philip posted as well on this one. > the page philip sent explains how to do this loading & mapping of the new ontology to the default one in KIM (PROTON). This is not exactly a user friendly task - as it is more for administrators of the kim server. > Generally this is a task you do initially and the demonstration UIs are not targeted to these people, but the end users. > In GATE you can play with loading the ontology if this is helpful to get a better feeling of the data. > Regarding: the last sentence of loading the ontology and not the rdf triples - i did not really get it - as ontologies are usually expressed in triples. if you want to avoid loading the instance data - it is handy if they come in separate files. > > philip please add if i missed something > b > > > On Nov 9, 2010, at 3:03 PM, VERMILLION, Bonnie wrote: > > > > > > > > Borislav, > > Thank you for your response! > > After looking at the documentation that Philip referred to, I agree that it is not necessary what I am looking for. > > What I?m trying to do is to import (if this is possible) an ontology similar to loading an ontology from Prot?g? in to Gate based on the fact that I have select an ontology processing resource that was loaded as a CREOLE plug-in. However, in KIM, there is no such plug-in within the inherent GATE tool. Can I add this CREOLE plug-in to Gate within KIM? Or is there another way to accomplish loading the ontology without having to load the RDF triples as well. > > Thank you in advance for your assistance! > Bonnie Vermillion > > Yvonne Vermillion > > > > 2000 Corporate Ridge > McLean, VA 22102-7805 > (571)633-7830 P > > > > > > > > Complex Problems. Practical Solutions. > www.lmi.org > > > > From: borislav popov [mailto:borislav.popov at ontotext.com] > Sent: Tuesday, November 09, 2010 4:02 AM > To: VERMILLION, Bonnie > Cc: kim-discussion; philip > Subject: Re: [Kim-discussion] question about gate within KIM > > Hi Bonnie, > actually your request and philip's answer point in different directions. The ontology plugin in GATE provides partial coverage of what is available in Sesame 2 and/or OWLIM 3 as semantic repository APIs. > It is not used in KIM - there you have the direct integration with Sesame-compatible repository, incl. our OWLIM. For client application of KIM - there is also a higher level API accessible on the same level as our search or doc-related functionality. > In a KIM context the extension of the default ontology is explained in the documentation piece provided by philip. > There are certain things to take into account to ensure the mapping to the default ontology is right and the modeling paradigms of your ontology are compatible with the extraction pipeline - to bootstrap automatic recognition of new entities, given the ontology comes with entity descriptions / knowledge base as well. > you can tell us more about your experiments - so that we can suggest the route more accurately. If you consider it confidential - you may also avoid the discussion list, which is public and write directly to us as we have NDA already. > all the best > borislav > > > On Nov 9, 2010, at 10:27 AM, Philip Alexiev @ Ontotext wrote: > > > > > > > > > Hi Yvonne, > > In order to use a new ontology it is good to map it to your top ontology classes. > > http://ontotext.com/kim/doc/KimDocs-3.0-EN/ExtendInformationExtraction.html > > This is a good guide showing how you can do this. > > tht > Philip Alexiev > Software Engineer, KIM team > > > > > On Nov 8, 2010, at 10:28 PM, VERMILLION, Bonnie wrote: > > > > > > > > > Is there a way to add a ontology CREOLE plug-in within KIM so that an external ontology can be loaded? > > Thank you, > Bonnie Vermillion > > Yvonne Vermillion > > > > 2000 Corporate Ridge > McLean, VA 22102-7805 > (571)633-7830 P > > > > > > > > > Complex Problems. Practical Solutions. > www.lmi.org > > > > _______________________________________________ > Kim-discussion mailing list > Kim-discussion at ontotext.com > http://ontotext.com/mailman/listinfo/kim-discussion > > _______________________________________________ > Kim-discussion mailing list > Kim-discussion at ontotext.com > http://ontotext.com/mailman/listinfo/kim-discussion > > > > > > > > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From YVERMILLION at lmi.org Tue Nov 16 13:59:48 2010 From: YVERMILLION at lmi.org (VERMILLION, Bonnie) Date: Tue, 16 Nov 2010 13:59:48 -0500 Subject: [Kim-discussion] question about gate within KIM In-Reply-To: References: <83E46363-DAA5-4E7E-96FD-32B8B633E102@ontotext.com> <25B94943-AFED-46DC-A827-0452C3506530@ontotext.com> <1EE46E0D-41AB-42FE-B077-654E683885E9@ontotext.com> <787EE2AB-D3BF-4AED-B748-31D39E0492DF@ontotext.com> Message-ID: I got it working, but now no Entities display. See attached Thanks, Phillip - getting there with your help! Bonnie From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at ontotext.com] Sent: Tuesday, November 16, 2010 1:46 PM To: VERMILLION, Bonnie Cc: borislav popov; Matthew Petrillo; WILSON, Greg; ENUGU, Reddy (Independent Contractor); KIM Server mailing-list Subject: Re: [Kim-discussion] question about gate within KIM Hi Bonnie I guess my editor has put some strange character there. Just copy-paste it in a simple text editor (notepad) and save it. This should save only the readable characters. hth Philip On Nov 16, 2010, at 6:55 PM, VERMILLION, Bonnie wrote: Hi Phillip, I'm getting an error from the query file in red below: Can you let me know what to do to correct it? Thank you, Bonnie 1:52:51 [INFO] 2371[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - Labels are loaded from aliases. 11:52:51 [DEBUG] 2480[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - classes cache contains 321 items. here is the first: http://proton.semanticweb.org/2006/05/protonu#AirplaneModel 11:52:51 [DEBUG] 2776[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - direct subs cache contains 321 items. here is the first: http://proton.semanticweb.org/2006/05/protonu#AirplaneModel=[] 11:52:51 [DEBUG] 2776[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - all subs cache contains 321 items. here is the first: http://proton.semanticweb.org/2006/05/protonu#AirplaneModel=[http://proton.semanticweb.org/2006/05/protonu#AirplaneModel] 11:52:51 [DEBUG] 2776[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - supers cache contains 321 items. here is the first: http://proton.semanticweb.org/2006/05/protonu#AirplaneModel=[http://proton.semanticweb.org/2006/05/protonu#AirplaneModel, http://www.w3.org/2000/01/rdf-schema#Resource, http://proton.semanticweb.org/2006/05/protont#ProductModel, http://proton.semanticweb.org/2006/05/protont#Object, http://proton.semanticweb.org/2006/05/protons#Entity] 11:52:51 [INFO] 2792[ComponentStarter-Thread-2](KIM_SERVICE) - Waking Up GATE... 11:52:51 [INFO] 3276[ComponentStarter-Thread-2](KIM_SERVICE) - GATE is AWAKE. 11:52:51 [INFO] 3291[ComponentStarter-Thread-2](KIM_SERVICE) - Loading C:\KIM\kim-platform-3.0-RC4\context\default\resources\IE.gapp 11:52:55 [INFO] 7176[ComponentStarter-Thread-2](gate.LargeKBGazetteer) - Replaced $relpath$ in gazetteer parameters with C:\KIM\kim-platform-3.0-RC4\context\default\resources/ 11:52:55 [INFO] 7207[ComponentStarter-Thread-2](model.KimDictionaryFeederImpl) - Loading of trusted entities from Sesame 11:52:55 [DEBUG] 7207[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - Executing evaluateQuery('select lbl, i, dc from {i} {lbl}, {i} serql:directType {dc}, {i} {} ','null', listener) 11:52:55 [DEBUG] 7207[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - org.openrdf.query.MalformedQueryException: Lexical error at line 1, column 8. Encountered: "\u00a0" (160), after : "" 11:52:55 [DEBUG] 7238[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - org.openrdf.query.MalformedQueryException: Lexical error at line 1, column 8. Encountered: "\u00a0" (160), after : "" 11:52:55 [INFO] 7238[ComponentStarter-Thread-2](model.KimDictionaryFeederImpl) - The loading of the Static Dictionary finished 11:52:58 [INFO] 10046[ComponentStarter-Thread-2](KIM_SERVICE) - Get EntityAPI. 11:52:58 [DEBUG] 10046[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - Executing evaluateQuery('select COUNTRY,ADJ from {COUNTRY} {ADJ}','SeRQL', listener) 11:52:58 [INFO] 10077[ComponentStarter-Thread-2](ig.RelationExtractors) - Total external relations successfuly loaded : 0 out of 0 supplied. 11:52:58 [INFO] 10108[ComponentStarter-Thread-2](KIM_SERVICE) - SemanticAnnotationAPI loaded on Tue Nov 16 11:52:58 EST 2010 11:52:58 [INFO] 10108[ComponentStarter-Thread-2](NERC) - GATE pipelines=1 11:52:58 [INFO] 10124[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - KIMDocument Feature Schema loaded from Configuration file. 11:52:58 [INFO] 10140[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - KIMDocument Feature Schema loaded from Configuration file. 11:52:58 [INFO] 10140[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - KIMDocument Feature Schema loaded from Configuration file. 11:52:59 [INFO] 10342[ComponentStarter-Thread-2](KIM_SERVICE) - CORE Index Addon: class com.ontotext.kim.coredb.CachingCoreWrapper 11:52:59 [INFO] 10358[ComponentStarter-Thread-2](KIM_SERVICE) - Loaded extension: com.ontotext.kim.coredb.management.RdfCoreAdminExt 11:52:59 [INFO] 10374[ComponentStarter-Thread-2](KIM_SERVICE) - Loaded extension: com.ontotext.kim.util.FactoryImpl 11:52:59 [INFO] 10374[ComponentStarter-Thread-2](KIM_SERVICE) - Loaded extension: com.ontotext.kim.util.console.ConsoleTasksExtension 11:52:59 [INFO] 10389[ComponentStarter-Thread-2](KIM_SERVICE) - Loaded extension: com.ontotext.kim.gate.TeamwareAdapter 11:52:59 [INFO] 10389[ComponentStarter-Thread-2](KIM_SERVICE) - Loaded extension: com.ontotext.kim.rss.KimRssDatabase 11:52:59 [INFO] 10405[ComponentStarter-Thread-2](KIM_SERVICE) - KIM Server startup ended! From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at ontotext.com] Sent: Tuesday, November 16, 2010 10:29 AM To: VERMILLION, Bonnie Cc: borislav popov; Matthew Petrillo; WILSON, Greg; ENUGU, Reddy (Independent Contractor) Subject: Re: [Kim-discussion] question about gate within KIM Hi Bonnie, >From the output of you have sent me, I conclude that you have not cleared the cache after changing the configuration. The cache lives in KIM/context/default/populated. Remove the entire directory clear it. Now if you want the gazetteer to entirely use your ontology instead of KIM's , you should have some things in mind. The gazetteer resource has a setup option FeedSetupPath, which is a path where it searches for a file named query.txt . In your case the path is KIM/config/ . This file contains a query in serql or sparql and is responsible for filling the dictionary of the gazetteer. The query should return exactly 3 characteristics of each entity you would like to put in the dictionary: * the label of the entity * the instance URI of the entity * the direct class this entity is instance of If the gazetteer does not find such a file, it uses this query: select LA, I, DC from ( {TI} rdf:type {}, {I} {TI}, {I} rdf:type {}, {I} serql:directType {DC}, {I} {} rdfs:label {LA}; [ {IG}] ) UNION ( {I} {}, {I} serql:directType {DC}, {I} {LA} ) WHERE IG = NULL AND isLiteral(LA) AND DC != AND NOT LA = "" If you set the semantic repository logger level to DEBUG you could see this in the log. Just change in KIM/config/log.prop : log4j.category.SEMANTIC_REPOSITORY = , aSEMANTIC_REPOSITORY to log4j.category.SEMANTIC_REPOSITORY = DEBUG, aSEMANTIC_REPOSITORY You could create a file KIM/config/query.txt and provide a simpler query like: select lbl, i, dc from {i} {lbl}, {i} serql:directType {dc}, {i} {} Now the instances of Actor and its subclasses will be recognized in the text. Note: One thing that puzzled me when I looked at your screenshots, is that Role was a subclass of Actor. The relation here should be Actor hasRole Role I think. To be able to see your classes in KIM's web interface, you should actually mark them as visible. This happens by providing the triples like this to your RDF: "" . you can see KIM's visibility configuration in KIM/context/default/kb/visibility.nt . Please notify me of your progress, so that I can help further Philip On Nov 16, 2010, at 3:07 PM, VERMILLION, Bonnie wrote: Thanks Phillip. At some point we may have lists such as specific Codes that have a list of values that would be suitable for a gazetteer list. For now what we want to do is turn off Proton (which I think I have done since there are references to Person, Organization or Location in the ontology shown in KIM. So, I'm not sure where the ontology that is now listed in KIM is coming from . But we need to turn it off so that when we load a sample ontology, it just shows the ontology we are loading. Please see the attached screen shots attached. Thank you, Bonnie From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at ontotext.com] Sent: Tuesday, November 16, 2010 3:26 AM To: VERMILLION, Bonnie Cc: borislav popov; Matthew Petrillo; WILSON, Greg; ENUGU, Reddy (Independent Contractor) Subject: Re: [Kim-discussion] question about gate within KIM Hi Bonnie, I guess you would want to run only a gazetteer with your ontology, to observe which entities are recognized? Will this help you? Philip On Nov 16, 2010, at 5:05 AM, VERMILLION, Bonnie wrote: Phillip, I was able to follow the document that you provided in order to load a sample ontology, but because Proton and Annie are still running, the results are not clear. How can I turn off Proton and Annie? Thank you, Bonnie From: VERMILLION, Bonnie Sent: Tuesday, November 09, 2010 11:08 AM To: 'Philip Alexiev @ Ontotext' Cc: borislav popov; Matthew Petrillo; WILSON, Greg; ENUGU, Reddy (Independent Contractor) Subject: RE: [Kim-discussion] question about gate within KIM Thanks Phillip. Great explanation! For the ontology I am trying to load we have both classes and instances. Though we do have one ontology that only has classes. I'll let you know the result after following your response. Thank you, Bonnie From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at ontotext.com] Sent: Tuesday, November 09, 2010 10:54 AM To: VERMILLION, Bonnie Cc: borislav popov; Matthew Petrillo; WILSON, Greg; ENUGU, Reddy (Independent Contractor) Subject: Re: [Kim-discussion] question about gate within KIM Hi Bonnie, The act of extending the ontology alone, does not add value to your IE. It will only store those entities in the semantic repository. In order for those entities to be included in the LKB gazetteer dictionary, they have to meet 3 conditions: * are of a type that is a subclass of protons:Entity * have at least one alias * are marked as Trusted That way the gazetteer will create Lookup annotations when he meets one of those in the text. Later you can transform them using Jape rules. Does your owl file contain instances or only classes? In the general case you need instances to be recognized in the texts. It is a good idea to map some of your classes to PROTON only if you find they are expressing the same concept. Otherwise just subclass your top classes to protons:Entity . 'Include the new files in the import section of owlim' OWLIM's configuration resides in KIM/config/owlim.ttl . There is a owlim:imports section there. Add your custom files there. The path is relative to KIM/context/default/ . If you have already ran KIM, some cache will exist. In this case you will have to clear the cache in order for the changes to take effect. To do this, perform the following steps: * stop KIM * delete KIM/context/default/populated/ (NOTE:this will clear all the cache, including the documents in the document repository). * start KIM All the best, Philip On Nov 9, 2010, at 5:22 PM, VERMILLION, Bonnie wrote: Thanks Phillip. We have several ontologies that we created in Prot?g?. So we have the .owl files. I'm following the documentation that you pointed me to - * Create a sub-folder in the KIM context folder. It will be used as storage for all the RDF data for this task. For example, create $KIM_HOME/context/default/kb/dbpedia/. We recommend this location but you can put your RDF data anywhere in the KIM context folder. * Put dbpedia_3.5.1.owl , containing the DBpedia taxonomy, in $KIM_HOME/context/default/kb/dbpedia/ * Put dbpedia_instances.nt , containing the actual objects description, in $KIM_HOME/context/default/kb/dbpedia/ * Include the new files in the import section of owlim ( $KIM_HOME/config/owlim.ttl ): I created a subfolder und the kb directory and copied an .owl file created in Prot?g?. I'm not sure how to create the .nt file, and the ontology that I'm using does not have Person, Organization or Place domains - so there is nothing to align with Proton. I'm also not sure what is meant by - 'Include the new files in the import section of owlim' Thanks for your expertise! Bonnie From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at ontotext.com] Sent: Tuesday, November 09, 2010 9:37 AM To: VERMILLION, Bonnie Cc: borislav popov; Matthew Petrillo; WILSON, Greg; ENUGU, Reddy (Independent Contractor) Subject: Re: [Kim-discussion] question about gate within KIM Hi Bonnie, Gate embedded in KIM functions the same way. A difference is that not all the plugins available in GATE developer are directly available in KIM too. You can check the KIM/plugins/ folder. Generally if you import the Ontology plugin you should be able to use the Ontology language resources as you intend to. I am sure that if you provide some more information about what you want to achieve, we will be able to provide more meaningful support. A simple usecase will help a lot. All the best, Philip On Nov 9, 2010, at 4:03 PM, VERMILLION, Bonnie wrote: Thanks, Borislov. I will try following the document Phillip mentioned. I guess I was thinking that Gate within KIM would function as it does independently - that is to use Prot?g? to create an ontology and then load the ontology by indicating a CREOLE 'ontology' plug-in and then a Sesame or OWLIM ontology language resource can be used to load the ontology created from Prot?g?. Sorry for the poor explanation. I'll report back! Thank you, Bonnie From: borislav popov [mailto:borislav.popov at ontotext.com] Sent: Tuesday, November 09, 2010 8:40 AM To: VERMILLION, Bonnie Cc: Matthew Petrillo; WILSON, Greg; ENUGU, Reddy (Independent Contractor); philip Subject: Re: [Kim-discussion] question about gate within KIM Hi Bonnie, i will keep philip posted as well on this one. the page philip sent explains how to do this loading & mapping of the new ontology to the default one in KIM (PROTON). This is not exactly a user friendly task - as it is more for administrators of the kim server. Generally this is a task you do initially and the demonstration UIs are not targeted to these people, but the end users. In GATE you can play with loading the ontology if this is helpful to get a better feeling of the data. Regarding: the last sentence of loading the ontology and not the rdf triples - i did not really get it - as ontologies are usually expressed in triples. if you want to avoid loading the instance data - it is handy if they come in separate files. philip please add if i missed something b On Nov 9, 2010, at 3:03 PM, VERMILLION, Bonnie wrote: Borislav, Thank you for your response! After looking at the documentation that Philip referred to, I agree that it is not necessary what I am looking for. What I'm trying to do is to import (if this is possible) an ontology similar to loading an ontology from Prot?g? in to Gate based on the fact that I have select an ontology processing resource that was loaded as a CREOLE plug-in. However, in KIM, there is no such plug-in within the inherent GATE tool. Can I add this CREOLE plug-in to Gate within KIM? Or is there another way to accomplish loading the ontology without having to load the RDF triples as well. Thank you in advance for your assistance! Bonnie Vermillion Yvonne Vermillion 2000 Corporate Ridge McLean, VA 22102-7805 (571)633-7830 P Complex Problems. Practical Solutions. www.lmi.org From: borislav popov [mailto:borislav.popov at ontotext.com] Sent: Tuesday, November 09, 2010 4:02 AM To: VERMILLION, Bonnie Cc: kim-discussion; philip Subject: Re: [Kim-discussion] question about gate within KIM Hi Bonnie, actually your request and philip's answer point in different directions. The ontology plugin in GATE provides partial coverage of what is available in Sesame 2 and/or OWLIM 3 as semantic repository APIs. It is not used in KIM - there you have the direct integration with Sesame-compatible repository, incl. our OWLIM. For client application of KIM - there is also a higher level API accessible on the same level as our search or doc-related functionality. In a KIM context the extension of the default ontology is explained in the documentation piece provided by philip. There are certain things to take into account to ensure the mapping to the default ontology is right and the modeling paradigms of your ontology are compatible with the extraction pipeline - to bootstrap automatic recognition of new entities, given the ontology comes with entity descriptions / knowledge base as well. you can tell us more about your experiments - so that we can suggest the route more accurately. If you consider it confidential - you may also avoid the discussion list, which is public and write directly to us as we have NDA already. all the best borislav On Nov 9, 2010, at 10:27 AM, Philip Alexiev @ Ontotext wrote: Hi Yvonne, In order to use a new ontology it is good to map it to your top ontology classes. http://ontotext.com/kim/doc/KimDocs-3.0-EN/ExtendInformationExtraction.html This is a good guide showing how you can do this. tht Philip Alexiev Software Engineer, KIM team On Nov 8, 2010, at 10:28 PM, VERMILLION, Bonnie wrote: Is there a way to add a ontology CREOLE plug-in within KIM so that an external ontology can be loaded? Thank you, Bonnie Vermillion Yvonne Vermillion 2000 Corporate Ridge McLean, VA 22102-7805 (571)633-7830 P Complex Problems. Practical Solutions. www.lmi.org _______________________________________________ Kim-discussion mailing list Kim-discussion at ontotext.com http://ontotext.com/mailman/listinfo/kim-discussion _______________________________________________ Kim-discussion mailing list Kim-discussion at ontotext.com http://ontotext.com/mailman/listinfo/kim-discussion -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: KIM_Entity_issue.docx Type: application/vnd.openxmlformats-officedocument.wordprocessingml.document Size: 623115 bytes Desc: KIM_Entity_issue.docx URL: From YVERMILLION at lmi.org Tue Nov 16 14:19:53 2010 From: YVERMILLION at lmi.org (VERMILLION, Bonnie) Date: Tue, 16 Nov 2010 14:19:53 -0500 Subject: [Kim-discussion] question about gate within KIM In-Reply-To: <26B7D3B5-BDD7-443D-86A9-37BF7657C856@ontotext.com> References: <83E46363-DAA5-4E7E-96FD-32B8B633E102@ontotext.com> <25B94943-AFED-46DC-A827-0452C3506530@ontotext.com> <1EE46E0D-41AB-42FE-B077-654E683885E9@ontotext.com> <787EE2AB-D3BF-4AED-B748-31D39E0492DF@ontotext.com> <26B7D3B5-BDD7-443D-86A9-37BF7657C856@ontotext.com> Message-ID: Sure. Also Philip - I think there is an issue with what I added to the visibility file - attaching the issue and the ontology. Thank you, Bonnie From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at ontotext.com] Sent: Tuesday, November 16, 2010 2:13 PM To: VERMILLION, Bonnie Cc: borislav popov; Matthew Petrillo; WILSON, Greg; ENUGU, Reddy (Independent Contractor); KIM Server mailing-list Subject: Re: [Kim-discussion] question about gate within KIM Hi Bonnie, I think I will save you a lot of time if you send me the ontology so that I can play with it. Is it possible? It seems the query does not return any results. I can not say what should be the exact query without knowledge of the ontology. All the best Philip On Nov 16, 2010, at 8:59 PM, VERMILLION, Bonnie wrote: I got it working, but now no Entities display. See attached Thanks, Phillip - getting there with your help! Bonnie From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at ontotext.com] Sent: Tuesday, November 16, 2010 1:46 PM To: VERMILLION, Bonnie Cc: borislav popov; Matthew Petrillo; WILSON, Greg; ENUGU, Reddy (Independent Contractor); KIM Server mailing-list Subject: Re: [Kim-discussion] question about gate within KIM Hi Bonnie I guess my editor has put some strange character there. Just copy-paste it in a simple text editor (notepad) and save it. This should save only the readable characters. hth Philip On Nov 16, 2010, at 6:55 PM, VERMILLION, Bonnie wrote: Hi Phillip, I'm getting an error from the query file in red below: Can you let me know what to do to correct it? Thank you, Bonnie 1:52:51 [INFO] 2371[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - Labels are loaded from aliases. 11:52:51 [DEBUG] 2480[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - classes cache contains 321 items. here is the first: http://proton.semanticweb.org/2006/05/protonu#AirplaneModel 11:52:51 [DEBUG] 2776[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - direct subs cache contains 321 items. here is the first: http://proton.semanticweb.org/2006/05/protonu#AirplaneModel=[] 11:52:51 [DEBUG] 2776[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - all subs cache contains 321 items. here is the first: http://proton.semanticweb.org/2006/05/protonu#AirplaneModel=[http://proton.semanticweb.org/2006/05/protonu#AirplaneModel] 11:52:51 [DEBUG] 2776[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - supers cache contains 321 items. here is the first: http://proton.semanticweb.org/2006/05/protonu#AirplaneModel=[http://proton.semanticweb.org/2006/05/protonu#AirplaneModel, http://www.w3.org/2000/01/rdf-schema#Resource, http://proton.semanticweb.org/2006/05/protont#ProductModel, http://proton.semanticweb.org/2006/05/protont#Object, http://proton.semanticweb.org/2006/05/protons#Entity] 11:52:51 [INFO] 2792[ComponentStarter-Thread-2](KIM_SERVICE) - Waking Up GATE... 11:52:51 [INFO] 3276[ComponentStarter-Thread-2](KIM_SERVICE) - GATE is AWAKE. 11:52:51 [INFO] 3291[ComponentStarter-Thread-2](KIM_SERVICE) - Loading C:\KIM\kim-platform-3.0-RC4\context\default\resources\IE.gapp 11:52:55 [INFO] 7176[ComponentStarter-Thread-2](gate.LargeKBGazetteer) - Replaced $relpath$ in gazetteer parameters with C:\KIM\kim-platform-3.0-RC4\context\default\resources/ 11:52:55 [INFO] 7207[ComponentStarter-Thread-2](model.KimDictionaryFeederImpl) - Loading of trusted entities from Sesame 11:52:55 [DEBUG] 7207[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - Executing evaluateQuery('select lbl, i, dc from {i} {lbl}, {i} serql:directType {dc}, {i} {} ','null', listener) 11:52:55 [DEBUG] 7207[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - org.openrdf.query.MalformedQueryException: Lexical error at line 1, column 8. Encountered: "\u00a0" (160), after : "" 11:52:55 [DEBUG] 7238[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - org.openrdf.query.MalformedQueryException: Lexical error at line 1, column 8. Encountered: "\u00a0" (160), after : "" 11:52:55 [INFO] 7238[ComponentStarter-Thread-2](model.KimDictionaryFeederImpl) - The loading of the Static Dictionary finished 11:52:58 [INFO] 10046[ComponentStarter-Thread-2](KIM_SERVICE) - Get EntityAPI. 11:52:58 [DEBUG] 10046[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - Executing evaluateQuery('select COUNTRY,ADJ from {COUNTRY} {ADJ}','SeRQL', listener) 11:52:58 [INFO] 10077[ComponentStarter-Thread-2](ig.RelationExtractors) - Total external relations successfuly loaded : 0 out of 0 supplied. 11:52:58 [INFO] 10108[ComponentStarter-Thread-2](KIM_SERVICE) - SemanticAnnotationAPI loaded on Tue Nov 16 11:52:58 EST 2010 11:52:58 [INFO] 10108[ComponentStarter-Thread-2](NERC) - GATE pipelines=1 11:52:58 [INFO] 10124[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - KIMDocument Feature Schema loaded from Configuration file. 11:52:58 [INFO] 10140[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - KIMDocument Feature Schema loaded from Configuration file. 11:52:58 [INFO] 10140[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - KIMDocument Feature Schema loaded from Configuration file. 11:52:59 [INFO] 10342[ComponentStarter-Thread-2](KIM_SERVICE) - CORE Index Addon: class com.ontotext.kim.coredb.CachingCoreWrapper 11:52:59 [INFO] 10358[ComponentStarter-Thread-2](KIM_SERVICE) - Loaded extension: com.ontotext.kim.coredb.management.RdfCoreAdminExt 11:52:59 [INFO] 10374[ComponentStarter-Thread-2](KIM_SERVICE) - Loaded extension: com.ontotext.kim.util.FactoryImpl 11:52:59 [INFO] 10374[ComponentStarter-Thread-2](KIM_SERVICE) - Loaded extension: com.ontotext.kim.util.console.ConsoleTasksExtension 11:52:59 [INFO] 10389[ComponentStarter-Thread-2](KIM_SERVICE) - Loaded extension: com.ontotext.kim.gate.TeamwareAdapter 11:52:59 [INFO] 10389[ComponentStarter-Thread-2](KIM_SERVICE) - Loaded extension: com.ontotext.kim.rss.KimRssDatabase 11:52:59 [INFO] 10405[ComponentStarter-Thread-2](KIM_SERVICE) - KIM Server startup ended! From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at ontotext.com] Sent: Tuesday, November 16, 2010 10:29 AM To: VERMILLION, Bonnie Cc: borislav popov; Matthew Petrillo; WILSON, Greg; ENUGU, Reddy (Independent Contractor) Subject: Re: [Kim-discussion] question about gate within KIM Hi Bonnie, >From the output of you have sent me, I conclude that you have not cleared the cache after changing the configuration. The cache lives in KIM/context/default/populated. Remove the entire directory clear it. Now if you want the gazetteer to entirely use your ontology instead of KIM's , you should have some things in mind. The gazetteer resource has a setup option FeedSetupPath, which is a path where it searches for a file named query.txt . In your case the path is KIM/config/ . This file contains a query in serql or sparql and is responsible for filling the dictionary of the gazetteer. The query should return exactly 3 characteristics of each entity you would like to put in the dictionary: * the label of the entity * the instance URI of the entity * the direct class this entity is instance of If the gazetteer does not find such a file, it uses this query: select LA, I, DC from ( {TI} rdf:type {}, {I} {TI}, {I} rdf:type {}, {I} serql:directType {DC}, {I} {} rdfs:label {LA}; [ {IG}] ) UNION ( {I} {}, {I} serql:directType {DC}, {I} {LA} ) WHERE IG = NULL AND isLiteral(LA) AND DC != AND NOT LA = "" If you set the semantic repository logger level to DEBUG you could see this in the log. Just change in KIM/config/log.prop : log4j.category.SEMANTIC_REPOSITORY = , aSEMANTIC_REPOSITORY to log4j.category.SEMANTIC_REPOSITORY = DEBUG, aSEMANTIC_REPOSITORY You could create a file KIM/config/query.txt and provide a simpler query like: select lbl, i, dc from {i} {lbl}, {i} serql:directType {dc}, {i} {} Now the instances of Actor and its subclasses will be recognized in the text. Note: One thing that puzzled me when I looked at your screenshots, is that Role was a subclass of Actor. The relation here should be Actor hasRole Role I think. To be able to see your classes in KIM's web interface, you should actually mark them as visible. This happens by providing the triples like this to your RDF: "" . you can see KIM's visibility configuration in KIM/context/default/kb/visibility.nt . Please notify me of your progress, so that I can help further Philip On Nov 16, 2010, at 3:07 PM, VERMILLION, Bonnie wrote: Thanks Phillip. At some point we may have lists such as specific Codes that have a list of values that would be suitable for a gazetteer list. For now what we want to do is turn off Proton (which I think I have done since there are references to Person, Organization or Location in the ontology shown in KIM. So, I'm not sure where the ontology that is now listed in KIM is coming from . But we need to turn it off so that when we load a sample ontology, it just shows the ontology we are loading. Please see the attached screen shots attached. Thank you, Bonnie From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at ontotext.com] Sent: Tuesday, November 16, 2010 3:26 AM To: VERMILLION, Bonnie Cc: borislav popov; Matthew Petrillo; WILSON, Greg; ENUGU, Reddy (Independent Contractor) Subject: Re: [Kim-discussion] question about gate within KIM Hi Bonnie, I guess you would want to run only a gazetteer with your ontology, to observe which entities are recognized? Will this help you? Philip On Nov 16, 2010, at 5:05 AM, VERMILLION, Bonnie wrote: Phillip, I was able to follow the document that you provided in order to load a sample ontology, but because Proton and Annie are still running, the results are not clear. How can I turn off Proton and Annie? Thank you, Bonnie From: VERMILLION, Bonnie Sent: Tuesday, November 09, 2010 11:08 AM To: 'Philip Alexiev @ Ontotext' Cc: borislav popov; Matthew Petrillo; WILSON, Greg; ENUGU, Reddy (Independent Contractor) Subject: RE: [Kim-discussion] question about gate within KIM Thanks Phillip. Great explanation! For the ontology I am trying to load we have both classes and instances. Though we do have one ontology that only has classes. I'll let you know the result after following your response. Thank you, Bonnie From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at ontotext.com] Sent: Tuesday, November 09, 2010 10:54 AM To: VERMILLION, Bonnie Cc: borislav popov; Matthew Petrillo; WILSON, Greg; ENUGU, Reddy (Independent Contractor) Subject: Re: [Kim-discussion] question about gate within KIM Hi Bonnie, The act of extending the ontology alone, does not add value to your IE. It will only store those entities in the semantic repository. In order for those entities to be included in the LKB gazetteer dictionary, they have to meet 3 conditions: * are of a type that is a subclass of protons:Entity * have at least one alias * are marked as Trusted That way the gazetteer will create Lookup annotations when he meets one of those in the text. Later you can transform them using Jape rules. Does your owl file contain instances or only classes? In the general case you need instances to be recognized in the texts. It is a good idea to map some of your classes to PROTON only if you find they are expressing the same concept. Otherwise just subclass your top classes to protons:Entity . 'Include the new files in the import section of owlim' OWLIM's configuration resides in KIM/config/owlim.ttl . There is a owlim:imports section there. Add your custom files there. The path is relative to KIM/context/default/ . If you have already ran KIM, some cache will exist. In this case you will have to clear the cache in order for the changes to take effect. To do this, perform the following steps: * stop KIM * delete KIM/context/default/populated/ (NOTE:this will clear all the cache, including the documents in the document repository). * start KIM All the best, Philip On Nov 9, 2010, at 5:22 PM, VERMILLION, Bonnie wrote: Thanks Phillip. We have several ontologies that we created in Prot?g?. So we have the .owl files. I'm following the documentation that you pointed me to - * Create a sub-folder in the KIM context folder. It will be used as storage for all the RDF data for this task. For example, create $KIM_HOME/context/default/kb/dbpedia/. We recommend this location but you can put your RDF data anywhere in the KIM context folder. * Put dbpedia_3.5.1.owl , containing the DBpedia taxonomy, in $KIM_HOME/context/default/kb/dbpedia/ * Put dbpedia_instances.nt , containing the actual objects description, in $KIM_HOME/context/default/kb/dbpedia/ * Include the new files in the import section of owlim ( $KIM_HOME/config/owlim.ttl ): I created a subfolder und the kb directory and copied an .owl file created in Prot?g?. I'm not sure how to create the .nt file, and the ontology that I'm using does not have Person, Organization or Place domains - so there is nothing to align with Proton. I'm also not sure what is meant by - 'Include the new files in the import section of owlim' Thanks for your expertise! Bonnie From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at ontotext.com] Sent: Tuesday, November 09, 2010 9:37 AM To: VERMILLION, Bonnie Cc: borislav popov; Matthew Petrillo; WILSON, Greg; ENUGU, Reddy (Independent Contractor) Subject: Re: [Kim-discussion] question about gate within KIM Hi Bonnie, Gate embedded in KIM functions the same way. A difference is that not all the plugins available in GATE developer are directly available in KIM too. You can check the KIM/plugins/ folder. Generally if you import the Ontology plugin you should be able to use the Ontology language resources as you intend to. I am sure that if you provide some more information about what you want to achieve, we will be able to provide more meaningful support. A simple usecase will help a lot. All the best, Philip On Nov 9, 2010, at 4:03 PM, VERMILLION, Bonnie wrote: Thanks, Borislov. I will try following the document Phillip mentioned. I guess I was thinking that Gate within KIM would function as it does independently - that is to use Prot?g? to create an ontology and then load the ontology by indicating a CREOLE 'ontology' plug-in and then a Sesame or OWLIM ontology language resource can be used to load the ontology created from Prot?g?. Sorry for the poor explanation. I'll report back! Thank you, Bonnie From: borislav popov [mailto:borislav.popov at ontotext.com] Sent: Tuesday, November 09, 2010 8:40 AM To: VERMILLION, Bonnie Cc: Matthew Petrillo; WILSON, Greg; ENUGU, Reddy (Independent Contractor); philip Subject: Re: [Kim-discussion] question about gate within KIM Hi Bonnie, i will keep philip posted as well on this one. the page philip sent explains how to do this loading & mapping of the new ontology to the default one in KIM (PROTON). This is not exactly a user friendly task - as it is more for administrators of the kim server. Generally this is a task you do initially and the demonstration UIs are not targeted to these people, but the end users. In GATE you can play with loading the ontology if this is helpful to get a better feeling of the data. Regarding: the last sentence of loading the ontology and not the rdf triples - i did not really get it - as ontologies are usually expressed in triples. if you want to avoid loading the instance data - it is handy if they come in separate files. philip please add if i missed something b On Nov 9, 2010, at 3:03 PM, VERMILLION, Bonnie wrote: Borislav, Thank you for your response! After looking at the documentation that Philip referred to, I agree that it is not necessary what I am looking for. What I'm trying to do is to import (if this is possible) an ontology similar to loading an ontology from Prot?g? in to Gate based on the fact that I have select an ontology processing resource that was loaded as a CREOLE plug-in. However, in KIM, there is no such plug-in within the inherent GATE tool. Can I add this CREOLE plug-in to Gate within KIM? Or is there another way to accomplish loading the ontology without having to load the RDF triples as well. Thank you in advance for your assistance! Bonnie Vermillion Yvonne Vermillion 2000 Corporate Ridge McLean, VA 22102-7805 (571)633-7830 P Complex Problems. Practical Solutions. www.lmi.org From: borislav popov [mailto:borislav.popov at ontotext.com] Sent: Tuesday, November 09, 2010 4:02 AM To: VERMILLION, Bonnie Cc: kim-discussion; philip Subject: Re: [Kim-discussion] question about gate within KIM Hi Bonnie, actually your request and philip's answer point in different directions. The ontology plugin in GATE provides partial coverage of what is available in Sesame 2 and/or OWLIM 3 as semantic repository APIs. It is not used in KIM - there you have the direct integration with Sesame-compatible repository, incl. our OWLIM. For client application of KIM - there is also a higher level API accessible on the same level as our search or doc-related functionality. In a KIM context the extension of the default ontology is explained in the documentation piece provided by philip. There are certain things to take into account to ensure the mapping to the default ontology is right and the modeling paradigms of your ontology are compatible with the extraction pipeline - to bootstrap automatic recognition of new entities, given the ontology comes with entity descriptions / knowledge base as well. you can tell us more about your experiments - so that we can suggest the route more accurately. If you consider it confidential - you may also avoid the discussion list, which is public and write directly to us as we have NDA already. all the best borislav On Nov 9, 2010, at 10:27 AM, Philip Alexiev @ Ontotext wrote: Hi Yvonne, In order to use a new ontology it is good to map it to your top ontology classes. http://ontotext.com/kim/doc/KimDocs-3.0-EN/ExtendInformationExtraction.html This is a good guide showing how you can do this. tht Philip Alexiev Software Engineer, KIM team On Nov 8, 2010, at 10:28 PM, VERMILLION, Bonnie wrote: Is there a way to add a ontology CREOLE plug-in within KIM so that an external ontology can be loaded? Thank you, Bonnie Vermillion Yvonne Vermillion 2000 Corporate Ridge McLean, VA 22102-7805 (571)633-7830 P Complex Problems. Practical Solutions. www.lmi.org _______________________________________________ Kim-discussion mailing list Kim-discussion at ontotext.com http://ontotext.com/mailman/listinfo/kim-discussion _______________________________________________ Kim-discussion mailing list Kim-discussion at ontotext.com http://ontotext.com/mailman/listinfo/kim-discussion -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: visibility file.docx Type: application/vnd.openxmlformats-officedocument.wordprocessingml.document Size: 251581 bytes Desc: visibility file.docx URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: dispreg.owl Type: application/octet-stream Size: 9374 bytes Desc: dispreg.owl URL: From YVERMILLION at lmi.org Tue Nov 16 16:02:26 2010 From: YVERMILLION at lmi.org (VERMILLION, Bonnie) Date: Tue, 16 Nov 2010 16:02:26 -0500 Subject: [Kim-discussion] question about gate within KIM In-Reply-To: <26B7D3B5-BDD7-443D-86A9-37BF7657C856@ontotext.com> References: <83E46363-DAA5-4E7E-96FD-32B8B633E102@ontotext.com> <25B94943-AFED-46DC-A827-0452C3506530@ontotext.com> <1EE46E0D-41AB-42FE-B077-654E683885E9@ontotext.com> <787EE2AB-D3BF-4AED-B748-31D39E0492DF@ontotext.com> <26B7D3B5-BDD7-443D-86A9-37BF7657C856@ontotext.com> Message-ID: Philip, Here is another example of the issue. Thank you for working through this! Bonnie From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at ontotext.com] Sent: Tuesday, November 16, 2010 2:13 PM To: VERMILLION, Bonnie Cc: borislav popov; Matthew Petrillo; WILSON, Greg; ENUGU, Reddy (Independent Contractor); KIM Server mailing-list Subject: Re: [Kim-discussion] question about gate within KIM Hi Bonnie, I think I will save you a lot of time if you send me the ontology so that I can play with it. Is it possible? It seems the query does not return any results. I can not say what should be the exact query without knowledge of the ontology. All the best Philip On Nov 16, 2010, at 8:59 PM, VERMILLION, Bonnie wrote: I got it working, but now no Entities display. See attached Thanks, Phillip - getting there with your help! Bonnie From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at ontotext.com] Sent: Tuesday, November 16, 2010 1:46 PM To: VERMILLION, Bonnie Cc: borislav popov; Matthew Petrillo; WILSON, Greg; ENUGU, Reddy (Independent Contractor); KIM Server mailing-list Subject: Re: [Kim-discussion] question about gate within KIM Hi Bonnie I guess my editor has put some strange character there. Just copy-paste it in a simple text editor (notepad) and save it. This should save only the readable characters. hth Philip On Nov 16, 2010, at 6:55 PM, VERMILLION, Bonnie wrote: Hi Phillip, I'm getting an error from the query file in red below: Can you let me know what to do to correct it? Thank you, Bonnie 1:52:51 [INFO] 2371[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - Labels are loaded from aliases. 11:52:51 [DEBUG] 2480[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - classes cache contains 321 items. here is the first: http://proton.semanticweb.org/2006/05/protonu#AirplaneModel 11:52:51 [DEBUG] 2776[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - direct subs cache contains 321 items. here is the first: http://proton.semanticweb.org/2006/05/protonu#AirplaneModel=[] 11:52:51 [DEBUG] 2776[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - all subs cache contains 321 items. here is the first: http://proton.semanticweb.org/2006/05/protonu#AirplaneModel=[http://proton.semanticweb.org/2006/05/protonu#AirplaneModel] 11:52:51 [DEBUG] 2776[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - supers cache contains 321 items. here is the first: http://proton.semanticweb.org/2006/05/protonu#AirplaneModel=[http://proton.semanticweb.org/2006/05/protonu#AirplaneModel, http://www.w3.org/2000/01/rdf-schema#Resource, http://proton.semanticweb.org/2006/05/protont#ProductModel, http://proton.semanticweb.org/2006/05/protont#Object, http://proton.semanticweb.org/2006/05/protons#Entity] 11:52:51 [INFO] 2792[ComponentStarter-Thread-2](KIM_SERVICE) - Waking Up GATE... 11:52:51 [INFO] 3276[ComponentStarter-Thread-2](KIM_SERVICE) - GATE is AWAKE. 11:52:51 [INFO] 3291[ComponentStarter-Thread-2](KIM_SERVICE) - Loading C:\KIM\kim-platform-3.0-RC4\context\default\resources\IE.gapp 11:52:55 [INFO] 7176[ComponentStarter-Thread-2](gate.LargeKBGazetteer) - Replaced $relpath$ in gazetteer parameters with C:\KIM\kim-platform-3.0-RC4\context\default\resources/ 11:52:55 [INFO] 7207[ComponentStarter-Thread-2](model.KimDictionaryFeederImpl) - Loading of trusted entities from Sesame 11:52:55 [DEBUG] 7207[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - Executing evaluateQuery('select lbl, i, dc from {i} {lbl}, {i} serql:directType {dc}, {i} {} ','null', listener) 11:52:55 [DEBUG] 7207[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - org.openrdf.query.MalformedQueryException: Lexical error at line 1, column 8. Encountered: "\u00a0" (160), after : "" 11:52:55 [DEBUG] 7238[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - org.openrdf.query.MalformedQueryException: Lexical error at line 1, column 8. Encountered: "\u00a0" (160), after : "" 11:52:55 [INFO] 7238[ComponentStarter-Thread-2](model.KimDictionaryFeederImpl) - The loading of the Static Dictionary finished 11:52:58 [INFO] 10046[ComponentStarter-Thread-2](KIM_SERVICE) - Get EntityAPI. 11:52:58 [DEBUG] 10046[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - Executing evaluateQuery('select COUNTRY,ADJ from {COUNTRY} {ADJ}','SeRQL', listener) 11:52:58 [INFO] 10077[ComponentStarter-Thread-2](ig.RelationExtractors) - Total external relations successfuly loaded : 0 out of 0 supplied. 11:52:58 [INFO] 10108[ComponentStarter-Thread-2](KIM_SERVICE) - SemanticAnnotationAPI loaded on Tue Nov 16 11:52:58 EST 2010 11:52:58 [INFO] 10108[ComponentStarter-Thread-2](NERC) - GATE pipelines=1 11:52:58 [INFO] 10124[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - KIMDocument Feature Schema loaded from Configuration file. 11:52:58 [INFO] 10140[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - KIMDocument Feature Schema loaded from Configuration file. 11:52:58 [INFO] 10140[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - KIMDocument Feature Schema loaded from Configuration file. 11:52:59 [INFO] 10342[ComponentStarter-Thread-2](KIM_SERVICE) - CORE Index Addon: class com.ontotext.kim.coredb.CachingCoreWrapper 11:52:59 [INFO] 10358[ComponentStarter-Thread-2](KIM_SERVICE) - Loaded extension: com.ontotext.kim.coredb.management.RdfCoreAdminExt 11:52:59 [INFO] 10374[ComponentStarter-Thread-2](KIM_SERVICE) - Loaded extension: com.ontotext.kim.util.FactoryImpl 11:52:59 [INFO] 10374[ComponentStarter-Thread-2](KIM_SERVICE) - Loaded extension: com.ontotext.kim.util.console.ConsoleTasksExtension 11:52:59 [INFO] 10389[ComponentStarter-Thread-2](KIM_SERVICE) - Loaded extension: com.ontotext.kim.gate.TeamwareAdapter 11:52:59 [INFO] 10389[ComponentStarter-Thread-2](KIM_SERVICE) - Loaded extension: com.ontotext.kim.rss.KimRssDatabase 11:52:59 [INFO] 10405[ComponentStarter-Thread-2](KIM_SERVICE) - KIM Server startup ended! From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at ontotext.com] Sent: Tuesday, November 16, 2010 10:29 AM To: VERMILLION, Bonnie Cc: borislav popov; Matthew Petrillo; WILSON, Greg; ENUGU, Reddy (Independent Contractor) Subject: Re: [Kim-discussion] question about gate within KIM Hi Bonnie, >From the output of you have sent me, I conclude that you have not cleared the cache after changing the configuration. The cache lives in KIM/context/default/populated. Remove the entire directory clear it. Now if you want the gazetteer to entirely use your ontology instead of KIM's , you should have some things in mind. The gazetteer resource has a setup option FeedSetupPath, which is a path where it searches for a file named query.txt . In your case the path is KIM/config/ . This file contains a query in serql or sparql and is responsible for filling the dictionary of the gazetteer. The query should return exactly 3 characteristics of each entity you would like to put in the dictionary: * the label of the entity * the instance URI of the entity * the direct class this entity is instance of If the gazetteer does not find such a file, it uses this query: select LA, I, DC from ( {TI} rdf:type {}, {I} {TI}, {I} rdf:type {}, {I} serql:directType {DC}, {I} {} rdfs:label {LA}; [ {IG}] ) UNION ( {I} {}, {I} serql:directType {DC}, {I} {LA} ) WHERE IG = NULL AND isLiteral(LA) AND DC != AND NOT LA = "" If you set the semantic repository logger level to DEBUG you could see this in the log. Just change in KIM/config/log.prop : log4j.category.SEMANTIC_REPOSITORY = , aSEMANTIC_REPOSITORY to log4j.category.SEMANTIC_REPOSITORY = DEBUG, aSEMANTIC_REPOSITORY You could create a file KIM/config/query.txt and provide a simpler query like: select lbl, i, dc from {i} {lbl}, {i} serql:directType {dc}, {i} {} Now the instances of Actor and its subclasses will be recognized in the text. Note: One thing that puzzled me when I looked at your screenshots, is that Role was a subclass of Actor. The relation here should be Actor hasRole Role I think. To be able to see your classes in KIM's web interface, you should actually mark them as visible. This happens by providing the triples like this to your RDF: "" . you can see KIM's visibility configuration in KIM/context/default/kb/visibility.nt . Please notify me of your progress, so that I can help further Philip On Nov 16, 2010, at 3:07 PM, VERMILLION, Bonnie wrote: Thanks Phillip. At some point we may have lists such as specific Codes that have a list of values that would be suitable for a gazetteer list. For now what we want to do is turn off Proton (which I think I have done since there are references to Person, Organization or Location in the ontology shown in KIM. So, I'm not sure where the ontology that is now listed in KIM is coming from . But we need to turn it off so that when we load a sample ontology, it just shows the ontology we are loading. Please see the attached screen shots attached. Thank you, Bonnie From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at ontotext.com] Sent: Tuesday, November 16, 2010 3:26 AM To: VERMILLION, Bonnie Cc: borislav popov; Matthew Petrillo; WILSON, Greg; ENUGU, Reddy (Independent Contractor) Subject: Re: [Kim-discussion] question about gate within KIM Hi Bonnie, I guess you would want to run only a gazetteer with your ontology, to observe which entities are recognized? Will this help you? Philip On Nov 16, 2010, at 5:05 AM, VERMILLION, Bonnie wrote: Phillip, I was able to follow the document that you provided in order to load a sample ontology, but because Proton and Annie are still running, the results are not clear. How can I turn off Proton and Annie? Thank you, Bonnie From: VERMILLION, Bonnie Sent: Tuesday, November 09, 2010 11:08 AM To: 'Philip Alexiev @ Ontotext' Cc: borislav popov; Matthew Petrillo; WILSON, Greg; ENUGU, Reddy (Independent Contractor) Subject: RE: [Kim-discussion] question about gate within KIM Thanks Phillip. Great explanation! For the ontology I am trying to load we have both classes and instances. Though we do have one ontology that only has classes. I'll let you know the result after following your response. Thank you, Bonnie From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at ontotext.com] Sent: Tuesday, November 09, 2010 10:54 AM To: VERMILLION, Bonnie Cc: borislav popov; Matthew Petrillo; WILSON, Greg; ENUGU, Reddy (Independent Contractor) Subject: Re: [Kim-discussion] question about gate within KIM Hi Bonnie, The act of extending the ontology alone, does not add value to your IE. It will only store those entities in the semantic repository. In order for those entities to be included in the LKB gazetteer dictionary, they have to meet 3 conditions: * are of a type that is a subclass of protons:Entity * have at least one alias * are marked as Trusted That way the gazetteer will create Lookup annotations when he meets one of those in the text. Later you can transform them using Jape rules. Does your owl file contain instances or only classes? In the general case you need instances to be recognized in the texts. It is a good idea to map some of your classes to PROTON only if you find they are expressing the same concept. Otherwise just subclass your top classes to protons:Entity . 'Include the new files in the import section of owlim' OWLIM's configuration resides in KIM/config/owlim.ttl . There is a owlim:imports section there. Add your custom files there. The path is relative to KIM/context/default/ . If you have already ran KIM, some cache will exist. In this case you will have to clear the cache in order for the changes to take effect. To do this, perform the following steps: * stop KIM * delete KIM/context/default/populated/ (NOTE:this will clear all the cache, including the documents in the document repository). * start KIM All the best, Philip On Nov 9, 2010, at 5:22 PM, VERMILLION, Bonnie wrote: Thanks Phillip. We have several ontologies that we created in Prot?g?. So we have the .owl files. I'm following the documentation that you pointed me to - * Create a sub-folder in the KIM context folder. It will be used as storage for all the RDF data for this task. For example, create $KIM_HOME/context/default/kb/dbpedia/. We recommend this location but you can put your RDF data anywhere in the KIM context folder. * Put dbpedia_3.5.1.owl , containing the DBpedia taxonomy, in $KIM_HOME/context/default/kb/dbpedia/ * Put dbpedia_instances.nt , containing the actual objects description, in $KIM_HOME/context/default/kb/dbpedia/ * Include the new files in the import section of owlim ( $KIM_HOME/config/owlim.ttl ): I created a subfolder und the kb directory and copied an .owl file created in Prot?g?. I'm not sure how to create the .nt file, and the ontology that I'm using does not have Person, Organization or Place domains - so there is nothing to align with Proton. I'm also not sure what is meant by - 'Include the new files in the import section of owlim' Thanks for your expertise! Bonnie From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at ontotext.com] Sent: Tuesday, November 09, 2010 9:37 AM To: VERMILLION, Bonnie Cc: borislav popov; Matthew Petrillo; WILSON, Greg; ENUGU, Reddy (Independent Contractor) Subject: Re: [Kim-discussion] question about gate within KIM Hi Bonnie, Gate embedded in KIM functions the same way. A difference is that not all the plugins available in GATE developer are directly available in KIM too. You can check the KIM/plugins/ folder. Generally if you import the Ontology plugin you should be able to use the Ontology language resources as you intend to. I am sure that if you provide some more information about what you want to achieve, we will be able to provide more meaningful support. A simple usecase will help a lot. All the best, Philip On Nov 9, 2010, at 4:03 PM, VERMILLION, Bonnie wrote: Thanks, Borislov. I will try following the document Phillip mentioned. I guess I was thinking that Gate within KIM would function as it does independently - that is to use Prot?g? to create an ontology and then load the ontology by indicating a CREOLE 'ontology' plug-in and then a Sesame or OWLIM ontology language resource can be used to load the ontology created from Prot?g?. Sorry for the poor explanation. I'll report back! Thank you, Bonnie From: borislav popov [mailto:borislav.popov at ontotext.com] Sent: Tuesday, November 09, 2010 8:40 AM To: VERMILLION, Bonnie Cc: Matthew Petrillo; WILSON, Greg; ENUGU, Reddy (Independent Contractor); philip Subject: Re: [Kim-discussion] question about gate within KIM Hi Bonnie, i will keep philip posted as well on this one. the page philip sent explains how to do this loading & mapping of the new ontology to the default one in KIM (PROTON). This is not exactly a user friendly task - as it is more for administrators of the kim server. Generally this is a task you do initially and the demonstration UIs are not targeted to these people, but the end users. In GATE you can play with loading the ontology if this is helpful to get a better feeling of the data. Regarding: the last sentence of loading the ontology and not the rdf triples - i did not really get it - as ontologies are usually expressed in triples. if you want to avoid loading the instance data - it is handy if they come in separate files. philip please add if i missed something b On Nov 9, 2010, at 3:03 PM, VERMILLION, Bonnie wrote: Borislav, Thank you for your response! After looking at the documentation that Philip referred to, I agree that it is not necessary what I am looking for. What I'm trying to do is to import (if this is possible) an ontology similar to loading an ontology from Prot?g? in to Gate based on the fact that I have select an ontology processing resource that was loaded as a CREOLE plug-in. However, in KIM, there is no such plug-in within the inherent GATE tool. Can I add this CREOLE plug-in to Gate within KIM? Or is there another way to accomplish loading the ontology without having to load the RDF triples as well. Thank you in advance for your assistance! Bonnie Vermillion Yvonne Vermillion 2000 Corporate Ridge McLean, VA 22102-7805 (571)633-7830 P Complex Problems. Practical Solutions. www.lmi.org From: borislav popov [mailto:borislav.popov at ontotext.com] Sent: Tuesday, November 09, 2010 4:02 AM To: VERMILLION, Bonnie Cc: kim-discussion; philip Subject: Re: [Kim-discussion] question about gate within KIM Hi Bonnie, actually your request and philip's answer point in different directions. The ontology plugin in GATE provides partial coverage of what is available in Sesame 2 and/or OWLIM 3 as semantic repository APIs. It is not used in KIM - there you have the direct integration with Sesame-compatible repository, incl. our OWLIM. For client application of KIM - there is also a higher level API accessible on the same level as our search or doc-related functionality. In a KIM context the extension of the default ontology is explained in the documentation piece provided by philip. There are certain things to take into account to ensure the mapping to the default ontology is right and the modeling paradigms of your ontology are compatible with the extraction pipeline - to bootstrap automatic recognition of new entities, given the ontology comes with entity descriptions / knowledge base as well. you can tell us more about your experiments - so that we can suggest the route more accurately. If you consider it confidential - you may also avoid the discussion list, which is public and write directly to us as we have NDA already. all the best borislav On Nov 9, 2010, at 10:27 AM, Philip Alexiev @ Ontotext wrote: Hi Yvonne, In order to use a new ontology it is good to map it to your top ontology classes. http://ontotext.com/kim/doc/KimDocs-3.0-EN/ExtendInformationExtraction.html This is a good guide showing how you can do this. tht Philip Alexiev Software Engineer, KIM team On Nov 8, 2010, at 10:28 PM, VERMILLION, Bonnie wrote: Is there a way to add a ontology CREOLE plug-in within KIM so that an external ontology can be loaded? Thank you, Bonnie Vermillion Yvonne Vermillion 2000 Corporate Ridge McLean, VA 22102-7805 (571)633-7830 P Complex Problems. Practical Solutions. www.lmi.org _______________________________________________ Kim-discussion mailing list Kim-discussion at ontotext.com http://ontotext.com/mailman/listinfo/kim-discussion _______________________________________________ Kim-discussion mailing list Kim-discussion at ontotext.com http://ontotext.com/mailman/listinfo/kim-discussion -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: Another example of the issue.docx Type: application/vnd.openxmlformats-officedocument.wordprocessingml.document Size: 730085 bytes Desc: Another example of the issue.docx URL: From philip.alexiev at ontotext.com Wed Nov 17 10:37:58 2010 From: philip.alexiev at ontotext.com (Philip Alexiev @ Ontotext) Date: Wed, 17 Nov 2010 17:37:58 +0200 Subject: [Kim-discussion] question about gate within KIM In-Reply-To: References: <83E46363-DAA5-4E7E-96FD-32B8B633E102@ontotext.com> <25B94943-AFED-46DC-A827-0452C3506530@ontotext.com> <1EE46E0D-41AB-42FE-B077-654E683885E9@ontotext.com> <787EE2AB-D3BF-4AED-B748-31D39E0492DF@ontotext.com> Message-ID: Hi Bonnie, I played with what you sent me. Made some changes to the ontology: * made the root class of all classes to be protons:Entity ** * removed some duplicate statements * added labels to all the instances ** KIM and PROTON usually live together, and the result of this is that some parts of the interface won't work without PROTON. That is why I used it in my experiments. It is advisable for now to use it, although not absolutely necessary for the IE. The least requirement is that your top level classes be subclasses of protons:Entity . Using labels is essential for gazetteer lookups, because on their basis entities are recognized in texts. That is why all the entities should have at least one label. I have attach all the resources I have customized: Note that the visibility.nt is a separate mchanism and is not explicitly imported in the owlim.ttl file. KIM knows where to look for it and imports it when started for the first time. I hope this will clarify the picture a little more. Following your progress Philip On Nov 16, 2010, at 8:59 PM, VERMILLION, Bonnie wrote: > I got it working, but now no Entities display. > > See attached > > Thanks, Phillip ? getting there with your help! > Bonnie > > From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at ontotext.com] > Sent: Tuesday, November 16, 2010 1:46 PM > To: VERMILLION, Bonnie > Cc: borislav popov; Matthew Petrillo; WILSON, Greg; ENUGU, Reddy (Independent Contractor); KIM Server mailing-list > Subject: Re: [Kim-discussion] question about gate within KIM > > Hi Bonnie > > I guess my editor has put some strange character there. Just copy-paste it in a simple text editor (notepad) and save it. This should save only the readable characters. > > hth > Philip > > > On Nov 16, 2010, at 6:55 PM, VERMILLION, Bonnie wrote: > > > Hi Phillip, > I?m getting an error from the query file in red below: > > Can you let me know what to do to correct it? > > Thank you, > Bonnie > > 1:52:51 [INFO] 2371[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - Labels are loaded from aliases. > 11:52:51 [DEBUG] 2480[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - classes cache contains 321 items. here is the first: http://proton.semanticweb.org/2006/05/protonu#AirplaneModel > 11:52:51 [DEBUG] 2776[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - direct subs cache contains 321 items. here is the first: http://proton.semanticweb.org/2006/05/protonu#AirplaneModel=[] > 11:52:51 [DEBUG] 2776[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - all subs cache contains 321 items. here is the first: http://proton.semanticweb.org/2006/05/protonu#AirplaneModel=[http://proton.semanticweb.org/2006/05/protonu#AirplaneModel] > 11:52:51 [DEBUG] 2776[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - supers cache contains 321 items. here is the first: http://proton.semanticweb.org/2006/05/protonu#AirplaneModel=[http://proton.semanticweb.org/2006/05/protonu#AirplaneModel, http://www.w3.org/2000/01/rdf-schema#Resource, http://proton.semanticweb.org/2006/05/protont#ProductModel, http://proton.semanticweb.org/2006/05/protont#Object, http://proton.semanticweb.org/2006/05/protons#Entity] > 11:52:51 [INFO] 2792[ComponentStarter-Thread-2](KIM_SERVICE) - Waking Up GATE... > 11:52:51 [INFO] 3276[ComponentStarter-Thread-2](KIM_SERVICE) - GATE is AWAKE. > 11:52:51 [INFO] 3291[ComponentStarter-Thread-2](KIM_SERVICE) - Loading C:\KIM\kim-platform-3.0-RC4\context\default\resources\IE.gapp > 11:52:55 [INFO] 7176[ComponentStarter-Thread-2](gate.LargeKBGazetteer) - Replaced $relpath$ in gazetteer parameters with C:\KIM\kim-platform-3.0-RC4\context\default\resources/ > 11:52:55 [INFO] 7207[ComponentStarter-Thread-2](model.KimDictionaryFeederImpl) - Loading of trusted entities from Sesame > 11:52:55 [DEBUG] 7207[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - Executing evaluateQuery('select lbl, i, dc > from > {i} {lbl}, > {i} serql:directType {dc}, > {i} {} > ','null', listener) > 11:52:55 [DEBUG] 7207[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - org.openrdf.query.MalformedQueryException: Lexical error at line 1, column 8. Encountered: "\u00a0" (160), after : "" > 11:52:55 [DEBUG] 7238[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - org.openrdf.query.MalformedQueryException: Lexical error at line 1, column 8. Encountered: "\u00a0" (160), after : "" > 11:52:55 [INFO] 7238[ComponentStarter-Thread-2](model.KimDictionaryFeederImpl) - The loading of the Static Dictionary finished > 11:52:58 [INFO] 10046[ComponentStarter-Thread-2](KIM_SERVICE) - Get EntityAPI. > 11:52:58 [DEBUG] 10046[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - Executing evaluateQuery('select COUNTRY,ADJ from {COUNTRY} {ADJ}','SeRQL', listener) > 11:52:58 [INFO] 10077[ComponentStarter-Thread-2](ig.RelationExtractors) - Total external relations successfuly loaded : 0 out of 0 supplied. > 11:52:58 [INFO] 10108[ComponentStarter-Thread-2](KIM_SERVICE) - SemanticAnnotationAPI loaded on Tue Nov 16 11:52:58 EST 2010 > 11:52:58 [INFO] 10108[ComponentStarter-Thread-2](NERC) - GATE pipelines=1 > 11:52:58 [INFO] 10124[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - KIMDocument Feature Schema loaded from Configuration file. > 11:52:58 [INFO] 10140[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - KIMDocument Feature Schema loaded from Configuration file. > 11:52:58 [INFO] 10140[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - KIMDocument Feature Schema loaded from Configuration file. > 11:52:59 [INFO] 10342[ComponentStarter-Thread-2](KIM_SERVICE) - CORE Index Addon: class com.ontotext.kim.coredb.CachingCoreWrapper > 11:52:59 [INFO] 10358[ComponentStarter-Thread-2](KIM_SERVICE) - Loaded extension: com.ontotext.kim.coredb.management.RdfCoreAdminExt > 11:52:59 [INFO] 10374[ComponentStarter-Thread-2](KIM_SERVICE) - Loaded extension: com.ontotext.kim.util.FactoryImpl > 11:52:59 [INFO] 10374[ComponentStarter-Thread-2](KIM_SERVICE) - Loaded extension: com.ontotext.kim.util.console.ConsoleTasksExtension > 11:52:59 [INFO] 10389[ComponentStarter-Thread-2](KIM_SERVICE) - Loaded extension: com.ontotext.kim.gate.TeamwareAdapter > 11:52:59 [INFO] 10389[ComponentStarter-Thread-2](KIM_SERVICE) - Loaded extension: com.ontotext.kim.rss.KimRssDatabase > 11:52:59 [INFO] 10405[ComponentStarter-Thread-2](KIM_SERVICE) - KIM Server startup ended! > > From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at ontotext.com] > Sent: Tuesday, November 16, 2010 10:29 AM > To: VERMILLION, Bonnie > Cc: borislav popov; Matthew Petrillo; WILSON, Greg; ENUGU, Reddy (Independent Contractor) > Subject: Re: [Kim-discussion] question about gate within KIM > > Hi Bonnie, > > From the output of you have sent me, I conclude that you have not cleared the cache after changing the configuration. The cache lives in KIM/context/default/populated. Remove the entire directory clear it. > > Now if you want the gazetteer to entirely use your ontology instead of KIM's , you should have some things in mind. > > The gazetteer resource has a setup option FeedSetupPath, which is a path where it searches for a file named query.txt . In your case the path is KIM/config/ . This file contains a query in serql or sparql and is responsible for filling the dictionary of the gazetteer. The query should return exactly 3 characteristics of each entity you would like to put in the dictionary: > * the label of the entity > * the instance URI of the entity > * the direct class this entity is instance of > > If the gazetteer does not find such a file, it uses this query: > > select LA, I, DC from > ( > {TI} rdf:type {}, > {I} {TI}, > {I} rdf:type {}, > {I} serql:directType {DC}, > {I} {} rdfs:label {LA}; > [ {IG}] > ) UNION ( > {I} {}, > {I} serql:directType {DC}, > {I} {LA} > ) > WHERE > IG = NULL > AND isLiteral(LA) > AND DC != > AND NOT LA = "" > > > If you set the semantic repository logger level to DEBUG you could see this in the log. Just change in KIM/config/log.prop : > log4j.category.SEMANTIC_REPOSITORY = , aSEMANTIC_REPOSITORY > to > log4j.category.SEMANTIC_REPOSITORY = DEBUG, aSEMANTIC_REPOSITORY > > > You could create a file KIM/config/query.txt and provide a simpler query like: > > select lbl, i, dc > from > {i} {lbl}, > {i} serql:directType {dc}, > {i} {} > > Now the instances of Actor and its subclasses will be recognized in the text. > > Note: One thing that puzzled me when I looked at your screenshots, is that Role was a subclass of Actor. The relation here should be Actor hasRole Role I think. > > To be able to see your classes in KIM's web interface, you should actually mark them as visible. This happens by providing the triples like this to your RDF: > "" . > > you can see KIM's visibility configuration in KIM/context/default/kb/visibility.nt . > > > Please notify me of your progress, so that I can help further > Philip > > On Nov 16, 2010, at 3:07 PM, VERMILLION, Bonnie wrote: > > > > Thanks Phillip. > > At some point we may have lists such as specific Codes that have a list of values that would be suitable for a gazetteer list. > > For now what we want to do is turn off Proton (which I think I have done since there are references to Person, Organization or Location in the ontology shown in KIM. So, I?m not sure where the ontology that is now listed in KIM is coming from . But we need to turn it off so that when we load a sample ontology, it just shows the ontology we are loading. > > Please see the attached screen shots attached. > > Thank you, > Bonnie > > From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at ontotext.com] > Sent: Tuesday, November 16, 2010 3:26 AM > To: VERMILLION, Bonnie > Cc: borislav popov; Matthew Petrillo; WILSON, Greg; ENUGU, Reddy (Independent Contractor) > Subject: Re: [Kim-discussion] question about gate within KIM > > Hi Bonnie, > > I guess you would want to run only a gazetteer with your ontology, to observe which entities are recognized? Will this help you? > > Philip > > On Nov 16, 2010, at 5:05 AM, VERMILLION, Bonnie wrote: > > > > > Phillip, > > I was able to follow the document that you provided in order to load a sample ontology, but because Proton and Annie are still running, the results are not clear. How can I turn off Proton and Annie? > > Thank you, > Bonnie > > From: VERMILLION, Bonnie > Sent: Tuesday, November 09, 2010 11:08 AM > To: 'Philip Alexiev @ Ontotext' > Cc: borislav popov; Matthew Petrillo; WILSON, Greg; ENUGU, Reddy (Independent Contractor) > Subject: RE: [Kim-discussion] question about gate within KIM > > Thanks Phillip. Great explanation! > > For the ontology I am trying to load we have both classes and instances. Though we do have one ontology that only has classes. > > I?ll let you know the result after following your response. > > Thank you, > Bonnie > > From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at ontotext.com] > Sent: Tuesday, November 09, 2010 10:54 AM > To: VERMILLION, Bonnie > Cc: borislav popov; Matthew Petrillo; WILSON, Greg; ENUGU, Reddy (Independent Contractor) > Subject: Re: [Kim-discussion] question about gate within KIM > > Hi Bonnie, > > The act of extending the ontology alone, does not add value to your IE. It will only store those entities in the semantic repository. In order for those entities to be included in the LKB gazetteer dictionary, they have to meet 3 conditions: > are of a type that is a subclass of protons:Entity > have at least one alias > are marked as Trusted > That way the gazetteer will create Lookup annotations when he meets one of those in the text. Later you can transform them using Jape rules. > > Does your owl file contain instances or only classes? In the general case you need instances to be recognized in the texts. > > It is a good idea to map some of your classes to PROTON only if you find they are expressing the same concept. Otherwise just subclass your top classes to protons:Entity . > > ?Include the new files in the import section of owlim? > OWLIM's configuration resides in KIM/config/owlim.ttl . There is a owlim:imports section there. Add your custom files there. The path is relative to KIM/context/default/ . If you have already ran KIM, some cache will exist. In this case you will have to clear the cache in order for the changes to take effect. To do this, perform the following steps: > * stop KIM > * delete KIM/context/default/populated/ (NOTE:this will clear all the cache, including the documents in the document repository). > * start KIM > > All the best, > Philip > > On Nov 9, 2010, at 5:22 PM, VERMILLION, Bonnie wrote: > > > Thanks Phillip. > > We have several ontologies that we created in Prot?g?. So we have the .owl files. > > I?m following the documentation that you pointed me to ? > Create a sub-folder in the KIM context folder. It will be used as storage for all the RDF data for this task. > For example, create $KIM_HOME/context/default/kb/dbpedia/. > We recommend this location but you can put your RDF data anywhere in the KIM context folder. > Put dbpedia_3.5.1.owl , containing the DBpedia taxonomy, in $KIM_HOME/context/default/kb/dbpedia/ > Put dbpedia_instances.nt , containing the actual objects description, in $KIM_HOME/context/default/kb/dbpedia/ > Include the new files in the import section of owlim ( $KIM_HOME/config/owlim.ttl ): > I created a subfolder und the kb directory and copied an .owl file created in Prot?g?. > I?m not sure how to create the .nt file, and the ontology that I?m using does not have Person, Organization or Place domains ? so there is nothing to align with Proton. > I?m also not sure what is meant by ? ?Include the new files in the import section of owlim? > Thanks for your expertise! > Bonnie > > > From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at ontotext.com] > Sent: Tuesday, November 09, 2010 9:37 AM > To: VERMILLION, Bonnie > Cc: borislav popov; Matthew Petrillo; WILSON, Greg; ENUGU, Reddy (Independent Contractor) > Subject: Re: [Kim-discussion] question about gate within KIM > > Hi Bonnie, > > Gate embedded in KIM functions the same way. A difference is that not all the plugins available in GATE developer are directly available in KIM too. You can check the KIM/plugins/ folder. Generally if you import the Ontology plugin you should be able to use the Ontology language resources as you intend to. > > I am sure that if you provide some more information about what you want to achieve, we will be able to provide more meaningful support. A simple usecase will help a lot. > > All the best, > Philip > > On Nov 9, 2010, at 4:03 PM, VERMILLION, Bonnie wrote: > > > > > > > Thanks, Borislov. I will try following the document Phillip mentioned. I guess I was thinking that Gate within KIM would function as it does independently ? that is to use Prot?g? to create an ontology and then load the ontology by indicating a CREOLE ?ontology? plug-in and then a Sesame or OWLIM ontology language resource can be used to load the ontology created from Prot?g?. Sorry for the poor explanation. > > I?ll report back! > > Thank you, > Bonnie > > From: borislav popov [mailto:borislav.popov at ontotext.com] > Sent: Tuesday, November 09, 2010 8:40 AM > To: VERMILLION, Bonnie > Cc: Matthew Petrillo; WILSON, Greg; ENUGU, Reddy (Independent Contractor); philip > Subject: Re: [Kim-discussion] question about gate within KIM > > Hi Bonnie, > i will keep philip posted as well on this one. > the page philip sent explains how to do this loading & mapping of the new ontology to the default one in KIM (PROTON). This is not exactly a user friendly task - as it is more for administrators of the kim server. > Generally this is a task you do initially and the demonstration UIs are not targeted to these people, but the end users. > In GATE you can play with loading the ontology if this is helpful to get a better feeling of the data. > Regarding: the last sentence of loading the ontology and not the rdf triples - i did not really get it - as ontologies are usually expressed in triples. if you want to avoid loading the instance data - it is handy if they come in separate files. > > philip please add if i missed something > b > > > On Nov 9, 2010, at 3:03 PM, VERMILLION, Bonnie wrote: > > > > > > > > Borislav, > > Thank you for your response! > > After looking at the documentation that Philip referred to, I agree that it is not necessary what I am looking for. > > What I?m trying to do is to import (if this is possible) an ontology similar to loading an ontology from Prot?g? in to Gate based on the fact that I have select an ontology processing resource that was loaded as a CREOLE plug-in. However, in KIM, there is no such plug-in within the inherent GATE tool. Can I add this CREOLE plug-in to Gate within KIM? Or is there another way to accomplish loading the ontology without having to load the RDF triples as well. > > Thank you in advance for your assistance! > Bonnie Vermillion > > Yvonne Vermillion > > > > 2000 Corporate Ridge > McLean, VA 22102-7805 > (571)633-7830 P > > > > > > > > Complex Problems. Practical Solutions. > www.lmi.org > > > > From: borislav popov [mailto:borislav.popov at ontotext.com] > Sent: Tuesday, November 09, 2010 4:02 AM > To: VERMILLION, Bonnie > Cc: kim-discussion; philip > Subject: Re: [Kim-discussion] question about gate within KIM > > Hi Bonnie, > actually your request and philip's answer point in different directions. The ontology plugin in GATE provides partial coverage of what is available in Sesame 2 and/or OWLIM 3 as semantic repository APIs. > It is not used in KIM - there you have the direct integration with Sesame-compatible repository, incl. our OWLIM. For client application of KIM - there is also a higher level API accessible on the same level as our search or doc-related functionality. > In a KIM context the extension of the default ontology is explained in the documentation piece provided by philip. > There are certain things to take into account to ensure the mapping to the default ontology is right and the modeling paradigms of your ontology are compatible with the extraction pipeline - to bootstrap automatic recognition of new entities, given the ontology comes with entity descriptions / knowledge base as well. > you can tell us more about your experiments - so that we can suggest the route more accurately. If you consider it confidential - you may also avoid the discussion list, which is public and write directly to us as we have NDA already. > all the best > borislav > > > On Nov 9, 2010, at 10:27 AM, Philip Alexiev @ Ontotext wrote: > > > > > > > > > Hi Yvonne, > > In order to use a new ontology it is good to map it to your top ontology classes. > > http://ontotext.com/kim/doc/KimDocs-3.0-EN/ExtendInformationExtraction.html > > This is a good guide showing how you can do this. > > tht > Philip Alexiev > Software Engineer, KIM team > > > > > On Nov 8, 2010, at 10:28 PM, VERMILLION, Bonnie wrote: > > > > > > > > > Is there a way to add a ontology CREOLE plug-in within KIM so that an external ontology can be loaded? > > Thank you, > Bonnie Vermillion > > Yvonne Vermillion > > > > 2000 Corporate Ridge > McLean, VA 22102-7805 > (571)633-7830 P > > > > > > > > > Complex Problems. Practical Solutions. > www.lmi.org > > > > _______________________________________________ > Kim-discussion mailing list > Kim-discussion at ontotext.com > http://ontotext.com/mailman/listinfo/kim-discussion > > _______________________________________________ > Kim-discussion mailing list > Kim-discussion at ontotext.com > http://ontotext.com/mailman/listinfo/kim-discussion > > > > > > > > > _______________________________________________ > Kim-discussion mailing list > Kim-discussion at ontotext.com > http://ontotext.com/mailman/listinfo/kim-discussion -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: owlim.ttl Type: application/octet-stream Size: 2216 bytes Desc: not available URL: -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- An embedded and charset-unspecified text was scrubbed... Name: query.txt URL: -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: dispreg.owl Type: application/octet-stream Size: 7797 bytes Desc: not available URL: -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: visibility.nt Type: application/octet-stream Size: 968 bytes Desc: not available URL: -------------- next part -------------- An HTML attachment was scrubbed... URL: From YVERMILLION at lmi.org Wed Nov 17 11:23:49 2010 From: YVERMILLION at lmi.org (VERMILLION, Bonnie) Date: Wed, 17 Nov 2010 11:23:49 -0500 Subject: [Kim-discussion] question about gate within KIM In-Reply-To: References: <83E46363-DAA5-4E7E-96FD-32B8B633E102@ontotext.com> <25B94943-AFED-46DC-A827-0452C3506530@ontotext.com> <1EE46E0D-41AB-42FE-B077-654E683885E9@ontotext.com> <787EE2AB-D3BF-4AED-B748-31D39E0492DF@ontotext.com> Message-ID: Thanks Phillip! I'll look at everything and get back to you. Bonnie From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at ontotext.com] Sent: Wednesday, November 17, 2010 10:38 AM To: VERMILLION, Bonnie Cc: ENUGU, Reddy (Independent Contractor); Matthew Petrillo; WILSON, Greg; KIM Server mailing-list Subject: Re: [Kim-discussion] question about gate within KIM Hi Bonnie, I played with what you sent me. Made some changes to the ontology: * made the root class of all classes to be protons:Entity ** * removed some duplicate statements * added labels to all the instances ** KIM and PROTON usually live together, and the result of this is that some parts of the interface won't work without PROTON. That is why I used it in my experiments. It is advisable for now to use it, although not absolutely necessary for the IE. The least requirement is that your top level classes be subclasses of protons:Entity . Using labels is essential for gazetteer lookups, because on their basis entities are recognized in texts. That is why all the entities should have at least one label. I have attach all the resources I have customized: -------------- next part -------------- An HTML attachment was scrubbed... URL: From YVERMILLION at lmi.org Wed Nov 17 11:42:08 2010 From: YVERMILLION at lmi.org (VERMILLION, Bonnie) Date: Wed, 17 Nov 2010 11:42:08 -0500 Subject: [Kim-discussion] question about gate within KIM In-Reply-To: References: <83E46363-DAA5-4E7E-96FD-32B8B633E102@ontotext.com> <25B94943-AFED-46DC-A827-0452C3506530@ontotext.com> <1EE46E0D-41AB-42FE-B077-654E683885E9@ontotext.com> <787EE2AB-D3BF-4AED-B748-31D39E0492DF@ontotext.com> Message-ID: Hi Phillip, I was able to run what you sent, but nothing from the ontology is showing up when running KIM. I'm sure it is because no aliases loaded - but you can let me know what needs be done from here. Please see attached word doc. Thank you, Bonnie From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at ontotext.com] Sent: Wednesday, November 17, 2010 10:38 AM To: VERMILLION, Bonnie Cc: ENUGU, Reddy (Independent Contractor); Matthew Petrillo; WILSON, Greg; KIM Server mailing-list Subject: Re: [Kim-discussion] question about gate within KIM Hi Bonnie, I played with what you sent me. Made some changes to the ontology: * made the root class of all classes to be protons:Entity ** * removed some duplicate statements * added labels to all the instances ** KIM and PROTON usually live together, and the result of this is that some parts of the interface won't work without PROTON. That is why I used it in my experiments. It is advisable for now to use it, although not absolutely necessary for the IE. The least requirement is that your top level classes be subclasses of protons:Entity . Using labels is essential for gazetteer lookups, because on their basis entities are recognized in texts. That is why all the entities should have at least one label. I have attach all the resources I have customized: -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: KimTest111710.docx Type: application/vnd.openxmlformats-officedocument.wordprocessingml.document Size: 600478 bytes Desc: KimTest111710.docx URL: From YVERMILLION at lmi.org Wed Nov 17 14:03:01 2010 From: YVERMILLION at lmi.org (VERMILLION, Bonnie) Date: Wed, 17 Nov 2010 14:03:01 -0500 Subject: [Kim-discussion] question about gate within KIM In-Reply-To: References: <83E46363-DAA5-4E7E-96FD-32B8B633E102@ontotext.com> <25B94943-AFED-46DC-A827-0452C3506530@ontotext.com> <1EE46E0D-41AB-42FE-B077-654E683885E9@ontotext.com> <787EE2AB-D3BF-4AED-B748-31D39E0492DF@ontotext.com> Message-ID: Hi Phillip, Just wanted to touch base again because we need to get this working today. Something is still not connected for us to be able to see the entities on the Facet Tab and the Ontology Tab . All we are seeing is the Word Entity. Thank you very much! I appreciate your assistance! Bonnie Yvonne Vermillion [cid:image001.jpg at 01CB8660.25AF9F00] 2000 Corporate Ridge McLean, VA 22102-7805 (571)633-7830 P Complex Problems. Practical Solutions. www.lmi.org From: kim-discussion-bounces at ontotext.com [mailto:kim-discussion-bounces at ontotext.com] On Behalf Of VERMILLION, Bonnie Sent: Wednesday, November 17, 2010 11:42 AM To: Philip Alexiev @ Ontotext Cc: Matthew Petrillo; ENUGU, Reddy (Independent Contractor); KIM at kim.virtual.vps-host.net; WILSON, Greg; mailing-list Subject: Re: [Kim-discussion] question about gate within KIM Hi Phillip, I was able to run what you sent, but nothing from the ontology is showing up when running KIM. I'm sure it is because no aliases loaded - but you can let me know what needs be done from here. Please see attached word doc. Thank you, Bonnie From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at ontotext.com] Sent: Wednesday, November 17, 2010 10:38 AM To: VERMILLION, Bonnie Cc: ENUGU, Reddy (Independent Contractor); Matthew Petrillo; WILSON, Greg; KIM Server mailing-list Subject: Re: [Kim-discussion] question about gate within KIM Hi Bonnie, I played with what you sent me. Made some changes to the ontology: * made the root class of all classes to be protons:Entity ** * removed some duplicate statements * added labels to all the instances ** KIM and PROTON usually live together, and the result of this is that some parts of the interface won't work without PROTON. That is why I used it in my experiments. It is advisable for now to use it, although not absolutely necessary for the IE. The least requirement is that your top level classes be subclasses of protons:Entity . Using labels is essential for gazetteer lookups, because on their basis entities are recognized in texts. That is why all the entities should have at least one label. I have attach all the resources I have customized: -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.jpg Type: image/jpeg Size: 899 bytes Desc: image001.jpg URL: From YVERMILLION at lmi.org Thu Nov 18 07:42:35 2010 From: YVERMILLION at lmi.org (VERMILLION, Bonnie) Date: Thu, 18 Nov 2010 07:42:35 -0500 Subject: [Kim-discussion] question about gate within KIM In-Reply-To: <6CFCA219-E490-4CB4-B8E2-2996DCE35852@ontotext.com> References: <83E46363-DAA5-4E7E-96FD-32B8B633E102@ontotext.com> <25B94943-AFED-46DC-A827-0452C3506530@ontotext.com> <1EE46E0D-41AB-42FE-B077-654E683885E9@ontotext.com> <787EE2AB-D3BF-4AED-B748-31D39E0492DF@ontotext.com> <6CFCA219-E490-4CB4-B8E2-2996DCE35852@ontotext.com> Message-ID: Thanks for the response Phillip! Something is still not quite right. I did use all the files you sent. I also added another reference to another ontology where I did define labels and relationships and have tried with each one with the same result. While Kim loads, there is an error with the visibility.nt file - here is the information from the log file - se below highlighted in yellow. What I am going to try next is to re-install KIM and then replace your files again and see what happens. Let me know if you have any other suggestions. Thank you, Bonnie Yvonne Vermillion [cid:image001.jpg at 01CB86F4.25211B60] 2000 Corporate Ridge McLean, VA 22102-7805 (571)633-7830 P Complex Problems. Practical Solutions. www.lmi.org 15:10:42 [INFO] 2802[ComponentStarter-Thread-2](KIM_SERVICE) - Waking Up GATE... 15:10:43 [INFO] 3310[ComponentStarter-Thread-2](KIM_SERVICE) - GATE is AWAKE. 15:10:43 [INFO] 3317[ComponentStarter-Thread-2](KIM_SERVICE) - Loading C:\KIM\kim-platform-3.0-RC4\context\default\resources\IE.gapp 15:10:47 [INFO] 7389[ComponentStarter-Thread-2](gate.LargeKBGazetteer) - Replaced $relpath$ in gazetteer parameters with C:\KIM\kim-platform-3.0-RC4\context\default\resources/ 15:10:47 [INFO] 7411[ComponentStarter-Thread-2](model.KimDictionaryFeederImpl) - Loading of trusted entities from Sesame 15:10:47 [DEBUG] 7414[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - Executing evaluateQuery('select distinct lbl, i, dc from {i} rdf:type {}, {i} serql:directType {dc}, {i} {lbl} ','null', listener) 15:10:47 [INFO] 7425[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - Loaded 0 aliases in 0 second(s). 15:10:47 [INFO] 7425[ComponentStarter-Thread-2](model.KimDictionaryFeederImpl) - The loading of the Static Dictionary finished 15:10:50 [INFO] 10351[ComponentStarter-Thread-2](KIM_SERVICE) - Get EntityAPI. 15:10:50 [DEBUG] 10355[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - Executing evaluateQuery('select COUNTRY,ADJ from {COUNTRY} {ADJ}','SeRQL', listener) 15:10:50 [INFO] 10385[ComponentStarter-Thread-2](ig.RelationExtractors) - Total external relations successfuly loaded : 0 out of 0 supplied. 15:10:50 [INFO] 10411[ComponentStarter-Thread-2](KIM_SERVICE) - SemanticAnnotationAPI loaded on Wed Nov 17 15:10:50 EST 2010 15:10:50 [INFO] 10411[ComponentStarter-Thread-2](NERC) - GATE pipelines=1 15:10:50 [INFO] 10425[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - KIMDocument Feature Schema loaded from Configuration file. 15:10:50 [INFO] 10447[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - KIMDocument Feature Schema loaded from Configuration file. 15:10:50 [INFO] 10448[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - KIMDocument Feature Schema loaded from Configuration file. 15:10:50 [INFO] 10655[ComponentStarter-Thread-2](KIM_SERVICE) - CORE Index Addon: class com.ontotext.kim.coredb.CachingCoreWrapper 15:10:50 [INFO] 10680[ComponentStarter-Thread-2](KIM_SERVICE) - Loaded extension: com.ontotext.kim.coredb.management.RdfCoreAdminExt 15:10:50 [INFO] 10682[ComponentStarter-Thread-2](KIM_SERVICE) - Loaded extension: com.ontotext.kim.util.FactoryImpl 15:10:50 [INFO] 10690[ComponentStarter-Thread-2](KIM_SERVICE) - Loaded extension: com.ontotext.kim.util.console.ConsoleTasksExtension 15:10:50 [INFO] 10699[ComponentStarter-Thread-2](KIM_SERVICE) - Loaded extension: com.ontotext.kim.gate.TeamwareAdapter 15:10:50 [INFO] 10707[ComponentStarter-Thread-2](KIM_SERVICE) - Loaded extension: com.ontotext.kim.rss.KimRssDatabase 15:10:50 [INFO] 10719[ComponentStarter-Thread-2](KIM_SERVICE) - KIM Server startup ended! 15:12:55 [INFO] 136140[RMI TCP Connection(4)-172.18.8.71](KIM_SERVICE) - Get SemanticAnnotationAPI. 15:13:25 [DEBUG] 166065[RMI TCP Connection(4)-172.18.8.71](SEMANTIC_REPOSITORY) - Committed 1 statements. 15:13:25 [DEBUG] 166066[RMI TCP Connection(4)-172.18.8.71](SEMANTIC_REPOSITORY) - Statements after visibility cleanup: 0 15:13:25 [WARN] 166087[RMI TCP Connection(4)-172.18.8.71](SEMANTIC_REPOSITORY) - Could not reload visibility due to a repository error. com.ontotext.kim.client.semanticrepository.SemanticRepositoryException: importData() Failed! at com.ontotext.kim.semanticrepository.SemanticRepositoryAPIImpl.importData(SemanticRepositoryAPIImpl.java:109) at com.ontotext.kim.semanticrepository.SemanticRepositoryBase.importData(SemanticRepositoryBase.java:65) at com.ontotext.kim.ontology.OntologyImpl.reloadVisibility(OntologyImpl.java:169) at com.ontotext.kim.ontology.OntologyImpl.initOntology(OntologyImpl.java:77) at com.ontotext.kim.ontology.OntologyImpl.getOntology(OntologyImpl.java:71) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at gmail.com] Sent: Thursday, November 18, 2010 4:59 AM To: VERMILLION, Bonnie Cc: Matthew Petrillo; ENUGU, Reddy (Independent Contractor); KIM at kim.virtual.vps-host.net; WILSON, Greg; mailing-list Subject: Re: [Kim-discussion] question about gate within KIM Hi Bonnie, If you don't see anything but Entity, this is because your classes do not subclass Entity. This is a requirement for now for the UI. Also from the log I see no aliases are loaded by the gazetteer. Are you using the modified ontology I sent? Philip On Nov 17, 2010, at 9:03 PM, VERMILLION, Bonnie wrote: Hi Phillip, Just wanted to touch base again because we need to get this working today. Something is still not connected for us to be able to see the entities on the Facet Tab and the Ontology Tab . All we are seeing is the Word Entity. Thank you very much! I appreciate your assistance! Bonnie Yvonne Vermillion 2000 Corporate Ridge McLean, VA 22102-7805 (571)633-7830 P Complex Problems. Practical Solutions. www.lmi.org From: kim-discussion-bounces at ontotext.com [mailto:kim-discussion-bounces at ontotext.com] On Behalf Of VERMILLION, Bonnie Sent: Wednesday, November 17, 2010 11:42 AM To: Philip Alexiev @ Ontotext Cc: Matthew Petrillo; ENUGU, Reddy (Independent Contractor); KIM at kim.virtual.vps-host.net; WILSON, Greg; mailing-list Subject: Re: [Kim-discussion] question about gate within KIM Hi Phillip, I was able to run what you sent, but nothing from the ontology is showing up when running KIM. I'm sure it is because no aliases loaded - but you can let me know what needs be done from here. Please see attached word doc. Thank you, Bonnie From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at ontotext.com] Sent: Wednesday, November 17, 2010 10:38 AM To: VERMILLION, Bonnie Cc: ENUGU, Reddy (Independent Contractor); Matthew Petrillo; WILSON, Greg; KIM Server mailing-list Subject: Re: [Kim-discussion] question about gate within KIM Hi Bonnie, I played with what you sent me. Made some changes to the ontology: * made the root class of all classes to be protons:Entity ** * removed some duplicate statements * added labels to all the instances ** KIM and PROTON usually live together, and the result of this is that some parts of the interface won't work without PROTON. That is why I used it in my experiments. It is advisable for now to use it, although not absolutely necessary for the IE. The least requirement is that your top level classes be subclasses of protons:Entity . Using labels is essential for gazetteer lookups, because on their basis entities are recognized in texts. That is why all the entities should have at least one label. I have attach all the resources I have customized: -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.jpg Type: image/jpeg Size: 899 bytes Desc: image001.jpg URL: From YVERMILLION at lmi.org Thu Nov 18 07:44:36 2010 From: YVERMILLION at lmi.org (VERMILLION, Bonnie) Date: Thu, 18 Nov 2010 07:44:36 -0500 Subject: [Kim-discussion] question about gate within KIM References: <83E46363-DAA5-4E7E-96FD-32B8B633E102@ontotext.com> <25B94943-AFED-46DC-A827-0452C3506530@ontotext.com> <1EE46E0D-41AB-42FE-B077-654E683885E9@ontotext.com> <787EE2AB-D3BF-4AED-B748-31D39E0492DF@ontotext.com> <6CFCA219-E490-4CB4-B8E2-2996DCE35852@ontotext.com> Message-ID: Thanks for the response Phillip! Something is still not quite right. I did use all the files you sent. I also added another reference to another ontology where I did define labels and relationships and have tried with each one with the same result. While Kim loads, there is an error with the visibility.nt file - here is the information from the log file - se below highlighted in yellow. What I am going to try next is to re-install KIM and then replace your files again and see what happens. Let me know if you have any other suggestions. Thank you, Bonnie Yvonne Vermillion [cid:image001.jpg at 01CB86F4.7263DAC0] 2000 Corporate Ridge McLean, VA 22102-7805 (571)633-7830 P Complex Problems. Practical Solutions. www.lmi.org 15:10:42 [INFO] 2802[ComponentStarter-Thread-2](KIM_SERVICE) - Waking Up GATE... 15:10:43 [INFO] 3310[ComponentStarter-Thread-2](KIM_SERVICE) - GATE is AWAKE. 15:10:43 [INFO] 3317[ComponentStarter-Thread-2](KIM_SERVICE) - Loading C:\KIM\kim-platform-3.0-RC4\context\default\resources\IE.gapp 15:10:47 [INFO] 7389[ComponentStarter-Thread-2](gate.LargeKBGazetteer) - Replaced $relpath$ in gazetteer parameters with C:\KIM\kim-platform-3.0-RC4\context\default\resources/ 15:10:47 [INFO] 7411[ComponentStarter-Thread-2](model.KimDictionaryFeederImpl) - Loading of trusted entities from Sesame 15:10:47 [DEBUG] 7414[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - Executing evaluateQuery('select distinct lbl, i, dc from {i} rdf:type {}, {i} serql:directType {dc}, {i} {lbl} ','null', listener) 15:10:47 [INFO] 7425[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - Loaded 0 aliases in 0 second(s). 15:10:47 [INFO] 7425[ComponentStarter-Thread-2](model.KimDictionaryFeederImpl) - The loading of the Static Dictionary finished 15:10:50 [INFO] 10351[ComponentStarter-Thread-2](KIM_SERVICE) - Get EntityAPI. 15:10:50 [DEBUG] 10355[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - Executing evaluateQuery('select COUNTRY,ADJ from {COUNTRY} {ADJ}','SeRQL', listener) 15:10:50 [INFO] 10385[ComponentStarter-Thread-2](ig.RelationExtractors) - Total external relations successfuly loaded : 0 out of 0 supplied. 15:10:50 [INFO] 10411[ComponentStarter-Thread-2](KIM_SERVICE) - SemanticAnnotationAPI loaded on Wed Nov 17 15:10:50 EST 2010 15:10:50 [INFO] 10411[ComponentStarter-Thread-2](NERC) - GATE pipelines=1 15:10:50 [INFO] 10425[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - KIMDocument Feature Schema loaded from Configuration file. 15:10:50 [INFO] 10447[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - KIMDocument Feature Schema loaded from Configuration file. 15:10:50 [INFO] 10448[ComponentStarter-Thread-2](SEMANTIC_REPOSITORY) - KIMDocument Feature Schema loaded from Configuration file. 15:10:50 [INFO] 10655[ComponentStarter-Thread-2](KIM_SERVICE) - CORE Index Addon: class com.ontotext.kim.coredb.CachingCoreWrapper 15:10:50 [INFO] 10680[ComponentStarter-Thread-2](KIM_SERVICE) - Loaded extension: com.ontotext.kim.coredb.management.RdfCoreAdminExt 15:10:50 [INFO] 10682[ComponentStarter-Thread-2](KIM_SERVICE) - Loaded extension: com.ontotext.kim.util.FactoryImpl 15:10:50 [INFO] 10690[ComponentStarter-Thread-2](KIM_SERVICE) - Loaded extension: com.ontotext.kim.util.console.ConsoleTasksExtension 15:10:50 [INFO] 10699[ComponentStarter-Thread-2](KIM_SERVICE) - Loaded extension: com.ontotext.kim.gate.TeamwareAdapter 15:10:50 [INFO] 10707[ComponentStarter-Thread-2](KIM_SERVICE) - Loaded extension: com.ontotext.kim.rss.KimRssDatabase 15:10:50 [INFO] 10719[ComponentStarter-Thread-2](KIM_SERVICE) - KIM Server startup ended! 15:12:55 [INFO] 136140[RMI TCP Connection(4)-172.18.8.71](KIM_SERVICE) - Get SemanticAnnotationAPI. 15:13:25 [DEBUG] 166065[RMI TCP Connection(4)-172.18.8.71](SEMANTIC_REPOSITORY) - Committed 1 statements. 15:13:25 [DEBUG] 166066[RMI TCP Connection(4)-172.18.8.71](SEMANTIC_REPOSITORY) - Statements after visibility cleanup: 0 15:13:25 [WARN] 166087[RMI TCP Connection(4)-172.18.8.71](SEMANTIC_REPOSITORY) - Could not reload visibility due to a repository error. com.ontotext.kim.client.semanticrepository.SemanticRepositoryException: importData() Failed! at com.ontotext.kim.semanticrepository.SemanticRepositoryAPIImpl.importData(SemanticRepositoryAPIImpl.java:109) at com.ontotext.kim.semanticrepository.SemanticRepositoryBase.importData(SemanticRepositoryBase.java:65) at com.ontotext.kim.ontology.OntologyImpl.reloadVisibility(OntologyImpl.java:169) at com.ontotext.kim.ontology.OntologyImpl.initOntology(OntologyImpl.java:77) at com.ontotext.kim.ontology.OntologyImpl.getOntology(OntologyImpl.java:71) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at gmail.com] Sent: Thursday, November 18, 2010 4:59 AM To: VERMILLION, Bonnie Cc: Matthew Petrillo; ENUGU, Reddy (Independent Contractor); KIM at kim.virtual.vps-host.net; WILSON, Greg; mailing-list Subject: Re: [Kim-discussion] question about gate within KIM Hi Bonnie, If you don't see anything but Entity, this is because your classes do not subclass Entity. This is a requirement for now for the UI. Also from the log I see no aliases are loaded by the gazetteer. Are you using the modified ontology I sent? Philip On Nov 17, 2010, at 9:03 PM, VERMILLION, Bonnie wrote: Hi Phillip, Just wanted to touch base again because we need to get this working today. Something is still not connected for us to be able to see the entities on the Facet Tab and the Ontology Tab . All we are seeing is the Word Entity. Thank you very much! I appreciate your assistance! Bonnie Yvonne Vermillion 2000 Corporate Ridge McLean, VA 22102-7805 (571)633-7830 P Complex Problems. Practical Solutions. www.lmi.org From: kim-discussion-bounces at ontotext.com [mailto:kim-discussion-bounces at ontotext.com] On Behalf Of VERMILLION, Bonnie Sent: Wednesday, November 17, 2010 11:42 AM To: Philip Alexiev @ Ontotext Cc: Matthew Petrillo; ENUGU, Reddy (Independent Contractor); KIM at kim.virtual.vps-host.net; WILSON, Greg; mailing-list Subject: Re: [Kim-discussion] question about gate within KIM Hi Phillip, I was able to run what you sent, but nothing from the ontology is showing up when running KIM. I'm sure it is because no aliases loaded - but you can let me know what needs be done from here. Please see attached word doc. Thank you, Bonnie From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at ontotext.com] Sent: Wednesday, November 17, 2010 10:38 AM To: VERMILLION, Bonnie Cc: ENUGU, Reddy (Independent Contractor); Matthew Petrillo; WILSON, Greg; KIM Server mailing-list Subject: Re: [Kim-discussion] question about gate within KIM Hi Bonnie, I played with what you sent me. Made some changes to the ontology: * made the root class of all classes to be protons:Entity ** * removed some duplicate statements * added labels to all the instances ** KIM and PROTON usually live together, and the result of this is that some parts of the interface won't work without PROTON. That is why I used it in my experiments. It is advisable for now to use it, although not absolutely necessary for the IE. The least requirement is that your top level classes be subclasses of protons:Entity . Using labels is essential for gazetteer lookups, because on their basis entities are recognized in texts. That is why all the entities should have at least one label. I have attach all the resources I have customized: -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.jpg Type: image/jpeg Size: 899 bytes Desc: image001.jpg URL: From YVERMILLION at lmi.org Thu Nov 18 08:29:10 2010 From: YVERMILLION at lmi.org (VERMILLION, Bonnie) Date: Thu, 18 Nov 2010 08:29:10 -0500 Subject: [Kim-discussion] question about gate within KIM In-Reply-To: <2D4BA463-E9DA-4C21-BD59-46488E3B44D6@gmail.com> References: <83E46363-DAA5-4E7E-96FD-32B8B633E102@ontotext.com> <25B94943-AFED-46DC-A827-0452C3506530@ontotext.com> <1EE46E0D-41AB-42FE-B077-654E683885E9@ontotext.com> <787EE2AB-D3BF-4AED-B748-31D39E0492DF@ontotext.com> <6CFCA219-E490-4CB4-B8E2-2996DCE35852@ontotext.com> <2D4BA463-E9DA-4C21-BD59-46488E3B44D6@gmail.com> Message-ID: Thanks Phillip, I'll try this and report back! Bonnie From: Philip Alexiev [mailto:philip.alexiev at gmail.com] Sent: Thursday, November 18, 2010 8:11 AM To: VERMILLION, Bonnie Cc: ENUGU, Reddy (Independent Contractor); Matthew Petrillo; mailing-list; WILSON, Greg Subject: Re: [Kim-discussion] question about gate within KIM Just one more correction. The UI also expects that the entities have a main label (protons:mainLabel). I have modified the ontology. So with a fresh KIM and this files I send you now, you should be able to run everything. -------------- next part -------------- An HTML attachment was scrubbed... URL: From YVERMILLION at lmi.org Thu Nov 18 08:51:04 2010 From: YVERMILLION at lmi.org (VERMILLION, Bonnie) Date: Thu, 18 Nov 2010 08:51:04 -0500 Subject: [Kim-discussion] question about gate within KIM In-Reply-To: <2D4BA463-E9DA-4C21-BD59-46488E3B44D6@gmail.com> References: <83E46363-DAA5-4E7E-96FD-32B8B633E102@ontotext.com> <25B94943-AFED-46DC-A827-0452C3506530@ontotext.com> <1EE46E0D-41AB-42FE-B077-654E683885E9@ontotext.com> <787EE2AB-D3BF-4AED-B748-31D39E0492DF@ontotext.com> <6CFCA219-E490-4CB4-B8E2-2996DCE35852@ontotext.com> <2D4BA463-E9DA-4C21-BD59-46488E3B44D6@gmail.com> Message-ID: Philip, I'm now getting another error: - please advise! Thank you, Bonnie 08:47:56 [INFO] 0[main](KIM_SERVICE) - : : : : : : : : KIM SERVER START : : : : : : : : 08:47:56 [INFO] 109[main](KIM_SERVICE) - KIMService registered on port 1099 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - OwlimSchemaRepository: 3.3 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Build date: 06-22-2010 11:57 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Configured parameter 'imports' to 'kb/owl/owl.rdfs; kb/owl/protons.owl; kb/owl/protont.owl; kb/owl/protonu.owl; kb/dispreg.owl;' 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Configured parameter 'defaultNS' to 'http://www.w3.org/2002/07/owl#; http://proton.semanticweb.org/2006/05/protons#; http://proton.semanticweb.org/2006/05/protont#; http://proton.semanticweb.org/2006/05/protonu#; http://www.semanticweb.org/ontologies/2010/10/15/dispreg.owl#;' 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Configured parameter 'base-URL' to 'http://www.ontotext.com/kim/2006/05/wkb#' 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Configured parameter 'ruleset' to 'kb/KIMRules.pie' 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Configured parameter 'ftsLiteralsOnly' to 'true' 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Configured parameter 'console-thread' to 'false' 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Configured parameter 'useShutdownHooks' to 'false' 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Configured parameter 'entity-index-size' to '400000' 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Configured parameter 'ftsIndexPolicy' to 'onStartup' 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Tokenization regular expression: [\p{L}\d_]+ 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Repository fragments: 1 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Inferencer threads: 1 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - ftsPolicy = on-startup 08:47:56 [INFO] 171[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - fts: indexing literals only 08:47:56 [INFO] 171[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Configured parameter 'tuple-index-memory' to '100M' 08:47:56 [INFO] 171[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Configured parameter 'fts-memory' to '80M' 08:47:56 [INFO] 171[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Cache pages for tuples: 5241 08:47:56 [INFO] 171[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Cache pages for predicates: 0 08:47:56 [INFO] 171[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Cache pages for FTS: 4193 08:47:56 [INFO] 171[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Configured parameter 'storage-folder' to 'populated' 08:48:00 [ERROR] 4134[ComponentStarter-Thread-2](KIM_SERVICE) - Server Starter thread failed! java.rmi.RemoteException: Error creating repository; nested exception is: java.lang.IllegalArgumentException: Not a valid (absolute) URI: at com.ontotext.kim.semanticrepository.UnmanagedRepositoryFactory.reconnect(UnmanagedRepositoryFactory.java:44) at com.ontotext.kim.KIMServiceImpl.getSemanticRepositoryAPI(KIMServiceImpl.java:228) at com.ontotext.kim.KIMServiceImpl.getSemanticRepositoryAPI(KIMServiceImpl.java:198) at com.ontotext.kim.KIMServiceImpl$ServerComponentStarter.run(KIMServiceImpl.java:82) Caused by: java.lang.IllegalArgumentException: Not a valid (absolute) URI: at org.openrdf.model.impl.URIImpl.setURIString(URIImpl.java:68) at org.openrdf.model.impl.URIImpl.(URIImpl.java:57) at com.ontotext.trree.HashEntityPool.toObject(HashEntityPool.java:819) at com.ontotext.trree.HashEntityPool.buildFullTextSearchIndex(HashEntityPool.java:1154) at com.ontotext.trree.HashEntityPool.buildFullTextIndex(HashEntityPool.java:154) at com.ontotext.trree.HashEntityPool.(HashEntityPool.java:143) at com.ontotext.trree.OwlimSchemaRepository.initialize(OwlimSchemaRepository.java:443) at org.openrdf.repository.sail.SailRepository.initialize(SailRepository.java:84) at com.ontotext.kim.semanticrepository.UnmanagedRepositoryFactory.reconnect(UnmanagedRepositoryFactory.java:40) ... 3 more 08:48:00 [INFO] 4134[Abandoned-ComponentStarter-Thread-2](KIM_SERVICE) - It is now safe to close the KIM Server. 08:48:00 [INFO] 4134[Abandoned-ComponentStarter-Thread-2](KIM_SERVICE) - KIMService unregistered from port 1099 08:48:00 [INFO] 4134[Thread-3](KIM_SERVICE) - It is now safe to close the KIM Server. From: Philip Alexiev [mailto:philip.alexiev at gmail.com] Sent: Thursday, November 18, 2010 8:11 AM To: VERMILLION, Bonnie Cc: ENUGU, Reddy (Independent Contractor); Matthew Petrillo; mailing-list; WILSON, Greg Subject: Re: [Kim-discussion] question about gate within KIM Just one more correction. The UI also expects that the entities have a main label (protons:mainLabel). I have modified the ontology. So with a fresh KIM and this files I send you now, you should be able to run everything. -------------- next part -------------- An HTML attachment was scrubbed... URL: From boyan.kukushev at ontotext.com Thu Nov 18 09:02:48 2010 From: boyan.kukushev at ontotext.com (Boyan Kukushev) Date: Thu, 18 Nov 2010 16:02:48 +0200 Subject: [Kim-discussion] question about gate within KIM In-Reply-To: References: <2D4BA463-E9DA-4C21-BD59-46488E3B44D6@gmail.com> Message-ID: <201011181602.48364.boyan.kukushev@ontotext.com> Hi, suppose that there is an incorrect line in one of your ontology / .nt files, probably something like: Philip, > > I'm now getting another error: - please advise! > > Thank you, > Bonnie > > 08:47:56 [INFO] 0[main](KIM_SERVICE) - : : : : : : : : KIM SERVER START : : : : : : : : > 08:47:56 [INFO] 109[main](KIM_SERVICE) - KIMService registered on port 1099 > 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - OwlimSchemaRepository: 3.3 > 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Build date: 06-22-2010 11:57 > 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Configured parameter 'imports' to 'kb/owl/owl.rdfs; > kb/owl/protons.owl; > kb/owl/protont.owl; > kb/owl/protonu.owl; > kb/dispreg.owl;' > 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Configured parameter 'defaultNS' to 'http://www.w3.org/2002/07/owl#; > http://proton.semanticweb.org/2006/05/protons#; > http://proton.semanticweb.org/2006/05/protont#; > http://proton.semanticweb.org/2006/05/protonu#; > http://www.semanticweb.org/ontologies/2010/10/15/dispreg.owl#;' > 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Configured parameter 'base-URL' to 'http://www.ontotext.com/kim/2006/05/wkb#' > 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Configured parameter 'ruleset' to 'kb/KIMRules.pie' > 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Configured parameter 'ftsLiteralsOnly' to 'true' > 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Configured parameter 'console-thread' to 'false' > 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Configured parameter 'useShutdownHooks' to 'false' > 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Configured parameter 'entity-index-size' to '400000' > 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Configured parameter 'ftsIndexPolicy' to 'onStartup' > 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Tokenization regular expression: [\p{L}\d_]+ > 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Repository fragments: 1 > 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Inferencer threads: 1 > 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - ftsPolicy = on-startup > 08:47:56 [INFO] 171[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - fts: indexing literals only > 08:47:56 [INFO] 171[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Configured parameter 'tuple-index-memory' to '100M' > 08:47:56 [INFO] 171[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Configured parameter 'fts-memory' to '80M' > 08:47:56 [INFO] 171[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Cache pages for tuples: 5241 > 08:47:56 [INFO] 171[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Cache pages for predicates: 0 > 08:47:56 [INFO] 171[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Cache pages for FTS: 4193 > 08:47:56 [INFO] 171[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Configured parameter 'storage-folder' to 'populated' > 08:48:00 [ERROR] 4134[ComponentStarter-Thread-2](KIM_SERVICE) - Server Starter thread failed! > java.rmi.RemoteException: Error creating repository; nested exception is: > java.lang.IllegalArgumentException: Not a valid (absolute) URI: > at com.ontotext.kim.semanticrepository.UnmanagedRepositoryFactory.reconnect(UnmanagedRepositoryFactory.java:44) > at com.ontotext.kim.KIMServiceImpl.getSemanticRepositoryAPI(KIMServiceImpl.java:228) > at com.ontotext.kim.KIMServiceImpl.getSemanticRepositoryAPI(KIMServiceImpl.java:198) > at com.ontotext.kim.KIMServiceImpl$ServerComponentStarter.run(KIMServiceImpl.java:82) > Caused by: java.lang.IllegalArgumentException: Not a valid (absolute) URI: > at org.openrdf.model.impl.URIImpl.setURIString(URIImpl.java:68) > at org.openrdf.model.impl.URIImpl.(URIImpl.java:57) > at com.ontotext.trree.HashEntityPool.toObject(HashEntityPool.java:819) > at com.ontotext.trree.HashEntityPool.buildFullTextSearchIndex(HashEntityPool.java:1154) > at com.ontotext.trree.HashEntityPool.buildFullTextIndex(HashEntityPool.java:154) > at com.ontotext.trree.HashEntityPool.(HashEntityPool.java:143) > at com.ontotext.trree.OwlimSchemaRepository.initialize(OwlimSchemaRepository.java:443) > at org.openrdf.repository.sail.SailRepository.initialize(SailRepository.java:84) > at com.ontotext.kim.semanticrepository.UnmanagedRepositoryFactory.reconnect(UnmanagedRepositoryFactory.java:40) > ... 3 more > 08:48:00 [INFO] 4134[Abandoned-ComponentStarter-Thread-2](KIM_SERVICE) - It is now safe to close the KIM Server. > 08:48:00 [INFO] 4134[Abandoned-ComponentStarter-Thread-2](KIM_SERVICE) - KIMService unregistered from port 1099 > 08:48:00 [INFO] 4134[Thread-3](KIM_SERVICE) - It is now safe to close the KIM Server. > > From: Philip Alexiev [mailto:philip.alexiev at gmail.com] > Sent: Thursday, November 18, 2010 8:11 AM > To: VERMILLION, Bonnie > Cc: ENUGU, Reddy (Independent Contractor); Matthew Petrillo; mailing-list; WILSON, Greg > Subject: Re: [Kim-discussion] question about gate within KIM > > Just one more correction. The UI also expects that the entities have a main label (protons:mainLabel). I have modified the ontology. So with a fresh KIM and this files I send you now, you should be able to run everything. > > From YVERMILLION at lmi.org Thu Nov 18 09:03:52 2010 From: YVERMILLION at lmi.org (VERMILLION, Bonnie) Date: Thu, 18 Nov 2010 09:03:52 -0500 Subject: [Kim-discussion] question about gate within KIM In-Reply-To: <201011181602.48364.boyan.kukushev@ontotext.com> References: <2D4BA463-E9DA-4C21-BD59-46488E3B44D6@gmail.com> <201011181602.48364.boyan.kukushev@ontotext.com> Message-ID: Thanks everyone. I must have copied something wrong - I started over with a new instance of Kim, copied everything and it is now starting - now testing - will report back! Thank you, Bonnie -----Original Message----- From: Boyan Kukushev [mailto:boyan.kukushev at ontotext.com] Sent: Thursday, November 18, 2010 9:03 AM To: kim-discussion at ontotext.com Cc: VERMILLION, Bonnie; Philip Alexiev; Matthew Petrillo; ENUGU, Reddy (Independent Contractor); WILSON, Greg Subject: Re: [Kim-discussion] question about gate within KIM Hi, suppose that there is an incorrect line in one of your ontology / .nt files, probably something like: Philip, > > I'm now getting another error: - please advise! > > Thank you, > Bonnie > > 08:47:56 [INFO] 0[main](KIM_SERVICE) - : : : : : : : : KIM SERVER START : : : : : : : : > 08:47:56 [INFO] 109[main](KIM_SERVICE) - KIMService registered on port 1099 > 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - OwlimSchemaRepository: 3.3 > 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Build date: 06-22-2010 11:57 > 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Configured parameter 'imports' to 'kb/owl/owl.rdfs; > kb/owl/protons.owl; > kb/owl/protont.owl; > kb/owl/protonu.owl; > kb/dispreg.owl;' > 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Configured parameter 'defaultNS' to 'http://www.w3.org/2002/07/owl#; > http://proton.semanticweb.org/2006/05/protons#; > http://proton.semanticweb.org/2006/05/protont#; > http://proton.semanticweb.org/2006/05/protonu#; > http://www.semanticweb.org/ontologies/2010/10/15/dispreg.owl#;' > 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Configured parameter 'base-URL' to 'http://www.ontotext.com/kim/2006/05/wkb#' > 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Configured parameter 'ruleset' to 'kb/KIMRules.pie' > 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Configured parameter 'ftsLiteralsOnly' to 'true' > 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Configured parameter 'console-thread' to 'false' > 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Configured parameter 'useShutdownHooks' to 'false' > 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Configured parameter 'entity-index-size' to '400000' > 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Configured parameter 'ftsIndexPolicy' to 'onStartup' > 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Tokenization regular expression: [\p{L}\d_]+ > 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Repository fragments: 1 > 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Inferencer threads: 1 > 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - ftsPolicy = on-startup > 08:47:56 [INFO] 171[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - fts: indexing literals only > 08:47:56 [INFO] 171[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Configured parameter 'tuple-index-memory' to '100M' > 08:47:56 [INFO] 171[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Configured parameter 'fts-memory' to '80M' > 08:47:56 [INFO] 171[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Cache pages for tuples: 5241 > 08:47:56 [INFO] 171[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Cache pages for predicates: 0 > 08:47:56 [INFO] 171[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Cache pages for FTS: 4193 > 08:47:56 [INFO] 171[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Configured parameter 'storage-folder' to 'populated' > 08:48:00 [ERROR] 4134[ComponentStarter-Thread-2](KIM_SERVICE) - Server Starter thread failed! > java.rmi.RemoteException: Error creating repository; nested exception is: > java.lang.IllegalArgumentException: Not a valid (absolute) URI: > at com.ontotext.kim.semanticrepository.UnmanagedRepositoryFactory.reconnect(UnmanagedRepositoryFactory.java:44) > at com.ontotext.kim.KIMServiceImpl.getSemanticRepositoryAPI(KIMServiceImpl.java:228) > at com.ontotext.kim.KIMServiceImpl.getSemanticRepositoryAPI(KIMServiceImpl.java:198) > at com.ontotext.kim.KIMServiceImpl$ServerComponentStarter.run(KIMServiceImpl.java:82) > Caused by: java.lang.IllegalArgumentException: Not a valid (absolute) URI: > at org.openrdf.model.impl.URIImpl.setURIString(URIImpl.java:68) > at org.openrdf.model.impl.URIImpl.(URIImpl.java:57) > at com.ontotext.trree.HashEntityPool.toObject(HashEntityPool.java:819) > at com.ontotext.trree.HashEntityPool.buildFullTextSearchIndex(HashEntityPool.java:1154) > at com.ontotext.trree.HashEntityPool.buildFullTextIndex(HashEntityPool.java:154) > at com.ontotext.trree.HashEntityPool.(HashEntityPool.java:143) > at com.ontotext.trree.OwlimSchemaRepository.initialize(OwlimSchemaRepository.java:443) > at org.openrdf.repository.sail.SailRepository.initialize(SailRepository.java:84) > at com.ontotext.kim.semanticrepository.UnmanagedRepositoryFactory.reconnect(UnmanagedRepositoryFactory.java:40) > ... 3 more > 08:48:00 [INFO] 4134[Abandoned-ComponentStarter-Thread-2](KIM_SERVICE) - It is now safe to close the KIM Server. > 08:48:00 [INFO] 4134[Abandoned-ComponentStarter-Thread-2](KIM_SERVICE) - KIMService unregistered from port 1099 > 08:48:00 [INFO] 4134[Thread-3](KIM_SERVICE) - It is now safe to close the KIM Server. > > From: Philip Alexiev [mailto:philip.alexiev at gmail.com] > Sent: Thursday, November 18, 2010 8:11 AM > To: VERMILLION, Bonnie > Cc: ENUGU, Reddy (Independent Contractor); Matthew Petrillo; mailing-list; WILSON, Greg > Subject: Re: [Kim-discussion] question about gate within KIM > > Just one more correction. The UI also expects that the entities have a main label (protons:mainLabel). I have modified the ontology. So with a fresh KIM and this files I send you now, you should be able to run everything. > > From YVERMILLION at lmi.org Thu Nov 18 09:12:54 2010 From: YVERMILLION at lmi.org (VERMILLION, Bonnie) Date: Thu, 18 Nov 2010 09:12:54 -0500 Subject: [Kim-discussion] question about gate within KIM In-Reply-To: <201011181602.48364.boyan.kukushev@ontotext.com> References: <2D4BA463-E9DA-4C21-BD59-46488E3B44D6@gmail.com> <201011181602.48364.boyan.kukushev@ontotext.com> Message-ID: Here is the contents of the command window. - points to the visibility file Thank you, Bonnie -----Original Message----- From: Boyan Kukushev [mailto:boyan.kukushev at ontotext.com] Sent: Thursday, November 18, 2010 9:03 AM To: kim-discussion at ontotext.com Cc: VERMILLION, Bonnie; Philip Alexiev; Matthew Petrillo; ENUGU, Reddy (Independent Contractor); WILSON, Greg Subject: Re: [Kim-discussion] question about gate within KIM Hi, suppose that there is an incorrect line in one of your ontology / .nt files, probably something like: Philip, > > I'm now getting another error: - please advise! > > Thank you, > Bonnie > > 08:47:56 [INFO] 0[main](KIM_SERVICE) - : : : : : : : : KIM SERVER START : : : : : : : : > 08:47:56 [INFO] 109[main](KIM_SERVICE) - KIMService registered on port 1099 > 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - OwlimSchemaRepository: 3.3 > 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Build date: 06-22-2010 11:57 > 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Configured parameter 'imports' to 'kb/owl/owl.rdfs; > kb/owl/protons.owl; > kb/owl/protont.owl; > kb/owl/protonu.owl; > kb/dispreg.owl;' > 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Configured parameter 'defaultNS' to 'http://www.w3.org/2002/07/owl#; > http://proton.semanticweb.org/2006/05/protons#; > http://proton.semanticweb.org/2006/05/protont#; > http://proton.semanticweb.org/2006/05/protonu#; > http://www.semanticweb.org/ontologies/2010/10/15/dispreg.owl#;' > 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Configured parameter 'base-URL' to 'http://www.ontotext.com/kim/2006/05/wkb#' > 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Configured parameter 'ruleset' to 'kb/KIMRules.pie' > 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Configured parameter 'ftsLiteralsOnly' to 'true' > 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Configured parameter 'console-thread' to 'false' > 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Configured parameter 'useShutdownHooks' to 'false' > 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Configured parameter 'entity-index-size' to '400000' > 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Configured parameter 'ftsIndexPolicy' to 'onStartup' > 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Tokenization regular expression: [\p{L}\d_]+ > 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Repository fragments: 1 > 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Inferencer threads: 1 > 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - ftsPolicy = on-startup > 08:47:56 [INFO] 171[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - fts: indexing literals only > 08:47:56 [INFO] 171[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Configured parameter 'tuple-index-memory' to '100M' > 08:47:56 [INFO] 171[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Configured parameter 'fts-memory' to '80M' > 08:47:56 [INFO] 171[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Cache pages for tuples: 5241 > 08:47:56 [INFO] 171[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Cache pages for predicates: 0 > 08:47:56 [INFO] 171[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Cache pages for FTS: 4193 > 08:47:56 [INFO] 171[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Configured parameter 'storage-folder' to 'populated' > 08:48:00 [ERROR] 4134[ComponentStarter-Thread-2](KIM_SERVICE) - Server Starter thread failed! > java.rmi.RemoteException: Error creating repository; nested exception is: > java.lang.IllegalArgumentException: Not a valid (absolute) URI: > at com.ontotext.kim.semanticrepository.UnmanagedRepositoryFactory.reconnect(UnmanagedRepositoryFactory.java:44) > at com.ontotext.kim.KIMServiceImpl.getSemanticRepositoryAPI(KIMServiceImpl.java:228) > at com.ontotext.kim.KIMServiceImpl.getSemanticRepositoryAPI(KIMServiceImpl.java:198) > at com.ontotext.kim.KIMServiceImpl$ServerComponentStarter.run(KIMServiceImpl.java:82) > Caused by: java.lang.IllegalArgumentException: Not a valid (absolute) URI: > at org.openrdf.model.impl.URIImpl.setURIString(URIImpl.java:68) > at org.openrdf.model.impl.URIImpl.(URIImpl.java:57) > at com.ontotext.trree.HashEntityPool.toObject(HashEntityPool.java:819) > at com.ontotext.trree.HashEntityPool.buildFullTextSearchIndex(HashEntityPool.java:1154) > at com.ontotext.trree.HashEntityPool.buildFullTextIndex(HashEntityPool.java:154) > at com.ontotext.trree.HashEntityPool.(HashEntityPool.java:143) > at com.ontotext.trree.OwlimSchemaRepository.initialize(OwlimSchemaRepository.java:443) > at org.openrdf.repository.sail.SailRepository.initialize(SailRepository.java:84) > at com.ontotext.kim.semanticrepository.UnmanagedRepositoryFactory.reconnect(UnmanagedRepositoryFactory.java:40) > ... 3 more > 08:48:00 [INFO] 4134[Abandoned-ComponentStarter-Thread-2](KIM_SERVICE) - It is now safe to close the KIM Server. > 08:48:00 [INFO] 4134[Abandoned-ComponentStarter-Thread-2](KIM_SERVICE) - KIMService unregistered from port 1099 > 08:48:00 [INFO] 4134[Thread-3](KIM_SERVICE) - It is now safe to close the KIM Server. > > From: Philip Alexiev [mailto:philip.alexiev at gmail.com] > Sent: Thursday, November 18, 2010 8:11 AM > To: VERMILLION, Bonnie > Cc: ENUGU, Reddy (Independent Contractor); Matthew Petrillo; mailing-list; WILSON, Greg > Subject: Re: [Kim-discussion] question about gate within KIM > > Just one more correction. The UI also expects that the entities have a main label (protons:mainLabel). I have modified the ontology. So with a fresh KIM and this files I send you now, you should be able to run everything. > > -------------- next part -------------- A non-text attachment was scrubbed... Name: Command window.docx Type: application/vnd.openxmlformats-officedocument.wordprocessingml.document Size: 125551 bytes Desc: Command window.docx URL: From YVERMILLION at lmi.org Thu Nov 18 09:08:05 2010 From: YVERMILLION at lmi.org (VERMILLION, Bonnie) Date: Thu, 18 Nov 2010 09:08:05 -0500 Subject: [Kim-discussion] question about gate within KIM In-Reply-To: <201011181602.48364.boyan.kukushev@ontotext.com> References: <2D4BA463-E9DA-4C21-BD59-46488E3B44D6@gmail.com> <201011181602.48364.boyan.kukushev@ontotext.com> Message-ID: Phillip, Same issue - When I run Kim - ontology and Facets only show Entity and no other classes - see attached Thank you, Bonnie -----Original Message----- From: Boyan Kukushev [mailto:boyan.kukushev at ontotext.com] Sent: Thursday, November 18, 2010 9:03 AM To: kim-discussion at ontotext.com Cc: VERMILLION, Bonnie; Philip Alexiev; Matthew Petrillo; ENUGU, Reddy (Independent Contractor); WILSON, Greg Subject: Re: [Kim-discussion] question about gate within KIM Hi, suppose that there is an incorrect line in one of your ontology / .nt files, probably something like: Philip, > > I'm now getting another error: - please advise! > > Thank you, > Bonnie > > 08:47:56 [INFO] 0[main](KIM_SERVICE) - : : : : : : : : KIM SERVER START : : : : : : : : > 08:47:56 [INFO] 109[main](KIM_SERVICE) - KIMService registered on port 1099 > 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - OwlimSchemaRepository: 3.3 > 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Build date: 06-22-2010 11:57 > 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Configured parameter 'imports' to 'kb/owl/owl.rdfs; > kb/owl/protons.owl; > kb/owl/protont.owl; > kb/owl/protonu.owl; > kb/dispreg.owl;' > 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Configured parameter 'defaultNS' to 'http://www.w3.org/2002/07/owl#; > http://proton.semanticweb.org/2006/05/protons#; > http://proton.semanticweb.org/2006/05/protont#; > http://proton.semanticweb.org/2006/05/protonu#; > http://www.semanticweb.org/ontologies/2010/10/15/dispreg.owl#;' > 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Configured parameter 'base-URL' to 'http://www.ontotext.com/kim/2006/05/wkb#' > 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Configured parameter 'ruleset' to 'kb/KIMRules.pie' > 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Configured parameter 'ftsLiteralsOnly' to 'true' > 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Configured parameter 'console-thread' to 'false' > 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Configured parameter 'useShutdownHooks' to 'false' > 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Configured parameter 'entity-index-size' to '400000' > 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Configured parameter 'ftsIndexPolicy' to 'onStartup' > 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Tokenization regular expression: [\p{L}\d_]+ > 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Repository fragments: 1 > 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Inferencer threads: 1 > 08:47:56 [INFO] 156[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - ftsPolicy = on-startup > 08:47:56 [INFO] 171[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - fts: indexing literals only > 08:47:56 [INFO] 171[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Configured parameter 'tuple-index-memory' to '100M' > 08:47:56 [INFO] 171[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Configured parameter 'fts-memory' to '80M' > 08:47:56 [INFO] 171[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Cache pages for tuples: 5241 > 08:47:56 [INFO] 171[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Cache pages for predicates: 0 > 08:47:56 [INFO] 171[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Cache pages for FTS: 4193 > 08:47:56 [INFO] 171[ComponentStarter-Thread-2](trree.OwlimSchemaRepository) - Configured parameter 'storage-folder' to 'populated' > 08:48:00 [ERROR] 4134[ComponentStarter-Thread-2](KIM_SERVICE) - Server Starter thread failed! > java.rmi.RemoteException: Error creating repository; nested exception is: > java.lang.IllegalArgumentException: Not a valid (absolute) URI: > at com.ontotext.kim.semanticrepository.UnmanagedRepositoryFactory.reconnect(UnmanagedRepositoryFactory.java:44) > at com.ontotext.kim.KIMServiceImpl.getSemanticRepositoryAPI(KIMServiceImpl.java:228) > at com.ontotext.kim.KIMServiceImpl.getSemanticRepositoryAPI(KIMServiceImpl.java:198) > at com.ontotext.kim.KIMServiceImpl$ServerComponentStarter.run(KIMServiceImpl.java:82) > Caused by: java.lang.IllegalArgumentException: Not a valid (absolute) URI: > at org.openrdf.model.impl.URIImpl.setURIString(URIImpl.java:68) > at org.openrdf.model.impl.URIImpl.(URIImpl.java:57) > at com.ontotext.trree.HashEntityPool.toObject(HashEntityPool.java:819) > at com.ontotext.trree.HashEntityPool.buildFullTextSearchIndex(HashEntityPool.java:1154) > at com.ontotext.trree.HashEntityPool.buildFullTextIndex(HashEntityPool.java:154) > at com.ontotext.trree.HashEntityPool.(HashEntityPool.java:143) > at com.ontotext.trree.OwlimSchemaRepository.initialize(OwlimSchemaRepository.java:443) > at org.openrdf.repository.sail.SailRepository.initialize(SailRepository.java:84) > at com.ontotext.kim.semanticrepository.UnmanagedRepositoryFactory.reconnect(UnmanagedRepositoryFactory.java:40) > ... 3 more > 08:48:00 [INFO] 4134[Abandoned-ComponentStarter-Thread-2](KIM_SERVICE) - It is now safe to close the KIM Server. > 08:48:00 [INFO] 4134[Abandoned-ComponentStarter-Thread-2](KIM_SERVICE) - KIMService unregistered from port 1099 > 08:48:00 [INFO] 4134[Thread-3](KIM_SERVICE) - It is now safe to close the KIM Server. > > From: Philip Alexiev [mailto:philip.alexiev at gmail.com] > Sent: Thursday, November 18, 2010 8:11 AM > To: VERMILLION, Bonnie > Cc: ENUGU, Reddy (Independent Contractor); Matthew Petrillo; mailing-list; WILSON, Greg > Subject: Re: [Kim-discussion] question about gate within KIM > > Just one more correction. The UI also expects that the entities have a main label (protons:mainLabel). I have modified the ontology. So with a fresh KIM and this files I send you now, you should be able to run everything. > > -------------- next part -------------- A non-text attachment was scrubbed... Name: Kim_issue_111810.docx Type: application/vnd.openxmlformats-officedocument.wordprocessingml.document Size: 428721 bytes Desc: Kim_issue_111810.docx URL: From naaman at truemeridian.com Thu Nov 25 01:51:19 2010 From: naaman at truemeridian.com (Naaman Musawwir) Date: Thu, 25 Nov 2010 11:51:19 +0500 Subject: [Kim-discussion] Help - Adding/Deleting Documents Message-ID: <31.B6.07283.A480EEC4@cm-omr6> Hello, I am using Kim 3.0 RC4 on Windows and Linux, same configuration with Lucene database setting and Java API to connect to KIM instance and carry out operations. While trying to add/delete/load documents I see some inconsistency in results and need help regarding correct use of the API. Here is what I do and get as a result: DocumentRepositoryAPI apiDR; 1. Create two documents using CorporaAPI.createDocument() and add those to document repository using apiDR.adDocument() just like given in the example. Documents added successfully. 2. Loaded documents using apiDR.getDocumentIds(new DocumentQuery()). It returned all two documents fine. I also tested using apiDR.getDocumentCount(new DocumentQuery()). It also gave correct result as two. 3. Then I deleted all the documents using apiDR.clear(DocumentRepositoryAPI.CLEAR_COMMAND_ALL);. 4. Now I retrieved documents again as step 2 above. There was no effect on the repository and same two documents were returned. Is it the correct behaviour? 5. I tried to delete the documents one by one using apiDR.deleteDocument(docID). Here are the confusions in this step a. I tried to retrieve documents using apiDR.getDocumentIds(new DocumentQuery()). Behavior is unexpected as it returned 2 documents, but no document could be loaded using apiDR.loadDocument(docID). I tried to get the count using apiDR.getDocumentCount(new DocumentQuery()). It returned 2, also. b. I shutdown KIM server and restart. Now I try to retrieve documents as step 2. Now the deletion seemed to work as the count and list count in step 2 both were 0? Please explain if it is the expected behavior. Regards, Naaman Musawwir. -------------- next part -------------- An HTML attachment was scrubbed... URL: From naaman at truemeridian.com Thu Nov 25 02:57:42 2010 From: naaman at truemeridian.com (Naaman Musawwir) Date: Thu, 25 Nov 2010 12:57:42 +0500 Subject: [Kim-discussion] Help - Document Feature Schema Message-ID: Hello, I want to add a few custom features to KIM documents. How should I do that? I updated the property com.ontotext.kim.KIMConstants.DOCUMENT_FEAT_LIST in conf/document.repository.properties but even after that I get the error that Features [CUSTOM_FEATURE] are not in the feature schema. Feature schema is currently: [SUBJECT, AUTHORS, SOURCE, LANGUAGE, DOCTYPE, KEYENTITIES, KEYPHRASES, TIMESTAMP, URL, TITLE] What to do more in this regard? Regards, Naaman Musawwir. -------------- next part -------------- An HTML attachment was scrubbed... URL: From naaman at truemeridian.com Thu Nov 25 03:31:56 2010 From: naaman at truemeridian.com (Naaman Musawwir) Date: Thu, 25 Nov 2010 13:31:56 +0500 Subject: [Kim-discussion] Help - Document Search Message-ID: Hello, I have two queries regarding document searching from the repository. 1. How to search based upon matching feature value e.g. all the documents with title matching "some title" 2. I am loading documents using DocumentQuery from DocumentRepositoryAPI. When I pass an empty query it returns 0 documents that is correct as I have deleted all the documents and there are no documents in the repository. But when I set a keyword restriction it loads all the deleted documents. Please suggest. Regards, Naaman Musawwir. -------------- next part -------------- An HTML attachment was scrubbed... URL: From philip.alexiev at ontotext.com Thu Nov 25 09:06:36 2010 From: philip.alexiev at ontotext.com (Philip Alexiev @ Ontotext) Date: Thu, 25 Nov 2010 16:06:36 +0200 Subject: [Kim-discussion] Help - Document Feature Schema In-Reply-To: References: Message-ID: Hi Naaman Adding your custom feature to the list is sufficient. Please send your document.repository.properties if you still have problems with that. Greetings, Philip Alexiev Software Engineer, KIM Team On Nov 25, 2010, at 9:57 AM, Naaman Musawwir wrote: > Hello, > > I want to add a few custom features to KIM documents. How should I do that? I updated the propertycom.ontotext.kim.KIMConstants.DOCUMENT_FEAT_LIST in conf/document.repository.properties but even after that I get the error that > > Features [CUSTOM_FEATURE] are not in the feature schema. Feature schema is currently: [SUBJECT, AUTHORS, SOURCE, LANGUAGE, DOCTYPE, KEYENTITIES, KEYPHRASES, TIMESTAMP, URL, TITLE] > > What to do more in this regard? > > Regards, > Naaman Musawwir. > > _______________________________________________ > Kim-discussion mailing list > Kim-discussion at ontotext.com > http://ontotext.com/mailman/listinfo/kim-discussion -------------- next part -------------- An HTML attachment was scrubbed... URL: From philip.alexiev at ontotext.com Thu Nov 25 09:46:13 2010 From: philip.alexiev at ontotext.com (Philip Alexiev @ Ontotext) Date: Thu, 25 Nov 2010 16:46:13 +0200 Subject: [Kim-discussion] Help - Adding/Deleting Documents In-Reply-To: <31.B6.07283.A480EEC4@cm-omr6> References: <31.B6.07283.A480EEC4@cm-omr6> Message-ID: <05DE1BDA-34CD-446B-89EB-6C0385536BBF@ontotext.com> Hi Naaman, This is interesting behavior. Generally, we don't delete documents in our scenarios where we use KIM, so there is a slight possibility that this is a bug. I will try to reproduce it. Thank you for your feedback. All the best Philip Alexiev Software Engineer, KIM Team On Nov 25, 2010, at 8:51 AM, Naaman Musawwir wrote: > Hello, > > I am using Kim 3.0 RC4 on Windows and Linux, same configuration with Lucene database setting and Java API to connect to KIM instance and carry out operations. While trying to add/delete/load documents I see some inconsistency in results and need help regarding correct use of the API. > > Here is what I do and get as a result: > > DocumentRepositoryAPI apiDR; > > 1. Create two documents using CorporaAPI.createDocument() and add those to document repository using apiDR.adDocument() just like given in the example. Documents added successfully. > 2. Loaded documents using apiDR.getDocumentIds(new DocumentQuery()). It returned all two documents fine. I also tested using apiDR.getDocumentCount(new DocumentQuery()). It also gave correct result as two. > 3. Then I deleted all the documents using apiDR.clear(DocumentRepositoryAPI.CLEAR_COMMAND_ALL);. > 4. Now I retrieved documents again as step 2 above. There was no effect on the repository and same two documents were returned. Is it the correct behaviour? > 5. I tried to delete the documents one by one using apiDR.deleteDocument(docID). Here are the confusions in this step > a. I tried to retrieve documents using apiDR.getDocumentIds(new DocumentQuery()). Behavior is unexpected as it returned 2 documents, but no document could be loaded using apiDR.loadDocument(docID). I tried to get the count using apiDR.getDocumentCount(new DocumentQuery()). It returned 2, also. > b. I shutdown KIM server and restart. Now I try to retrieve documents as step 2. Now the deletion seemed to work as the count and list count in step 2 both were 0? > > > Please explain if it is the expected behavior. > > Regards, > Naaman Musawwir. > > _______________________________________________ > Kim-discussion mailing list > Kim-discussion at ontotext.com > http://ontotext.com/mailman/listinfo/kim-discussion -------------- next part -------------- An HTML attachment was scrubbed... URL: From naaman at truemeridian.com Thu Nov 25 09:48:30 2010 From: naaman at truemeridian.com (Naaman Musawwir) Date: Thu, 25 Nov 2010 19:48:30 +0500 Subject: [Kim-discussion] Help - Document Feature Schema In-Reply-To: Message-ID: <1C.A2.06713.2287EEC4@cm-omr12> Attached is the properties file. Regards, Naaman Musawwir. _____ From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at ontotext.com] Sent: Thursday, November 25, 2010 7:07 PM To: Naaman Musawwir Cc: kim-discussion at ontotext.com Subject: Re: [Kim-discussion] Help - Document Feature Schema Hi Naaman Adding your custom feature to the list is sufficient. Please send your document.repository.properties if you still have problems with that. Greetings, Philip Alexiev Software Engineer, KIM Team On Nov 25, 2010, at 9:57 AM, Naaman Musawwir wrote: Hello, I want to add a few custom features to KIM documents. How should I do that? I updated the propertycom.ontotext.kim.KIMConstants.DOCUMENT_FEAT_LIST in conf/document.repository.properties but even after that I get the error that Features [CUSTOM_FEATURE] are not in the feature schema. Feature schema is currently: [SUBJECT, AUTHORS, SOURCE, LANGUAGE, DOCTYPE, KEYENTITIES, KEYPHRASES, TIMESTAMP, URL, TITLE] What to do more in this regard? Regards, Naaman Musawwir. _______________________________________________ Kim-discussion mailing list Kim-discussion at ontotext.com http://ontotext.com/mailman/listinfo/kim-discussion No virus found in this incoming message. Checked by AVG - www.avg.com Version: 9.0.872 / Virus Database: 271.1.1/3277 - Release Date: 11/25/10 00:34:00 -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: document.repository.properties Type: application/octet-stream Size: 3580 bytes Desc: not available URL: From philip.alexiev at ontotext.com Fri Nov 26 04:19:04 2010 From: philip.alexiev at ontotext.com (Philip Alexiev @ Ontotext) Date: Fri, 26 Nov 2010 11:19:04 +0200 Subject: [Kim-discussion] Help - Adding/Deleting Documents In-Reply-To: <05DE1BDA-34CD-446B-89EB-6C0385536BBF@ontotext.com> References: <31.B6.07283.A480EEC4@cm-omr6> <05DE1BDA-34CD-446B-89EB-6C0385536BBF@ontotext.com> Message-ID: <6A6D8C56-6AB9-467B-A145-BBED3BD28FA8@ontotext.com> Hi Naaman, We managed to reproduce the issue and are currently working on it. We will provide you a link to download the fixed version. The fix will definitely go into KIM 3.5, which is expected soon. Greetings Philip Alexiev Software Engineer, KIM Team On Nov 25, 2010, at 4:46 PM, Philip Alexiev @ Ontotext wrote: > Hi Naaman, > > This is interesting behavior. Generally, we don't delete documents in our scenarios where we use KIM, so there is a slight possibility that this is a bug. I will try to reproduce it. > > Thank you for your feedback. > > All the best > Philip Alexiev > Software Engineer, KIM Team > > > > On Nov 25, 2010, at 8:51 AM, Naaman Musawwir wrote: > >> Hello, >> >> I am using Kim 3.0 RC4 on Windows and Linux, same configuration with Lucene database setting and Java API to connect to KIM instance and carry out operations. While trying to add/delete/load documents I see some inconsistency in results and need help regarding correct use of the API. >> >> Here is what I do and get as a result: >> >> DocumentRepositoryAPI apiDR; >> >> 1. Create two documents using CorporaAPI.createDocument() and add those to document repository using apiDR.adDocument() just like given in the example. Documents added successfully. >> 2. Loaded documents using apiDR.getDocumentIds(new DocumentQuery()). It returned all two documents fine. I also tested using apiDR.getDocumentCount(new DocumentQuery()). It also gave correct result as two. >> 3. Then I deleted all the documents using apiDR.clear(DocumentRepositoryAPI.CLEAR_COMMAND_ALL);. >> 4. Now I retrieved documents again as step 2 above. There was no effect on the repository and same two documents were returned. Is it the correct behaviour? >> 5. I tried to delete the documents one by one using apiDR.deleteDocument(docID). Here are the confusions in this step >> a. I tried to retrieve documents using apiDR.getDocumentIds(new DocumentQuery()). Behavior is unexpected as it returned 2 documents, but no document could be loaded using apiDR.loadDocument(docID). I tried to get the count using apiDR.getDocumentCount(new DocumentQuery()). It returned 2, also. >> b. I shutdown KIM server and restart. Now I try to retrieve documents as step 2. Now the deletion seemed to work as the count and list count in step 2 both were 0? >> >> >> Please explain if it is the expected behavior. >> >> Regards, >> Naaman Musawwir. >> >> _______________________________________________ >> Kim-discussion mailing list >> Kim-discussion at ontotext.com >> http://ontotext.com/mailman/listinfo/kim-discussion > > _______________________________________________ > Kim-discussion mailing list > Kim-discussion at ontotext.com > http://ontotext.com/mailman/listinfo/kim-discussion -------------- next part -------------- An HTML attachment was scrubbed... URL: From naaman at truemeridian.com Fri Nov 26 04:46:57 2010 From: naaman at truemeridian.com (Naaman Musawwir) Date: Fri, 26 Nov 2010 14:46:57 +0500 Subject: [Kim-discussion] Help - Adding/Deleting Documents In-Reply-To: <6A6D8C56-6AB9-467B-A145-BBED3BD28FA8@ontotext.com> Message-ID: <7E.D0.05725.6F28FEC4@cm-omr4> Thank you. This is great news and we really appreciate the quick response. Regards, Naaman Musawwir. _____ From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at ontotext.com] Sent: Friday, November 26, 2010 2:19 PM To: Naaman Musawwir Cc: mailing-list mailing-list Subject: Re: [Kim-discussion] Help - Adding/Deleting Documents Hi Naaman, We managed to reproduce the issue and are currently working on it. We will provide you a link to download the fixed version. The fix will definitely go into KIM 3.5, which is expected soon. Greetings Philip Alexiev Software Engineer, KIM Team On Nov 25, 2010, at 4:46 PM, Philip Alexiev @ Ontotext wrote: Hi Naaman, This is interesting behavior. Generally, we don't delete documents in our scenarios where we use KIM, so there is a slight possibility that this is a bug. I will try to reproduce it. Thank you for your feedback. All the best Philip Alexiev Software Engineer, KIM Team On Nov 25, 2010, at 8:51 AM, Naaman Musawwir wrote: Hello, I am using Kim 3.0 RC4 on Windows and Linux, same configuration with Lucene database setting and Java API to connect to KIM instance and carry out operations. While trying to add/delete/load documents I see some inconsistency in results and need help regarding correct use of the API. Here is what I do and get as a result: DocumentRepositoryAPI apiDR; 1. Create two documents using CorporaAPI.createDocument() and add those to document repository using apiDR.adDocument() just like given in the example. Documents added successfully. 2. Loaded documents using apiDR.getDocumentIds(new DocumentQuery()). It returned all two documents fine. I also tested using apiDR.getDocumentCount(new DocumentQuery()). It also gave correct result as two. 3. Then I deleted all the documents using apiDR.clear(DocumentRepositoryAPI.CLEAR_COMMAND_ALL);. 4. Now I retrieved documents again as step 2 above. There was no effect on the repository and same two documents were returned. Is it the correct behaviour? 5. I tried to delete the documents one by one using apiDR.deleteDocument(docID). Here are the confusions in this step a. I tried to retrieve documents using apiDR.getDocumentIds(new DocumentQuery()). Behavior is unexpected as it returned 2 documents, but no document could be loaded using apiDR.loadDocument(docID). I tried to get the count using apiDR.getDocumentCount(new DocumentQuery()). It returned 2, also. b. I shutdown KIM server and restart. Now I try to retrieve documents as step 2. Now the deletion seemed to work as the count and list count in step 2 both were 0? Please explain if it is the expected behavior. Regards, Naaman Musawwir. _______________________________________________ Kim-discussion mailing list Kim-discussion at ontotext.com http://ontotext.com/mailman/listinfo/kim-discussion _______________________________________________ Kim-discussion mailing list Kim-discussion at ontotext.com http://ontotext.com/mailman/listinfo/kim-discussion No virus found in this incoming message. Checked by AVG - www.avg.com Version: 9.0.872 / Virus Database: 271.1.1/3277 - Release Date: 11/26/10 04:47:00 -------------- next part -------------- An HTML attachment was scrubbed... URL: From naaman at truemeridian.com Fri Nov 26 04:58:01 2010 From: naaman at truemeridian.com (Naaman Musawwir) Date: Fri, 26 Nov 2010 14:58:01 +0500 Subject: [Kim-discussion] Help - Adding/Deleting Documents In-Reply-To: <6A6D8C56-6AB9-467B-A145-BBED3BD28FA8@ontotext.com> Message-ID: <4D.24.31170.E858FEC4@cm-omr13> Hello Philip, there was another message regarding search. Here it is copied I have two queries regarding document searching from the repository. 1. How to search based upon matching feature value e.g. all the documents with title matching "some title" 2. I am loading documents using DocumentQuery from DocumentRepositoryAPI. When I pass an empty query it returns 0 documents that is correct as I have deleted all the documents and there are no documents in the repository. But when I set a keyword restriction it loads all the deleted documents. Please suggest. I believe second will be fixed with the deletion issues you are working on. Please guide about the first one. Regards, Naaman Musawwir. _____ From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at ontotext.com] Sent: Friday, November 26, 2010 2:19 PM To: Naaman Musawwir Cc: mailing-list mailing-list Subject: Re: [Kim-discussion] Help - Adding/Deleting Documents Hi Naaman, We managed to reproduce the issue and are currently working on it. We will provide you a link to download the fixed version. The fix will definitely go into KIM 3.5, which is expected soon. Greetings Philip Alexiev Software Engineer, KIM Team On Nov 25, 2010, at 4:46 PM, Philip Alexiev @ Ontotext wrote: Hi Naaman, This is interesting behavior. Generally, we don't delete documents in our scenarios where we use KIM, so there is a slight possibility that this is a bug. I will try to reproduce it. Thank you for your feedback. All the best Philip Alexiev Software Engineer, KIM Team On Nov 25, 2010, at 8:51 AM, Naaman Musawwir wrote: Hello, I am using Kim 3.0 RC4 on Windows and Linux, same configuration with Lucene database setting and Java API to connect to KIM instance and carry out operations. While trying to add/delete/load documents I see some inconsistency in results and need help regarding correct use of the API. Here is what I do and get as a result: DocumentRepositoryAPI apiDR; 1. Create two documents using CorporaAPI.createDocument() and add those to document repository using apiDR.adDocument() just like given in the example. Documents added successfully. 2. Loaded documents using apiDR.getDocumentIds(new DocumentQuery()). It returned all two documents fine. I also tested using apiDR.getDocumentCount(new DocumentQuery()). It also gave correct result as two. 3. Then I deleted all the documents using apiDR.clear(DocumentRepositoryAPI.CLEAR_COMMAND_ALL);. 4. Now I retrieved documents again as step 2 above. There was no effect on the repository and same two documents were returned. Is it the correct behaviour? 5. I tried to delete the documents one by one using apiDR.deleteDocument(docID). Here are the confusions in this step a. I tried to retrieve documents using apiDR.getDocumentIds(new DocumentQuery()). Behavior is unexpected as it returned 2 documents, but no document could be loaded using apiDR.loadDocument(docID). I tried to get the count using apiDR.getDocumentCount(new DocumentQuery()). It returned 2, also. b. I shutdown KIM server and restart. Now I try to retrieve documents as step 2. Now the deletion seemed to work as the count and list count in step 2 both were 0? Please explain if it is the expected behavior. Regards, Naaman Musawwir. _______________________________________________ Kim-discussion mailing list Kim-discussion at ontotext.com http://ontotext.com/mailman/listinfo/kim-discussion _______________________________________________ Kim-discussion mailing list Kim-discussion at ontotext.com http://ontotext.com/mailman/listinfo/kim-discussion No virus found in this incoming message. Checked by AVG - www.avg.com Version: 9.0.872 / Virus Database: 271.1.1/3277 - Release Date: 11/26/10 04:47:00 -------------- next part -------------- An HTML attachment was scrubbed... URL: From philip.alexiev at ontotext.com Fri Nov 26 07:58:39 2010 From: philip.alexiev at ontotext.com (Philip Alexiev @ Ontotext) Date: Fri, 26 Nov 2010 14:58:39 +0200 Subject: [Kim-discussion] Help - Adding/Deleting Documents In-Reply-To: <4D.24.31170.E858FEC4@cm-omr13> References: <4D.24.31170.E858FEC4@cm-omr13> Message-ID: <915FB75E-447D-45F6-9E69-A04D700D0D25@ontotext.com> Hello Naaman, My guess is that this and the previous are connected. So we will look into this interesting behavior too. Thank you for the feedback. Philip On Nov 26, 2010, at 11:58 AM, Naaman Musawwir wrote: > Hello Philip, there was another message regarding search. Here it is copied > > I have two queries regarding document searching from the repository. > > 1. How to search based upon matching feature value e.g. all the documents with title matching ?some title? > 2. I am loading documents using DocumentQuery from DocumentRepositoryAPI. When I pass an empty query it returns 0 documents that is correct as I have deleted all the documents and there are no documents in the repository. But when I set a keyword restriction it loads all the deleted documents. Please suggest. > > I believe second will be fixed with the deletion issues you are working on. Please guide about the first one. > > Regards, > Naaman Musawwir. > From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at ontotext.com] > Sent: Friday, November 26, 2010 2:19 PM > To: Naaman Musawwir > Cc: mailing-list mailing-list > Subject: Re: [Kim-discussion] Help - Adding/Deleting Documents > > Hi Naaman, > > We managed to reproduce the issue and are currently working on it. We will provide you a link to download the fixed version. The fix will definitely go into KIM 3.5, which is expected soon. > > Greetings > Philip Alexiev > Software Engineer, KIM Team > > On Nov 25, 2010, at 4:46 PM, Philip Alexiev @ Ontotext wrote: > > > Hi Naaman, > > This is interesting behavior. Generally, we don't delete documents in our scenarios where we use KIM, so there is a slight possibility that this is a bug. I will try to reproduce it. > > Thank you for your feedback. > > All the best > Philip Alexiev > Software Engineer, KIM Team > > > > On Nov 25, 2010, at 8:51 AM, Naaman Musawwir wrote: > > > Hello, > > I am using Kim 3.0 RC4 on Windows and Linux, same configuration with Lucene database setting and Java API to connect to KIM instance and carry out operations. While trying to add/delete/load documents I see some inconsistency in results and need help regarding correct use of the API. > > Here is what I do and get as a result: > > DocumentRepositoryAPI apiDR; > > 1. Create two documents using CorporaAPI.createDocument() and add those to document repository using apiDR.adDocument() just like given in the example. Documents added successfully. > 2. Loaded documents using apiDR.getDocumentIds(new DocumentQuery()). It returned all two documents fine. I also tested using apiDR.getDocumentCount(new DocumentQuery()). It also gave correct result as two. > 3. Then I deleted all the documents using apiDR.clear(DocumentRepositoryAPI.CLEAR_COMMAND_ALL);. > 4. Now I retrieved documents again as step 2 above. There was no effect on the repository and same two documents were returned. Is it the correct behaviour? > 5. I tried to delete the documents one by one using apiDR.deleteDocument(docID). Here are the confusions in this step > a. I tried to retrieve documents using apiDR.getDocumentIds(new DocumentQuery()). Behavior is unexpected as it returned 2 documents, but no document could be loaded using apiDR.loadDocument(docID). I tried to get the count using apiDR.getDocumentCount(new DocumentQuery()). It returned 2, also. > b. I shutdown KIM server and restart. Now I try to retrieve documents as step 2. Now the deletion seemed to work as the count and list count in step 2 both were 0? > > > Please explain if it is the expected behavior. > > Regards, > Naaman Musawwir. > > _______________________________________________ > Kim-discussion mailing list > Kim-discussion at ontotext.com > http://ontotext.com/mailman/listinfo/kim-discussion > > _______________________________________________ > Kim-discussion mailing list > Kim-discussion at ontotext.com > http://ontotext.com/mailman/listinfo/kim-discussion > > No virus found in this incoming message. > Checked by AVG - www.avg.com > Version: 9.0.872 / Virus Database: 271.1.1/3277 - Release Date: 11/26/10 04:47:00 > > _______________________________________________ > Kim-discussion mailing list > Kim-discussion at ontotext.com > http://ontotext.com/mailman/listinfo/kim-discussion -------------- next part -------------- An HTML attachment was scrubbed... URL: From philip.alexiev at ontotext.com Fri Nov 26 10:10:11 2010 From: philip.alexiev at ontotext.com (Philip Alexiev @ Ontotext) Date: Fri, 26 Nov 2010 17:10:11 +0200 Subject: [Kim-discussion] Help - Adding/Deleting Documents In-Reply-To: <915FB75E-447D-45F6-9E69-A04D700D0D25@ontotext.com> References: <4D.24.31170.E858FEC4@cm-omr13> <915FB75E-447D-45F6-9E69-A04D700D0D25@ontotext.com> Message-ID: <789E0F82-7502-4671-8376-4A3CEE412C25@ontotext.com> Sorry, I missed the second part of the mail. This is an example of using the Java API to search for documents: http://ontotext.com/kim/doc/KimDocs-3.0-EN/SearchForDocumentsExamples.html And you can find another useful examples in the system documentation: http://ontotext.com/kim/doc/KimDocs-3.0-EN/Examples.html hth Philip On Nov 26, 2010, at 2:58 PM, Philip Alexiev @ Ontotext wrote: > Hello Naaman, > > My guess is that this and the previous are connected. So we will look into this interesting behavior too. Thank you for the feedback. > > Philip > > > On Nov 26, 2010, at 11:58 AM, Naaman Musawwir wrote: > >> Hello Philip, there was another message regarding search. Here it is copied >> >> I have two queries regarding document searching from the repository. >> >> 1. How to search based upon matching feature value e.g. all the documents with title matching ?some title? >> 2. I am loading documents using DocumentQuery from DocumentRepositoryAPI. When I pass an empty query it returns 0 documents that is correct as I have deleted all the documents and there are no documents in the repository. But when I set a keyword restriction it loads all the deleted documents. Please suggest. >> >> I believe second will be fixed with the deletion issues you are working on. Please guide about the first one. >> >> Regards, >> Naaman Musawwir. >> From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at ontotext.com] >> Sent: Friday, November 26, 2010 2:19 PM >> To: Naaman Musawwir >> Cc: mailing-list mailing-list >> Subject: Re: [Kim-discussion] Help - Adding/Deleting Documents >> >> Hi Naaman, >> >> We managed to reproduce the issue and are currently working on it. We will provide you a link to download the fixed version. The fix will definitely go into KIM 3.5, which is expected soon. >> >> Greetings >> Philip Alexiev >> Software Engineer, KIM Team >> >> On Nov 25, 2010, at 4:46 PM, Philip Alexiev @ Ontotext wrote: >> >> >> Hi Naaman, >> >> This is interesting behavior. Generally, we don't delete documents in our scenarios where we use KIM, so there is a slight possibility that this is a bug. I will try to reproduce it. >> >> Thank you for your feedback. >> >> All the best >> Philip Alexiev >> Software Engineer, KIM Team >> >> >> >> On Nov 25, 2010, at 8:51 AM, Naaman Musawwir wrote: >> >> >> Hello, >> >> I am using Kim 3.0 RC4 on Windows and Linux, same configuration with Lucene database setting and Java API to connect to KIM instance and carry out operations. While trying to add/delete/load documents I see some inconsistency in results and need help regarding correct use of the API. >> >> Here is what I do and get as a result: >> >> DocumentRepositoryAPI apiDR; >> >> 1. Create two documents using CorporaAPI.createDocument() and add those to document repository using apiDR.adDocument() just like given in the example. Documents added successfully. >> 2. Loaded documents using apiDR.getDocumentIds(new DocumentQuery()). It returned all two documents fine. I also tested using apiDR.getDocumentCount(new DocumentQuery()). It also gave correct result as two. >> 3. Then I deleted all the documents using apiDR.clear(DocumentRepositoryAPI.CLEAR_COMMAND_ALL);. >> 4. Now I retrieved documents again as step 2 above. There was no effect on the repository and same two documents were returned. Is it the correct behaviour? >> 5. I tried to delete the documents one by one using apiDR.deleteDocument(docID). Here are the confusions in this step >> a. I tried to retrieve documents using apiDR.getDocumentIds(new DocumentQuery()). Behavior is unexpected as it returned 2 documents, but no document could be loaded using apiDR.loadDocument(docID). I tried to get the count using apiDR.getDocumentCount(new DocumentQuery()). It returned 2, also. >> b. I shutdown KIM server and restart. Now I try to retrieve documents as step 2. Now the deletion seemed to work as the count and list count in step 2 both were 0? >> >> >> Please explain if it is the expected behavior. >> >> Regards, >> Naaman Musawwir. >> >> _______________________________________________ >> Kim-discussion mailing list >> Kim-discussion at ontotext.com >> http://ontotext.com/mailman/listinfo/kim-discussion >> >> _______________________________________________ >> Kim-discussion mailing list >> Kim-discussion at ontotext.com >> http://ontotext.com/mailman/listinfo/kim-discussion >> >> No virus found in this incoming message. >> Checked by AVG - www.avg.com >> Version: 9.0.872 / Virus Database: 271.1.1/3277 - Release Date: 11/26/10 04:47:00 >> >> _______________________________________________ >> Kim-discussion mailing list >> Kim-discussion at ontotext.com >> http://ontotext.com/mailman/listinfo/kim-discussion > > _______________________________________________ > Kim-discussion mailing list > Kim-discussion at ontotext.com > http://ontotext.com/mailman/listinfo/kim-discussion -------------- next part -------------- An HTML attachment was scrubbed... URL: From philip.alexiev at ontotext.com Sun Nov 28 06:53:32 2010 From: philip.alexiev at ontotext.com (Philip Alexiev @ Ontotext) Date: Sun, 28 Nov 2010 13:53:32 +0200 Subject: [Kim-discussion] Issues with creating owl files In-Reply-To: References: Message-ID: Hi Bonnie I will try to draw the complete picture in this mail. It is perfectly true, that you can run KIM with a completely new ontology. Importing the RDF in OWLIM is only the first part of the process. After this you will have to make the resources you use for IE aware of the new ontology. For example changing the way the Gazetteer fills its dictionary, making grammars aware of the new classes (Lookup.class feature) etc. That way you will be able to extract the new entities. Extraction is one of the modules of KIM. Over that, we provide indexing and search mechanisms. Searches are accessible though the web interface and on low level though the Java API. But because the WEB UI is tightly related PROTON, you will not be able to use it. You will have to use the Java API to search for entities and documents. So using a completely new ontology is a lot of work and efforts. KIM makes it easier if you map your ontology to PROTON. That way you can reuse the already existing mechanisms and save a lot of work. Reading this resource carefully will answer most of the questions how to do that: * http://ontotext.com/kim/doc/KimDocs-3.0-EN/ExtendInformationExtraction.html The minimum requirements are: - your classes should inherit protons:Entity directly or indirectly - make your classes and properties visible by setting kimso:visibilityLevel1 - provide at least a MainAlias* to all the instances * you can use either aliases or labels to describe your entities. If you use labels, the property is protons:mainLabel . Which mechanism you use is described in KIM/config/install.properties (com.ontotext.kim.KIMConstants.ENTITY_DESCR property). It is generally a very good idea to subclass the main classes in PROTON * protont:Person * protont:Organization * protont:Location This will make them visible for some of the resources. Another thing to have in mind, is the default behavior of the gazetteer. Only entities generated by trusted sources will be included in the dictionary. That is, the below RDF is valid for them: ?entity protons:generatedBy ?trusted . ?trusted rdf:type protons:Trusted . You can add your own trusted source or use one of the already existing. You can also provide a custom query to fill the dictionary of the gazetteer. This is done by putting a text file with the query (sparql or serql) in KIM/config/query.txt . When using some ontology modeling tool (like Protege), it is enough to include the proton modules and follow the rules above to allow KIM to make a good use of the ontology. And again, all the information you need and even much more detailed is in the documentation: * http://ontotext.com/kim/doc/KimDocs-3.0-EN/ExtendInformationExtraction.html Hope this helps, Philip Alexiev Software Engineer, KIM Team From YVERMILLION at lmi.org Sun Nov 28 22:06:32 2010 From: YVERMILLION at lmi.org (VERMILLION, Bonnie) Date: Sun, 28 Nov 2010 22:06:32 -0500 Subject: [Kim-discussion] Issues with creating owl files In-Reply-To: References: , Message-ID: Thanks, Phillip for the explanation. Bonnie ________________________________________ From: Philip Alexiev@ [Ontotext philip.alexiev at ontotext.com] Sent: Sunday, November 28, 2010 6:53 AM To: VERMILLION, Bonnie Cc: WILSON, Greg; borislav popov; Matthew Petrillo; mailing-list mailing-list Subject: Re: Issues with creating owl files Hi Bonnie I will try to draw the complete picture in this mail. It is perfectly true, that you can run KIM with a completely new ontology. Importing the RDF in OWLIM is only the first part of the process. After this you will have to make the resources you use for IE aware of the new ontology. For example changing the way the Gazetteer fills its dictionary, making grammars aware of the new classes (Lookup.class feature) etc. That way you will be able to extract the new entities. Extraction is one of the modules of KIM. Over that, we provide indexing and search mechanisms. Searches are accessible though the web interface and on low level though the Java API. But because the WEB UI is tightly related PROTON, you will not be able to use it. You will have to use the Java API to search for entities and documents. So using a completely new ontology is a lot of work and efforts. KIM makes it easier if you map your ontology to PROTON. That way you can reuse the already existing mechanisms and save a lot of work. Reading this resource carefully will answer most of the questions how to do that: * http://ontotext.com/kim/doc/KimDocs-3.0-EN/ExtendInformationExtraction.html The minimum requirements are: - your classes should inherit protons:Entity directly or indirectly - make your classes and properties visible by setting kimso:visibilityLevel1 - provide at least a MainAlias* to all the instances * you can use either aliases or labels to describe your entities. If you use labels, the property is protons:mainLabel . Which mechanism you use is described in KIM/config/install.properties (com.ontotext.kim.KIMConstants.ENTITY_DESCR property). It is generally a very good idea to subclass the main classes in PROTON * protont:Person * protont:Organization * protont:Location This will make them visible for some of the resources. Another thing to have in mind, is the default behavior of the gazetteer. Only entities generated by trusted sources will be included in the dictionary. That is, the below RDF is valid for them: ?entity protons:generatedBy ?trusted . ?trusted rdf:type protons:Trusted . You can add your own trusted source or use one of the already existing. You can also provide a custom query to fill the dictionary of the gazetteer. This is done by putting a text file with the query (sparql or serql) in KIM/config/query.txt . When using some ontology modeling tool (like Protege), it is enough to include the proton modules and follow the rules above to allow KIM to make a good use of the ontology. And again, all the information you need and even much more detailed is in the documentation: * http://ontotext.com/kim/doc/KimDocs-3.0-EN/ExtendInformationExtraction.html Hope this helps, Philip Alexiev Software Engineer, KIM Team From YVERMILLION at lmi.org Sun Nov 28 22:07:56 2010 From: YVERMILLION at lmi.org (VERMILLION, Bonnie) Date: Sun, 28 Nov 2010 22:07:56 -0500 Subject: [Kim-discussion] Issues with creating owl files In-Reply-To: References: , Message-ID: Thanks, Phillip. Bonnie ________________________________________ From: Philip Alexiev@ [Ontotext philip.alexiev at ontotext.com] Sent: Sunday, November 28, 2010 6:53 AM To: VERMILLION, Bonnie Cc: WILSON, Greg; borislav popov; Matthew Petrillo; mailing-list mailing-list Subject: Re: Issues with creating owl files Hi Bonnie I will try to draw the complete picture in this mail. It is perfectly true, that you can run KIM with a completely new ontology. Importing the RDF in OWLIM is only the first part of the process. After this you will have to make the resources you use for IE aware of the new ontology. For example changing the way the Gazetteer fills its dictionary, making grammars aware of the new classes (Lookup.class feature) etc. That way you will be able to extract the new entities. Extraction is one of the modules of KIM. Over that, we provide indexing and search mechanisms. Searches are accessible though the web interface and on low level though the Java API. But because the WEB UI is tightly related PROTON, you will not be able to use it. You will have to use the Java API to search for entities and documents. So using a completely new ontology is a lot of work and efforts. KIM makes it easier if you map your ontology to PROTON. That way you can reuse the already existing mechanisms and save a lot of work. Reading this resource carefully will answer most of the questions how to do that: * http://ontotext.com/kim/doc/KimDocs-3.0-EN/ExtendInformationExtraction.html The minimum requirements are: - your classes should inherit protons:Entity directly or indirectly - make your classes and properties visible by setting kimso:visibilityLevel1 - provide at least a MainAlias* to all the instances * you can use either aliases or labels to describe your entities. If you use labels, the property is protons:mainLabel . Which mechanism you use is described in KIM/config/install.properties (com.ontotext.kim.KIMConstants.ENTITY_DESCR property). It is generally a very good idea to subclass the main classes in PROTON * protont:Person * protont:Organization * protont:Location This will make them visible for some of the resources. Another thing to have in mind, is the default behavior of the gazetteer. Only entities generated by trusted sources will be included in the dictionary. That is, the below RDF is valid for them: ?entity protons:generatedBy ?trusted . ?trusted rdf:type protons:Trusted . You can add your own trusted source or use one of the already existing. You can also provide a custom query to fill the dictionary of the gazetteer. This is done by putting a text file with the query (sparql or serql) in KIM/config/query.txt . When using some ontology modeling tool (like Protege), it is enough to include the proton modules and follow the rules above to allow KIM to make a good use of the ontology. And again, all the information you need and even much more detailed is in the documentation: * http://ontotext.com/kim/doc/KimDocs-3.0-EN/ExtendInformationExtraction.html Hope this helps, Philip Alexiev Software Engineer, KIM Team From YVERMILLION at lmi.org Mon Nov 29 07:31:52 2010 From: YVERMILLION at lmi.org (VERMILLION, Bonnie) Date: Mon, 29 Nov 2010 07:31:52 -0500 Subject: [Kim-discussion] Issues with creating owl files In-Reply-To: References: Message-ID: Philip, Attached is a Word document showing what happens when Kim is run using the attached LMI.owl file build with Prot?g?. I followed the document you have referenced, but only the word 'Entity' is showing up in the KIM ontology instead of the expected Owl hierarchy. Can you tell me what I have done wrong? Thank you, Bonnie -----Original Message----- From: Philip Alexiev@ [mailto:Ontotext philip.alexiev at ontotext.com] Sent: Sunday, November 28, 2010 6:54 AM To: VERMILLION, Bonnie Cc: WILSON, Greg; borislav popov; Matthew Petrillo; mailing-list mailing-list Subject: Re: Issues with creating owl files Hi Bonnie I will try to draw the complete picture in this mail. It is perfectly true, that you can run KIM with a completely new ontology. Importing the RDF in OWLIM is only the first part of the process. After this you will have to make the resources you use for IE aware of the new ontology. For example changing the way the Gazetteer fills its dictionary, making grammars aware of the new classes (Lookup.class feature) etc. That way you will be able to extract the new entities. Extraction is one of the modules of KIM. Over that, we provide indexing and search mechanisms. Searches are accessible though the web interface and on low level though the Java API. But because the WEB UI is tightly related PROTON, you will not be able to use it. You will have to use the Java API to search for entities and documents. So using a completely new ontology is a lot of work and efforts. KIM makes it easier if you map your ontology to PROTON. That way you can reuse the already existing mechanisms and save a lot of work. Reading this resource carefully will answer most of the questions how to do that: * http://ontotext.com/kim/doc/KimDocs-3.0-EN/ExtendInformationExtraction.html The minimum requirements are: - your classes should inherit protons:Entity directly or indirectly - make your classes and properties visible by setting kimso:visibilityLevel1 - provide at least a MainAlias* to all the instances * you can use either aliases or labels to describe your entities. If you use labels, the property is protons:mainLabel . Which mechanism you use is described in KIM/config/install.properties (com.ontotext.kim.KIMConstants.ENTITY_DESCR property). It is generally a very good idea to subclass the main classes in PROTON * protont:Person * protont:Organization * protont:Location This will make them visible for some of the resources. Another thing to have in mind, is the default behavior of the gazetteer. Only entities generated by trusted sources will be included in the dictionary. That is, the below RDF is valid for them: ?entity protons:generatedBy ?trusted . ?trusted rdf:type protons:Trusted . You can add your own trusted source or use one of the already existing. You can also provide a custom query to fill the dictionary of the gazetteer. This is done by putting a text file with the query (sparql or serql) in KIM/config/query.txt . When using some ontology modeling tool (like Protege), it is enough to include the proton modules and follow the rules above to allow KIM to make a good use of the ontology. And again, all the information you need and even much more detailed is in the documentation: * http://ontotext.com/kim/doc/KimDocs-3.0-EN/ExtendInformationExtraction.html Hope this helps, Philip Alexiev Software Engineer, KIM Team -------------- next part -------------- A non-text attachment was scrubbed... Name: LMI.owl example.docx Type: application/vnd.openxmlformats-officedocument.wordprocessingml.document Size: 260235 bytes Desc: LMI.owl example.docx URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: owlim.ttl Type: application/octet-stream Size: 2197 bytes Desc: owlim.ttl URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: lmi.owl Type: application/octet-stream Size: 16178 bytes Desc: lmi.owl URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: visibility.nt Type: application/octet-stream Size: 873 bytes Desc: visibility.nt URL: From YVERMILLION at lmi.org Mon Nov 29 07:44:52 2010 From: YVERMILLION at lmi.org (VERMILLION, Bonnie) Date: Mon, 29 Nov 2010 07:44:52 -0500 Subject: [Kim-discussion] Issues with creating owl files References: Message-ID: Also, Philip - attached is the end of the log file and also the contents of the visibility file. It is pointing to an issue with what is defined in the visibility file, but the definition in the visibility file exists. Thank you, Bonnie -----Original Message----- From: VERMILLION, Bonnie Sent: Monday, November 29, 2010 7:32 AM To: 'Philip Alexiev@' Cc: WILSON, Greg; borislav popov; Matthew Petrillo; mailing-list mailing-list Subject: RE: Issues with creating owl files Philip, Attached is a Word document showing what happens when Kim is run using the attached LMI.owl file build with Prot?g?. I followed the document you have referenced, but only the word 'Entity' is showing up in the KIM ontology instead of the expected Owl hierarchy. Can you tell me what I have done wrong? Thank you, Bonnie -----Original Message----- From: Philip Alexiev@ [mailto:Ontotext philip.alexiev at ontotext.com] Sent: Sunday, November 28, 2010 6:54 AM To: VERMILLION, Bonnie Cc: WILSON, Greg; borislav popov; Matthew Petrillo; mailing-list mailing-list Subject: Re: Issues with creating owl files Hi Bonnie I will try to draw the complete picture in this mail. It is perfectly true, that you can run KIM with a completely new ontology. Importing the RDF in OWLIM is only the first part of the process. After this you will have to make the resources you use for IE aware of the new ontology. For example changing the way the Gazetteer fills its dictionary, making grammars aware of the new classes (Lookup.class feature) etc. That way you will be able to extract the new entities. Extraction is one of the modules of KIM. Over that, we provide indexing and search mechanisms. Searches are accessible though the web interface and on low level though the Java API. But because the WEB UI is tightly related PROTON, you will not be able to use it. You will have to use the Java API to search for entities and documents. So using a completely new ontology is a lot of work and efforts. KIM makes it easier if you map your ontology to PROTON. That way you can reuse the already existing mechanisms and save a lot of work. Reading this resource carefully will answer most of the questions how to do that: * http://ontotext.com/kim/doc/KimDocs-3.0-EN/ExtendInformationExtraction.html The minimum requirements are: - your classes should inherit protons:Entity directly or indirectly - make your classes and properties visible by setting kimso:visibilityLevel1 - provide at least a MainAlias* to all the instances * you can use either aliases or labels to describe your entities. If you use labels, the property is protons:mainLabel . Which mechanism you use is described in KIM/config/install.properties (com.ontotext.kim.KIMConstants.ENTITY_DESCR property). It is generally a very good idea to subclass the main classes in PROTON * protont:Person * protont:Organization * protont:Location This will make them visible for some of the resources. Another thing to have in mind, is the default behavior of the gazetteer. Only entities generated by trusted sources will be included in the dictionary. That is, the below RDF is valid for them: ?entity protons:generatedBy ?trusted . ?trusted rdf:type protons:Trusted . You can add your own trusted source or use one of the already existing. You can also provide a custom query to fill the dictionary of the gazetteer. This is done by putting a text file with the query (sparql or serql) in KIM/config/query.txt . When using some ontology modeling tool (like Protege), it is enough to include the proton modules and follow the rules above to allow KIM to make a good use of the ontology. And again, all the information you need and even much more detailed is in the documentation: * http://ontotext.com/kim/doc/KimDocs-3.0-EN/ExtendInformationExtraction.html Hope this helps, Philip Alexiev Software Engineer, KIM Team -------------- next part -------------- A non-text attachment was scrubbed... Name: error pointing to visibility.docx Type: application/vnd.openxmlformats-officedocument.wordprocessingml.document Size: 335259 bytes Desc: error pointing to visibility.docx URL: From philip.alexiev at ontotext.com Mon Nov 29 11:54:47 2010 From: philip.alexiev at ontotext.com (Philip Alexiev @ Ontotext) Date: Mon, 29 Nov 2010 18:54:47 +0200 Subject: [Kim-discussion] Issues with creating owl files In-Reply-To: References: Message-ID: <9632362C-4764-44A1-9021-09376AE68FDC@ontotext.com> Hi Bonnie, We are following the discussion and working on the issue. I suggest we continue this on personal mail to not distract the others. We should be able to resolve this in the next couple of hours. All the best, Philip On Nov 29, 2010, at 2:44 PM, VERMILLION, Bonnie wrote: > Also, Philip - attached is the end of the log file and also the contents of the visibility file. It is pointing to an issue with what is defined in the visibility file, but the definition in the visibility file exists. > > Thank you, > Bonnie > > -----Original Message----- > From: VERMILLION, Bonnie > Sent: Monday, November 29, 2010 7:32 AM > To: 'Philip Alexiev@' > Cc: WILSON, Greg; borislav popov; Matthew Petrillo; mailing-list mailing-list > Subject: RE: Issues with creating owl files > > Philip, > > Attached is a Word document showing what happens when Kim is run using the attached LMI.owl file build with Prot?g?. I followed the document you have referenced, but only the word 'Entity' is showing up in the KIM ontology instead of the expected Owl hierarchy. Can you tell me what I have done wrong? > > Thank you, > Bonnie > > > -----Original Message----- > From: Philip Alexiev@ [mailto:Ontotext philip.alexiev at ontotext.com] > Sent: Sunday, November 28, 2010 6:54 AM > To: VERMILLION, Bonnie > Cc: WILSON, Greg; borislav popov; Matthew Petrillo; mailing-list mailing-list > Subject: Re: Issues with creating owl files > > Hi Bonnie > > I will try to draw the complete picture in this mail. > > It is perfectly true, that you can run KIM with a completely new ontology. Importing the RDF in OWLIM is only the first part of the process. After this you will have to make the resources you use for IE aware of the new ontology. For example changing the way the Gazetteer fills its dictionary, making grammars aware of the new classes (Lookup.class feature) etc. That way you will be able to extract the new entities. > > Extraction is one of the modules of KIM. Over that, we provide indexing and search mechanisms. Searches are accessible though the web interface and on low level though the Java API. But because the WEB UI is tightly related PROTON, you will not be able to use it. You will have to use the Java API to search for entities and documents. > > > So using a completely new ontology is a lot of work and efforts. > > KIM makes it easier if you map your ontology to PROTON. That way you can reuse the already existing mechanisms and save a lot of work. Reading this resource carefully will answer most of the questions how to do that: > * http://ontotext.com/kim/doc/KimDocs-3.0-EN/ExtendInformationExtraction.html > > The minimum requirements are: > - your classes should inherit protons:Entity directly or indirectly > - make your classes and properties visible by setting kimso:visibilityLevel1 > - provide at least a MainAlias* to all the instances > > * you can use either aliases or labels to describe your entities. If you use labels, the property is protons:mainLabel . Which mechanism you use is described in KIM/config/install.properties (com.ontotext.kim.KIMConstants.ENTITY_DESCR property). > > It is generally a very good idea to subclass the main classes in PROTON > * protont:Person > * protont:Organization > * protont:Location > This will make them visible for some of the resources. > > Another thing to have in mind, is the default behavior of the gazetteer. Only entities generated by trusted sources will be included in the dictionary. That is, the below RDF is valid for them: > ?entity protons:generatedBy ?trusted . > ?trusted rdf:type protons:Trusted . > > You can add your own trusted source or use one of the already existing. You can also provide a custom query to fill the dictionary of the gazetteer. This is done by putting a text file with the query (sparql or serql) in KIM/config/query.txt . > > > When using some ontology modeling tool (like Protege), it is enough to include the proton modules and follow the rules above to allow KIM to make a good use of the ontology. > > And again, all the information you need and even much more detailed is in the documentation: > * http://ontotext.com/kim/doc/KimDocs-3.0-EN/ExtendInformationExtraction.html > > Hope this helps, > Philip Alexiev > Software Engineer, KIM Team > _______________________________________________ > Kim-discussion mailing list > Kim-discussion at ontotext.com > http://ontotext.com/mailman/listinfo/kim-discussion From YVERMILLION at lmi.org Mon Nov 29 12:58:59 2010 From: YVERMILLION at lmi.org (VERMILLION, Bonnie) Date: Mon, 29 Nov 2010 12:58:59 -0500 Subject: [Kim-discussion] Issues with creating owl files In-Reply-To: <9632362C-4764-44A1-9021-09376AE68FDC@ontotext.com> References: <9632362C-4764-44A1-9021-09376AE68FDC@ontotext.com> Message-ID: Philip, Okay. Thanks, By the way, I worked on the more detailed ontology and it works to a point. I need your expertise to explain why some classes are not showing up, but using the location, organization and person classes does not show results. We will work on the details together. Attached is a document for the team to show something is now working and I did not have to make any changes to the .owl file other than adding a line for proton. Thank you, Bonnie Yvonne Vermillion LMI 2000 Corporate Ridge McLean, VA 22102-7805 (571)633-7830 P Complex Problems. Practical Solutions. www.lmi.org -----Original Message----- From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at ontotext.com] Sent: Monday, November 29, 2010 11:55 AM To: VERMILLION, Bonnie Cc: Matthew Petrillo; WILSON, Greg; mailing-list mailing-list Subject: Re: [Kim-discussion] Issues with creating owl files Hi Bonnie, We are following the discussion and working on the issue. I suggest we continue this on personal mail to not distract the others. We should be able to resolve this in the next couple of hours. All the best, Philip On Nov 29, 2010, at 2:44 PM, VERMILLION, Bonnie wrote: > Also, Philip - attached is the end of the log file and also the contents of the visibility file. It is pointing to an issue with what is defined in the visibility file, but the definition in the visibility file exists. > > Thank you, > Bonnie > > -----Original Message----- > From: VERMILLION, Bonnie > Sent: Monday, November 29, 2010 7:32 AM > To: 'Philip Alexiev@' > Cc: WILSON, Greg; borislav popov; Matthew Petrillo; mailing-list mailing-list > Subject: RE: Issues with creating owl files > > Philip, > > Attached is a Word document showing what happens when Kim is run using the attached LMI.owl file build with Prot?g?. I followed the document you have referenced, but only the word 'Entity' is showing up in the KIM ontology instead of the expected Owl hierarchy. Can you tell me what I have done wrong? > > Thank you, > Bonnie > > > -----Original Message----- > From: Philip Alexiev@ [mailto:Ontotext philip.alexiev at ontotext.com] > Sent: Sunday, November 28, 2010 6:54 AM > To: VERMILLION, Bonnie > Cc: WILSON, Greg; borislav popov; Matthew Petrillo; mailing-list mailing-list > Subject: Re: Issues with creating owl files > > Hi Bonnie > > I will try to draw the complete picture in this mail. > > It is perfectly true, that you can run KIM with a completely new ontology. Importing the RDF in OWLIM is only the first part of the process. After this you will have to make the resources you use for IE aware of the new ontology. For example changing the way the Gazetteer fills its dictionary, making grammars aware of the new classes (Lookup.class feature) etc. That way you will be able to extract the new entities. > > Extraction is one of the modules of KIM. Over that, we provide indexing and search mechanisms. Searches are accessible though the web interface and on low level though the Java API. But because the WEB UI is tightly related PROTON, you will not be able to use it. You will have to use the Java API to search for entities and documents. > > > So using a completely new ontology is a lot of work and efforts. > > KIM makes it easier if you map your ontology to PROTON. That way you can reuse the already existing mechanisms and save a lot of work. Reading this resource carefully will answer most of the questions how to do that: > * http://ontotext.com/kim/doc/KimDocs-3.0-EN/ExtendInformationExtraction.html > > The minimum requirements are: > - your classes should inherit protons:Entity directly or indirectly > - make your classes and properties visible by setting kimso:visibilityLevel1 > - provide at least a MainAlias* to all the instances > > * you can use either aliases or labels to describe your entities. If you use labels, the property is protons:mainLabel . Which mechanism you use is described in KIM/config/install.properties (com.ontotext.kim.KIMConstants.ENTITY_DESCR property). > > It is generally a very good idea to subclass the main classes in PROTON > * protont:Person > * protont:Organization > * protont:Location > This will make them visible for some of the resources. > > Another thing to have in mind, is the default behavior of the gazetteer. Only entities generated by trusted sources will be included in the dictionary. That is, the below RDF is valid for them: > ?entity protons:generatedBy ?trusted . > ?trusted rdf:type protons:Trusted . > > You can add your own trusted source or use one of the already existing. You can also provide a custom query to fill the dictionary of the gazetteer. This is done by putting a text file with the query (sparql or serql) in KIM/config/query.txt . > > > When using some ontology modeling tool (like Protege), it is enough to include the proton modules and follow the rules above to allow KIM to make a good use of the ontology. > > And again, all the information you need and even much more detailed is in the documentation: > * http://ontotext.com/kim/doc/KimDocs-3.0-EN/ExtendInformationExtraction.html > > Hope this helps, > Philip Alexiev > Software Engineer, KIM Team > _______________________________________________ > Kim-discussion mailing list > Kim-discussion at ontotext.com > http://ontotext.com/mailman/listinfo/kim-discussion -------------- next part -------------- A non-text attachment was scrubbed... Name: Kim Results..docx Type: application/vnd.openxmlformats-officedocument.wordprocessingml.document Size: 728003 bytes Desc: Kim Results..docx URL: From naaman at truemeridian.com Tue Nov 30 03:56:41 2010 From: naaman at truemeridian.com (Naaman Musawwir) Date: Tue, 30 Nov 2010 13:56:41 +0500 Subject: [Kim-discussion] Help - Adding/Deleting Documents In-Reply-To: <789E0F82-7502-4671-8376-4A3CEE412C25@ontotext.com> Message-ID: <1A.D9.25366.43DB4FC4@cm-omr3> Hello Philip, thank you for guiding in this regard. One more thing I noticed is about populator application under bin/tools. We are running two instances; one for testing and other for production. I imported a set of documents from a directory into one server. It worked fine. When I changed target server (by changing KIM server host) and tried to add the same set of documents into the other server it skipped all with a message that these documents have already been processed. I had to clear populated folder to get it to work for the second server. Please check why it is happening. Also, I sent a question about adding a custom feature into documents and also sent properties file. Did you get time to have a look at that? Regards, Naaman Musawwir. _____ From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at ontotext.com] Sent: Friday, November 26, 2010 8:10 PM To: Philip Alexiev @ Ontotext Cc: Naaman Musawwir; 'mailing-list mailing-list' Subject: Re: [Kim-discussion] Help - Adding/Deleting Documents Sorry, I missed the second part of the mail. This is an example of using the Java API to search for documents: http://ontotext.com/kim/doc/KimDocs-3.0-EN/SearchForDocumentsExamples.html And you can find another useful examples in the system documentation: http://ontotext.com/kim/doc/KimDocs-3.0-EN/Examples.html hth Philip On Nov 26, 2010, at 2:58 PM, Philip Alexiev @ Ontotext wrote: Hello Naaman, My guess is that this and the previous are connected. So we will look into this interesting behavior too. Thank you for the feedback. Philip On Nov 26, 2010, at 11:58 AM, Naaman Musawwir wrote: Hello Philip, there was another message regarding search. Here it is copied I have two queries regarding document searching from the repository. 1. How to search based upon matching feature value e.g. all the documents with title matching "some title" 2. I am loading documents using DocumentQuery from DocumentRepositoryAPI. When I pass an empty query it returns 0 documents that is correct as I have deleted all the documents and there are no documents in the repository. But when I set a keyword restriction it loads all the deleted documents. Please suggest. I believe second will be fixed with the deletion issues you are working on. Please guide about the first one. Regards, Naaman Musawwir. _____ From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at ontotext.com] Sent: Friday, November 26, 2010 2:19 PM To: Naaman Musawwir Cc: mailing-list mailing-list Subject: Re: [Kim-discussion] Help - Adding/Deleting Documents Hi Naaman, We managed to reproduce the issue and are currently working on it. We will provide you a link to download the fixed version. The fix will definitely go into KIM 3.5, which is expected soon. Greetings Philip Alexiev Software Engineer, KIM Team On Nov 25, 2010, at 4:46 PM, Philip Alexiev @ Ontotext wrote: Hi Naaman, This is interesting behavior. Generally, we don't delete documents in our scenarios where we use KIM, so there is a slight possibility that this is a bug. I will try to reproduce it. Thank you for your feedback. All the best Philip Alexiev Software Engineer, KIM Team On Nov 25, 2010, at 8:51 AM, Naaman Musawwir wrote: Hello, I am using Kim 3.0 RC4 on Windows and Linux, same configuration with Lucene database setting and Java API to connect to KIM instance and carry out operations. While trying to add/delete/load documents I see some inconsistency in results and need help regarding correct use of the API. Here is what I do and get as a result: DocumentRepositoryAPI apiDR; 1. Create two documents using CorporaAPI.createDocument() and add those to document repository using apiDR.adDocument() just like given in the example. Documents added successfully. 2. Loaded documents using apiDR.getDocumentIds(new DocumentQuery()). It returned all two documents fine. I also tested using apiDR.getDocumentCount(new DocumentQuery()). It also gave correct result as two. 3. Then I deleted all the documents using apiDR.clear(DocumentRepositoryAPI.CLEAR_COMMAND_ALL);. 4. Now I retrieved documents again as step 2 above. There was no effect on the repository and same two documents were returned. Is it the correct behaviour? 5. I tried to delete the documents one by one using apiDR.deleteDocument(docID). Here are the confusions in this step a. I tried to retrieve documents using apiDR.getDocumentIds(new DocumentQuery()). Behavior is unexpected as it returned 2 documents, but no document could be loaded using apiDR.loadDocument(docID). I tried to get the count using apiDR.getDocumentCount(new DocumentQuery()). It returned 2, also. b. I shutdown KIM server and restart. Now I try to retrieve documents as step 2. Now the deletion seemed to work as the count and list count in step 2 both were 0? Please explain if it is the expected behavior. Regards, Naaman Musawwir. _______________________________________________ Kim-discussion mailing list Kim-discussion at ontotext.com http://ontotext.com/mailman/listinfo/kim-discussion _______________________________________________ Kim-discussion mailing list Kim-discussion at ontotext.com http://ontotext.com/mailman/listinfo/kim-discussion No virus found in this incoming message. Checked by AVG - www.avg.com Version: 9.0.872 / Virus Database: 271.1.1/3277 - Release Date: 11/26/10 04:47:00 _______________________________________________ Kim-discussion mailing list Kim-discussion at ontotext.com http://ontotext.com/mailman/listinfo/kim-discussion _______________________________________________ Kim-discussion mailing list Kim-discussion at ontotext.com http://ontotext.com/mailman/listinfo/kim-discussion _____ No virus found in this message. Checked by AVG - www.avg.com Version: 10.0.1170 / Virus Database: 426/3286 - Release Date: 11/28/10 No virus found in this incoming message. Checked by AVG - www.avg.com Version: 9.0.872 / Virus Database: 271.1.1/3277 - Release Date: 11/26/10 04:47:00 -------------- next part -------------- An HTML attachment was scrubbed... URL: From philip.alexiev at ontotext.com Tue Nov 30 04:27:29 2010 From: philip.alexiev at ontotext.com (Philip Alexiev @ Ontotext) Date: Tue, 30 Nov 2010 11:27:29 +0200 Subject: [Kim-discussion] Help - Adding/Deleting Documents In-Reply-To: <1A.D9.25366.43DB4FC4@cm-omr3> References: <1A.D9.25366.43DB4FC4@cm-omr3> Message-ID: <98F1C02B-109B-4585-B5FD-98CE41F73D59@ontotext.com> Hi Naaman, There is an option in the populater.xml file saying: true If set, KIM creates a list of processed files in KIM/context/default/populated/SKIPLOG.info and skips the files if you try to annotate them again. In your case populating another instance of KIM with the same files, the behavior is strange. Which makes me think, you are trying to populate the same KIM instance. Double check to see which KIM you are trying to connect to. The feature schema looks good. What is the property you are trying to set and is it in the schema ? Hth, Philip On Nov 30, 2010, at 10:56 AM, Naaman Musawwir wrote: > Hello Philip, thank you for guiding in this regard. > > One more thing I noticed is about populator application under bin/tools. We are running two instances; one for testing and other for production. I imported a set of documents from a directory into one server. It worked fine. When I changed target server (by changing KIM server host) and tried to add the same set of documents into the other server it skipped all with a message that these documents have already been processed. I had to clear populated folder to get it to work for the second server. Please check why it is happening. > > Also, I sent a question about adding a custom feature into documents and also sent properties file. Did you get time to have a look at that? > > Regards, > Naaman Musawwir. > > From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at ontotext.com] > Sent: Friday, November 26, 2010 8:10 PM > To: Philip Alexiev @ Ontotext > Cc: Naaman Musawwir; 'mailing-list mailing-list' > Subject: Re: [Kim-discussion] Help - Adding/Deleting Documents > > Sorry, I missed the second part of the mail. This is an example of using the Java API to search for documents: > > http://ontotext.com/kim/doc/KimDocs-3.0-EN/SearchForDocumentsExamples.html > > And you can find another useful examples in the system documentation: > > http://ontotext.com/kim/doc/KimDocs-3.0-EN/Examples.html > > hth > Philip > > > On Nov 26, 2010, at 2:58 PM, Philip Alexiev @ Ontotext wrote: > > > Hello Naaman, > > My guess is that this and the previous are connected. So we will look into this interesting behavior too. Thank you for the feedback. > > Philip > > > On Nov 26, 2010, at 11:58 AM, Naaman Musawwir wrote: > > > Hello Philip, there was another message regarding search. Here it is copied > > I have two queries regarding document searching from the repository. > > 1. How to search based upon matching feature value e.g. all the documents with title matching ?some title? > 2. I am loading documents using DocumentQuery from DocumentRepositoryAPI. When I pass an empty query it returns 0 documents that is correct as I have deleted all the documents and there are no documents in the repository. But when I set a keyword restriction it loads all the deleted documents. Please suggest. > > I believe second will be fixed with the deletion issues you are working on. Please guide about the first one. > > Regards, > Naaman Musawwir. > From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at ontotext.com] > Sent: Friday, November 26, 2010 2:19 PM > To: Naaman Musawwir > Cc: mailing-list mailing-list > Subject: Re: [Kim-discussion] Help - Adding/Deleting Documents > > Hi Naaman, > > We managed to reproduce the issue and are currently working on it. We will provide you a link to download the fixed version. The fix will definitely go into KIM 3.5, which is expected soon. > > Greetings > Philip Alexiev > Software Engineer, KIM Team > > On Nov 25, 2010, at 4:46 PM, Philip Alexiev @ Ontotext wrote: > > > Hi Naaman, > > This is interesting behavior. Generally, we don't delete documents in our scenarios where we use KIM, so there is a slight possibility that this is a bug. I will try to reproduce it. > > Thank you for your feedback. > > All the best > Philip Alexiev > Software Engineer, KIM Team > > > > On Nov 25, 2010, at 8:51 AM, Naaman Musawwir wrote: > > > Hello, > > I am using Kim 3.0 RC4 on Windows and Linux, same configuration with Lucene database setting and Java API to connect to KIM instance and carry out operations. While trying to add/delete/load documents I see some inconsistency in results and need help regarding correct use of the API. > > Here is what I do and get as a result: > > DocumentRepositoryAPI apiDR; > > 1. Create two documents using CorporaAPI.createDocument() and add those to document repository using apiDR.adDocument() just like given in the example. Documents added successfully. > 2. Loaded documents using apiDR.getDocumentIds(new DocumentQuery()). It returned all two documents fine. I also tested using apiDR.getDocumentCount(new DocumentQuery()). It also gave correct result as two. > 3. Then I deleted all the documents using apiDR.clear(DocumentRepositoryAPI.CLEAR_COMMAND_ALL);. > 4. Now I retrieved documents again as step 2 above. There was no effect on the repository and same two documents were returned. Is it the correct behaviour? > 5. I tried to delete the documents one by one using apiDR.deleteDocument(docID). Here are the confusions in this step > a. I tried to retrieve documents using apiDR.getDocumentIds(new DocumentQuery()). Behavior is unexpected as it returned 2 documents, but no document could be loaded using apiDR.loadDocument(docID). I tried to get the count using apiDR.getDocumentCount(new DocumentQuery()). It returned 2, also. > b. I shutdown KIM server and restart. Now I try to retrieve documents as step 2. Now the deletion seemed to work as the count and list count in step 2 both were 0? > > > Please explain if it is the expected behavior. > > Regards, > Naaman Musawwir. > > _______________________________________________ > Kim-discussion mailing list > Kim-discussion at ontotext.com > http://ontotext.com/mailman/listinfo/kim-discussion > > _______________________________________________ > Kim-discussion mailing list > Kim-discussion at ontotext.com > http://ontotext.com/mailman/listinfo/kim-discussion > > No virus found in this incoming message. > Checked by AVG - www.avg.com > Version: 9.0.872 / Virus Database: 271.1.1/3277 - Release Date: 11/26/10 04:47:00 > > _______________________________________________ > Kim-discussion mailing list > Kim-discussion at ontotext.com > http://ontotext.com/mailman/listinfo/kim-discussion > > _______________________________________________ > Kim-discussion mailing list > Kim-discussion at ontotext.com > http://ontotext.com/mailman/listinfo/kim-discussion > > No virus found in this message. > Checked by AVG - www.avg.com > Version: 10.0.1170 / Virus Database: 426/3286 - Release Date: 11/28/10 > > No virus found in this incoming message. > Checked by AVG - www.avg.com > Version: 9.0.872 / Virus Database: 271.1.1/3277 - Release Date: 11/26/10 04:47:00 > > _______________________________________________ > Kim-discussion mailing list > Kim-discussion at ontotext.com > http://ontotext.com/mailman/listinfo/kim-discussion -------------- next part -------------- An HTML attachment was scrubbed... URL: From naaman at truemeridian.com Tue Nov 30 05:36:33 2010 From: naaman at truemeridian.com (Naaman Musawwir) Date: Tue, 30 Nov 2010 15:36:33 +0500 Subject: [Kim-discussion] Help - Adding/Deleting Documents In-Reply-To: <98F1C02B-109B-4585-B5FD-98CE41F73D59@ontotext.com> Message-ID: <66.1F.12370.B94D4FC4@cm-omr6> Hello, I am using the KIM populator placed under my windows installation to load document into a Linux instance. First I loaded into Windows then changed host and tried for Linux. In this case it skips all. I closed the populator application and then started again but with same skipped result. Then I emptied the SKIPLOG and tried, this time it populated the files into Linux instance. I think skipping logic is independent of host. I am trying to add LENSID. Regards, Naaman Musawwir. _____ From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at ontotext.com] Sent: Tuesday, November 30, 2010 2:27 PM To: Naaman Musawwir Cc: 'mailing-list mailing-list' Subject: Re: [Kim-discussion] Help - Adding/Deleting Documents Hi Naaman, There is an option in the populater.xml file saying: true If set, KIM creates a list of processed files in KIM/context/default/populated/SKIPLOG.info and skips the files if you try to annotate them again. In your case populating another instance of KIM with the same files, the behavior is strange. Which makes me think, you are trying to populate the same KIM instance. Double check to see which KIM you are trying to connect to. The feature schema looks good. What is the property you are trying to set and is it in the schema ? Hth, Philip On Nov 30, 2010, at 10:56 AM, Naaman Musawwir wrote: Hello Philip, thank you for guiding in this regard. One more thing I noticed is about populator application under bin/tools. We are running two instances; one for testing and other for production. I imported a set of documents from a directory into one server. It worked fine. When I changed target server (by changing KIM server host) and tried to add the same set of documents into the other server it skipped all with a message that these documents have already been processed. I had to clear populated folder to get it to work for the second server. Please check why it is happening. Also, I sent a question about adding a custom feature into documents and also sent properties file. Did you get time to have a look at that? Regards, Naaman Musawwir. _____ From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at ontotext.com] Sent: Friday, November 26, 2010 8:10 PM To: Philip Alexiev @ Ontotext Cc: Naaman Musawwir; 'mailing-list mailing-list' Subject: Re: [Kim-discussion] Help - Adding/Deleting Documents Sorry, I missed the second part of the mail. This is an example of using the Java API to search for documents: http://ontotext.com/kim/doc/KimDocs-3.0-EN/SearchForDocumentsExamples.html And you can find another useful examples in the system documentation: http://ontotext.com/kim/doc/KimDocs-3.0-EN/Examples.html hth Philip On Nov 26, 2010, at 2:58 PM, Philip Alexiev @ Ontotext wrote: Hello Naaman, My guess is that this and the previous are connected. So we will look into this interesting behavior too. Thank you for the feedback. Philip On Nov 26, 2010, at 11:58 AM, Naaman Musawwir wrote: Hello Philip, there was another message regarding search. Here it is copied I have two queries regarding document searching from the repository. 1. How to search based upon matching feature value e.g. all the documents with title matching "some title" 2. I am loading documents using DocumentQuery from DocumentRepositoryAPI. When I pass an empty query it returns 0 documents that is correct as I have deleted all the documents and there are no documents in the repository. But when I set a keyword restriction it loads all the deleted documents. Please suggest. I believe second will be fixed with the deletion issues you are working on. Please guide about the first one. Regards, Naaman Musawwir. _____ From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at ontotext.com] Sent: Friday, November 26, 2010 2:19 PM To: Naaman Musawwir Cc: mailing-list mailing-list Subject: Re: [Kim-discussion] Help - Adding/Deleting Documents Hi Naaman, We managed to reproduce the issue and are currently working on it. We will provide you a link to download the fixed version. The fix will definitely go into KIM 3.5, which is expected soon. Greetings Philip Alexiev Software Engineer, KIM Team On Nov 25, 2010, at 4:46 PM, Philip Alexiev @ Ontotext wrote: Hi Naaman, This is interesting behavior. Generally, we don't delete documents in our scenarios where we use KIM, so there is a slight possibility that this is a bug. I will try to reproduce it. Thank you for your feedback. All the best Philip Alexiev Software Engineer, KIM Team On Nov 25, 2010, at 8:51 AM, Naaman Musawwir wrote: Hello, I am using Kim 3.0 RC4 on Windows and Linux, same configuration with Lucene database setting and Java API to connect to KIM instance and carry out operations. While trying to add/delete/load documents I see some inconsistency in results and need help regarding correct use of the API. Here is what I do and get as a result: DocumentRepositoryAPI apiDR; 1. Create two documents using CorporaAPI.createDocument() and add those to document repository using apiDR.adDocument() just like given in the example. Documents added successfully. 2. Loaded documents using apiDR.getDocumentIds(new DocumentQuery()). It returned all two documents fine. I also tested using apiDR.getDocumentCount(new DocumentQuery()). It also gave correct result as two. 3. Then I deleted all the documents using apiDR.clear(DocumentRepositoryAPI.CLEAR_COMMAND_ALL);. 4. Now I retrieved documents again as step 2 above. There was no effect on the repository and same two documents were returned. Is it the correct behaviour? 5. I tried to delete the documents one by one using apiDR.deleteDocument(docID). Here are the confusions in this step a. I tried to retrieve documents using apiDR.getDocumentIds(new DocumentQuery()). Behavior is unexpected as it returned 2 documents, but no document could be loaded using apiDR.loadDocument(docID). I tried to get the count using apiDR.getDocumentCount(new DocumentQuery()). It returned 2, also. b. I shutdown KIM server and restart. Now I try to retrieve documents as step 2. Now the deletion seemed to work as the count and list count in step 2 both were 0? Please explain if it is the expected behavior. Regards, Naaman Musawwir. _______________________________________________ Kim-discussion mailing list Kim-discussion at ontotext.com http://ontotext.com/mailman/listinfo/kim-discussion _______________________________________________ Kim-discussion mailing list Kim-discussion at ontotext.com http://ontotext.com/mailman/listinfo/kim-discussion No virus found in this incoming message. Checked by AVG - www.avg.com Version: 9.0.872 / Virus Database: 271.1.1/3277 - Release Date: 11/26/10 04:47:00 _______________________________________________ Kim-discussion mailing list Kim-discussion at ontotext.com http://ontotext.com/mailman/listinfo/kim-discussion _______________________________________________ Kim-discussion mailing list Kim-discussion at ontotext.com http://ontotext.com/mailman/listinfo/kim-discussion _____ No virus found in this message. Checked by AVG - www.avg.com Version: 10.0.1170 / Virus Database: 426/3286 - Release Date: 11/28/10 No virus found in this incoming message. Checked by AVG - www.avg.com Version: 9.0.872 / Virus Database: 271.1.1/3277 - Release Date: 11/26/10 04:47:00 _______________________________________________ Kim-discussion mailing list Kim-discussion at ontotext.com http://ontotext.com/mailman/listinfo/kim-discussion _____ No virus found in this message. Checked by AVG - www.avg.com Version: 10.0.1170 / Virus Database: 426/3288 - Release Date: 11/29/10 -------------- next part -------------- An HTML attachment was scrubbed... URL: From boyan.kukushev at ontotext.com Tue Nov 30 06:52:32 2010 From: boyan.kukushev at ontotext.com (Boyan Kukushev) Date: Tue, 30 Nov 2010 13:52:32 +0200 Subject: [Kim-discussion] Help - Document Feature Schema In-Reply-To: <1C.A2.06713.2287EEC4@cm-omr12> References: <1C.A2.06713.2287EEC4@cm-omr12> Message-ID: <201011301352.33050.boyan.kukushev@ontotext.com> Hello Naaman, Adding a custom feature to your documents is actually not a simple task to do, especially if you are trying to populate the documents using out populator tool. 1) If you are using the Java API to annotate and store documents into the KIM server, the procedure is as follows: - update the com.ontotext.kim.KIMConstants.DOCUMENT_FEAT_LIST property in kim-home/config/document.repository.properties configuration file, adding the name of your custom property to the list of properties - start the KIM server - you have to use the following (or similar) code to annotate, add the custom property value and store the document into the server: // retrieve all necessary server APIs KIMService service = GetService.from("localhost", 1099); DocumentRepositoryAPI dr = service.getDocumentRepositoryAPI(); SemanticAnnotationAPI sa = service.getSemanticAnnotationAPI(); CorporaAPI ca = service.getCorporaAPI(); // use corpora API to retrieve object of KIMDocument type // by invoking the most suitable method KIMDocument doc = ca.createDocument(new URL("someurl"), "UTF-8"); // semantically annotate the content of the document // read carefully the javadoc to understand what is happening doc = sa.execute(doc); // add your feature to the document // the features can be of any type // String is recommended Object myFeatureValue = ...; doc.putFeature("MYFEATURE", myFeatureValue); // store the document dr.addDocument(doc); For more detail on using KIM server APIs check our documentation at http://ontotext.com/kim/doc/KimDocs-3.0-EN/DevelopersGuide.html and http://nmwiki.ontotext.com/kim-javadoc/index.html 2) If you are using our populator tool, all this gets much more complex. As long as all things that the code above does happen in the populator tool JVM, you can't modify any object there. In order to be able to set your custom property, you have to add another step to the annotation process. That process is controlled by a special file: kim-home/context/default/resources/IE.gapp (by default!). This is the description of our GATE application; in short, GATE is a platform for text analysis and similar stuff, developed by our colleagues at the University of Sheffield. See http://gate.ac.uk for more info. If you are not familiar with GATE, I'm afraid it will be much harder to achieve your goal. With a few words - you have to add a new GATE processing resource to the GATE application. That processing resource would actually do the job of setting your custom property to the document. If you need more information, you can always ask us, but it is really recommended that you know how to do things with GATE. Hope this helps! Regards, Boyan Kukushev, KIM Platform developer, KIM team On Thu November 25 2010 16:48:30 Naaman Musawwir wrote: > Attached is the properties file. > > > > Regards, > > Naaman Musawwir. > > _____ > > From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at ontotext.com] > Sent: Thursday, November 25, 2010 7:07 PM > To: Naaman Musawwir > Cc: kim-discussion at ontotext.com > Subject: Re: [Kim-discussion] Help - Document Feature Schema > > > > Hi Naaman > > > > Adding your custom feature to the list is sufficient. Please send your > document.repository.properties if you still have problems with that. > > > > Greetings, > > Philip Alexiev > > Software Engineer, KIM Team > > > > On Nov 25, 2010, at 9:57 AM, Naaman Musawwir wrote: > > > > > > Hello, > > > > I want to add a few custom features to KIM documents. How should I do that? > I updated the propertycom.ontotext.kim.KIMConstants.DOCUMENT_FEAT_LIST in > conf/document.repository.properties but even after that I get the > error that > > > > Features [CUSTOM_FEATURE] are not in the feature schema. Feature schema is > currently: [SUBJECT, AUTHORS, SOURCE, LANGUAGE, DOCTYPE, KEYENTITIES, > KEYPHRASES, TIMESTAMP, URL, TITLE] > > > > What to do more in this regard? > > > > Regards, > > Naaman Musawwir. > > > > _______________________________________________ > Kim-discussion mailing list > Kim-discussion at ontotext.com > http://ontotext.com/mailman/listinfo/kim-discussion > > > > No virus found in this incoming message. > Checked by AVG - www.avg.com > Version: 9.0.872 / Virus Database: 271.1.1/3277 - Release Date: 11/25/10 > 00:34:00 > > > -- Boyan Kukushev Senior Software Engineer / Java Developer Ontotext AD @ Sirma Group Corp. From naaman at truemeridian.com Tue Nov 30 08:40:20 2010 From: naaman at truemeridian.com (Naaman Musawwir) Date: Tue, 30 Nov 2010 18:40:20 +0500 Subject: [Kim-discussion] Help - Document Feature Schema In-Reply-To: <201011301352.33050.boyan.kukushev@ontotext.com> Message-ID: <73.AA.09495.FAFF4FC4@cm-omr5> Hello, The problem I am facing is while using option 1 where we need to add a feature LENSID manually into the custom created documents. I fetched feature schema that also did not include LENSID in the list. What am I missing if just updating this list is sufficient? I followed the process below but that gives a nullpointer exception when trying to add LENSID. We have implemented a GATE plug-in with a custom IE application that is working fine. That adds NEAR_TOKENS feature automatically in the documents according tour custom logic. This works fine when we add documents using populator. Regards, Naaman Musawwir. _____ From: Boyan Kukushev [mailto:boyan.kukushev at ontotext.com] Sent: Tuesday, November 30, 2010 4:53 PM To: kim-discussion at ontotext.com Cc: Naaman Musawwir; 'Philip Alexiev @ Ontotext' Subject: Re: [Kim-discussion] Help - Document Feature Schema Hello Naaman, Adding a custom feature to your documents is actually not a simple task to do, especially if you are trying to populate the documents using out populator tool. 1) If you are using the Java API to annotate and store documents into the KIM server, the procedure is as follows: - update the com.ontotext.kim.KIMConstants.DOCUMENT_FEAT_LIST property in kim-home/config/document.repository.properties configuration file, adding the name of your custom property to the list of properties - start the KIM server - you have to use the following (or similar) code to annotate, add the custom property value and store the document into the server: // retrieve all necessary server APIs KIMService service = GetService.from("localhost", 1099); DocumentRepositoryAPI dr = service.getDocumentRepositoryAPI(); SemanticAnnotationAPI sa = service.getSemanticAnnotationAPI(); CorporaAPI ca = service.getCorporaAPI(); // use corpora API to retrieve object of KIMDocument type // by invoking the most suitable method KIMDocument doc = ca.createDocument(new URL("someurl"), "UTF-8"); // semantically annotate the content of the document // read carefully the javadoc to understand what is happening doc = sa.execute(doc); // add your feature to the document // the features can be of any type // String is recommended Object myFeatureValue = ...; doc.putFeature("MYFEATURE", myFeatureValue); // store the document dr.addDocument(doc); For more detail on using KIM server APIs check our documentation at http://ontotext.com/kim/doc/KimDocs-3.0-EN/DevelopersGuide.html and http://nmwiki.ontotext.com/kim-javadoc/index.html 2) If you are using our populator tool, all this gets much more complex. As long as all things that the code above does happen in the populator tool JVM, you can't modify any object there. In order to be able to set your custom property, you have to add another step to the annotation process. That process is controlled by a special file: kim-home/context/default/resources/IE.gapp (by default!). This is the description of our GATE application; in short, GATE is a platform for text analysis and similar stuff, developed by our colleagues at the University of Sheffield. See http://gate.ac.uk for more info. If you are not familiar with GATE, I'm afraid it will be much harder to achieve your goal. With a few words - you have to add a new GATE processing resource to the GATE application. That processing resource would actually do the job of setting your custom property to the document. If you need more information, you can always ask us, but it is really recommended that you know how to do things with GATE. Hope this helps! Regards, Boyan Kukushev, KIM Platform developer, KIM team On Thu November 25 2010 16:48:30 Naaman Musawwir wrote: > Attached is the properties file. > > > > Regards, > > Naaman Musawwir. > > _____ > > From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at ontotext.com] > Sent: Thursday, November 25, 2010 7:07 PM > To: Naaman Musawwir > Cc: kim-discussion at ontotext.com > Subject: Re: [Kim-discussion] Help - Document Feature Schema > > > > Hi Naaman > > > > Adding your custom feature to the list is sufficient. Please send your > document.repository.properties if you still have problems with that. > > > > Greetings, > > Philip Alexiev > > Software Engineer, KIM Team > > > > On Nov 25, 2010, at 9:57 AM, Naaman Musawwir wrote: > > > > > > Hello, > > > > I want to add a few custom features to KIM documents. How should I do that? > I updated the propertycom.ontotext.kim.KIMConstants.DOCUMENT_FEAT_LIST in > conf/document.repository.properties but even after that I get the > error that > > > > Features [CUSTOM_FEATURE] are not in the feature schema. Feature schema is > currently: [SUBJECT, AUTHORS, SOURCE, LANGUAGE, DOCTYPE, KEYENTITIES, > KEYPHRASES, TIMESTAMP, URL, TITLE] > > > > What to do more in this regard? > > > > Regards, > > Naaman Musawwir. > > > > _______________________________________________ > Kim-discussion mailing list > Kim-discussion at ontotext.com > http://ontotext.com/mailman/listinfo/kim-discussion > > > > No virus found in this incoming message. > Checked by AVG - www.avg.com > Version: 9.0.872 / Virus Database: 271.1.1/3277 - Release Date: 11/25/10 > 00:34:00 > > > -- Boyan Kukushev Senior Software Engineer / Java Developer Ontotext AD @ Sirma Group Corp. _____ No virus found in this message. Checked by AVG - www.avg.com Version: 10.0.1170 / Virus Database: 426/3288 - Release Date: 11/29/10 -------------- next part -------------- An HTML attachment was scrubbed... URL: From philip.alexiev at ontotext.com Tue Nov 30 09:02:33 2010 From: philip.alexiev at ontotext.com (Philip Alexiev) Date: Tue, 30 Nov 2010 16:02:33 +0200 Subject: [Kim-discussion] Help - Document Feature Schema In-Reply-To: <73.AA.09495.FAFF4FC4@cm-omr5> References: <73.AA.09495.FAFF4FC4@cm-omr5> Message-ID: <4CF503F9.9090202@ontotext.com> Could you describe exactly how you are trying to add your custom feature to the document ? Please also provide the output of the tools (and KIM) you are using. Also you may set the log level to DEBUG for more verbose output. In config/log.prop change: log4j.rootLogger=INFO, aAll, cAll to log4j.rootLogger=DEBUG, aAll, cAll Philip On 11/30/2010 03:40 PM, Naaman Musawwir wrote: > > Hello, > > The problem I am facing is while using option 1 where we need to add a > feature LENSID manually into the custom created documents. I fetched > feature schema that also did not include LENSID in the list. What am I > missing if just updating this list is sufficient? I followed the > process below but that gives a nullpointer exception when trying to > add LENSID. > > We have implemented a GATE plug-in with a custom IE application that > is working fine. That adds NEAR_TOKENS feature automatically in the > documents according tour custom logic. This works fine when we add > documents using populator. > > Regards, > > Naaman Musawwir. > > * From: * Boyan Kukushev [mailto:boyan.kukushev at ontotext.com] > *Sent:* Tuesday, November 30, 2010 4:53 PM > *To:* kim-discussion at ontotext.com > *Cc:* Naaman Musawwir; 'Philip Alexiev @ Ontotext' > *Subject:* Re: [Kim-discussion] Help - Document Feature Schema > > Hello Naaman, > > Adding a custom feature to your documents is actually not a simple > task to do, > especially if you are trying to populate the documents using out populator > tool. > > 1) If you are using the Java API to annotate and store documents into > the KIM > server, the procedure is as follows: > > - update the com.ontotext.kim.KIMConstants.DOCUMENT_FEAT_LIST > property in > kim-home/config/document.repository.properties configuration file, > adding the > name of your custom property to the list of properties > - start the KIM server > - you have to use the following (or similar) code to annotate, add > the custom > property value and store the document into the server: > > // retrieve all necessary server APIs > KIMService service = GetService.from("localhost", 1099); > DocumentRepositoryAPI dr = service.getDocumentRepositoryAPI(); > SemanticAnnotationAPI sa = service.getSemanticAnnotationAPI(); > CorporaAPI ca = service.getCorporaAPI(); > > // use corpora API to retrieve object of KIMDocument type > // by invoking the most suitable method > KIMDocument doc = ca.createDocument(new URL("someurl"), "UTF-8"); > > // semantically annotate the content of the document > // read carefully the javadoc to understand what is happening > doc = sa.execute(doc); > > // add your feature to the document > // the features can be of any type > // String is recommended > Object myFeatureValue = ...; > doc.putFeature("MYFEATURE", myFeatureValue); > > // store the document > dr.addDocument(doc); > > For more detail on using KIM server APIs check our documentation at > http://ontotext.com/kim/doc/KimDocs-3.0-EN/DevelopersGuide.html and > http://nmwiki.ontotext.com/kim-javadoc/index.html > > 2) If you are using our populator tool, all this gets much more > complex. As > long as all things that the code above does happen in the populator > tool JVM, > you can't modify any object there. In order to be able to set your custom > property, you have to add another step to the annotation process. That > process is controlled by a special file: > kim-home/context/default/resources/IE.gapp (by default!). > > This is the description of our GATE application; in short, GATE is a > platform > for text analysis and similar stuff, developed by our colleagues at the > University of Sheffield . See http://gate.ac.uk for more info. If you > are not > familiar with GATE, I'm afraid it will be much harder to achieve your > goal. > > With a few words - you have to add a new GATE processing resource to > the GATE > application. That processing resource would actually do the job of setting > your custom property to the document. If you need more information, > you can > always ask us, but it is really recommended that you know how to do things > with GATE. > > Hope this helps! > > Regards, > Boyan Kukushev, > KIM Platform developer, KIM team > > > On Thu November 25 2010 16:48:30 Naaman Musawwir wrote: > > Attached is the properties file. > > > > > > > > Regards, > > > > Naaman Musawwir. > > > > _____ > > > > From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at ontotext.com] > > Sent: Thursday, November 25, 2010 7:07 PM > > To: Naaman Musawwir > > Cc: kim-discussion at ontotext.com > > Subject: Re: [Kim-discussion] Help - Document Feature Schema > > > > > > > > Hi Naaman > > > > > > > > Adding your custom feature to the list is sufficient. Please send your > > document.repository.properties if you still have problems with that. > > > > > > > > Greetings, > > > > Philip Alexiev > > > > Software Engineer, KIM Team > > > > > > > > On Nov 25, 2010, at 9:57 AM, Naaman Musawwir wrote: > > > > > > > > > > > > Hello, > > > > > > > > I want to add a few custom features to KIM documents. How should I do > that? > > I updated the propertycom.ontotext.kim.KIMConstants.DOCUMENT_FEAT_LIST in > > conf/document.repository.properties but even after that I > get the > > error that > > > > > > > > Features [CUSTOM_FEATURE] are not in the feature schema. Feature > schema is > > currently: [SUBJECT, AUTHORS, SOURCE, LANGUAGE, DOCTYPE, KEYENTITIES, > > KEYPHRASES, TIMESTAMP, URL, TITLE] > > > > > > > > What to do more in this regard? > > > > > > > > Regards, > > > > Naaman Musawwir. > > > > > > > > _______________________________________________ > > Kim-discussion mailing list > > Kim-discussion at ontotext.com > > http://ontotext.com/mailman/listinfo/kim-discussion > > > > > > > > No virus found in this incoming message. > > Checked by AVG - www.avg.com > > Version: 9.0.872 / Virus Database: 271.1.1/3277 - Release Date: 11/25/10 > > 00:34:00 > > > > > > > > > > -- > Boyan Kukushev > Senior Software Engineer / Java Developer > Ontotext AD @ Sirma Group Corp. > > No virus found in this message. > Checked by AVG - www.avg.com > Version: 10.0.1170 / Virus Database: 426/3288 - Release Date: 11/29/10 > -- Philip Alexiev Software Engineer Ontotext AD -------------- next part -------------- An HTML attachment was scrubbed... URL: From naaman at truemeridian.com Tue Nov 30 09:10:19 2010 From: naaman at truemeridian.com (Naaman Musawwir) Date: Tue, 30 Nov 2010 19:10:19 +0500 Subject: [Kim-discussion] Help - Document Feature Schema In-Reply-To: <4CF503F9.9090202@ontotext.com> Message-ID: <95.66.04172.6B605FC4@cm-omr13> Here is the code I wrote to test document addition: KIMService serviceKim = GetService.from("192.168.11.11"); CorporaAPI apiCorpora = serviceKim.getCorporaAPI(); SemanticAnnotationAPI apiSemAnn = serviceKim.getSemanticAnnotationAPI(); DocumentRepositoryAPI apiDR = serviceKim.getDocumentRepositoryAPI(); String uri = "http://www.ontotext.com/kim"; URL url = new URL(uri); KIMDocument kdocFromUrl = apiCorpora.createDocument(url, "UTF-8"); kdocFromUrl.putFeature(KIMDocument.DOCUMENT_FEATURE_TITLE, "Onto"); kdocFromUrl.putFeature(KIMDocument.DOCUMENT_FEATURE_SOURCE, "Onto Site"); kdocFromUrl.putFeature(KIMDocument.DOCUMENT_FEATURE_AUTHORS, "Ontotext"); kdocFromUrl.putFeature(KIMDocument.DOCUMENT_FEATURE_URL, uri); kdocFromUrl.putFeature("LENSID", 2); KIMDocument kdocFromUrlAnn = apiSemAnn.execute(kdocFromUrl); apiDR.addDocument(kdocFromUrlAnn); It gives error at kdocFromUrl.putFeature("LENSID", 2). Regards, Naaman Musawwir. _____ From: Philip Alexiev [mailto:philip.alexiev at ontotext.com] Sent: Tuesday, November 30, 2010 7:03 PM To: Naaman Musawwir Cc: kim-discussion at ontotext.com Subject: Re: [Kim-discussion] Help - Document Feature Schema Could you describe exactly how you are trying to add your custom feature to the document ? Please also provide the output of the tools (and KIM) you are using. Also you may set the log level to DEBUG for more verbose output. In config/log.prop change: log4j.rootLogger=INFO, aAll, cAll to log4j.rootLogger=DEBUG, aAll, cAll Philip On 11/30/2010 03:40 PM, Naaman Musawwir wrote: Hello, The problem I am facing is while using option 1 where we need to add a feature LENSID manually into the custom created documents. I fetched feature schema that also did not include LENSID in the list. What am I missing if just updating this list is sufficient? I followed the process below but that gives a nullpointer exception when trying to add LENSID. We have implemented a GATE plug-in with a custom IE application that is working fine. That adds NEAR_TOKENS feature automatically in the documents according tour custom logic. This works fine when we add documents using populator. Regards, Naaman Musawwir. From: Boyan Kukushev [mailto:boyan.kukushev at ontotext.com] Sent: Tuesday, November 30, 2010 4:53 PM To: kim-discussion at ontotext.com Cc: Naaman Musawwir; 'Philip Alexiev @ Ontotext' Subject: Re: [Kim-discussion] Help - Document Feature Schema Hello Naaman, Adding a custom feature to your documents is actually not a simple task to do, especially if you are trying to populate the documents using out populator tool. 1) If you are using the Java API to annotate and store documents into the KIM server, the procedure is as follows: - update the com.ontotext.kim.KIMConstants.DOCUMENT_FEAT_LIST property in kim-home/config/document.repository.properties configuration file, adding the name of your custom property to the list of properties - start the KIM server - you have to use the following (or similar) code to annotate, add the custom property value and store the document into the server: // retrieve all necessary server APIs KIMService service = GetService.from("localhost", 1099); DocumentRepositoryAPI dr = service.getDocumentRepositoryAPI(); SemanticAnnotationAPI sa = service.getSemanticAnnotationAPI(); CorporaAPI ca = service.getCorporaAPI(); // use corpora API to retrieve object of KIMDocument type // by invoking the most suitable method KIMDocument doc = ca.createDocument(new URL("someurl"), "UTF-8"); // semantically annotate the content of the document // read carefully the javadoc to understand what is happening doc = sa.execute(doc); // add your feature to the document // the features can be of any type // String is recommended Object myFeatureValue = ...; doc.putFeature("MYFEATURE", myFeatureValue); // store the document dr.addDocument(doc); For more detail on using KIM server APIs check our documentation at http://ontotext.com/kim/doc/KimDocs-3.0-EN/DevelopersGuide.html and http://nmwiki.ontotext.com/kim-javadoc/index.html 2) If you are using our populator tool, all this gets much more complex. As long as all things that the code above does happen in the populator tool JVM, you can't modify any object there. In order to be able to set your custom property, you have to add another step to the annotation process. That process is controlled by a special file: kim-home/context/default/resources/IE.gapp (by default!). This is the description of our GATE application; in short, GATE is a platform for text analysis and similar stuff, developed by our colleagues at the University of Sheffield . See http://gate.ac.uk for more info. If you are not familiar with GATE, I'm afraid it will be much harder to achieve your goal. With a few words - you have to add a new GATE processing resource to the GATE application. That processing resource would actually do the job of setting your custom property to the document. If you need more information, you can always ask us, but it is really recommended that you know how to do things with GATE. Hope this helps! Regards, Boyan Kukushev, KIM Platform developer, KIM team On Thu November 25 2010 16:48:30 Naaman Musawwir wrote: > Attached is the properties file. > > > > Regards, > > Naaman Musawwir. > > _____ > > From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at ontotext.com] > Sent: Thursday, November 25, 2010 7:07 PM > To: Naaman Musawwir > Cc: kim-discussion at ontotext.com > Subject: Re: [Kim-discussion] Help - Document Feature Schema > > > > Hi Naaman > > > > Adding your custom feature to the list is sufficient. Please send your > document.repository.properties if you still have problems with that. > > > > Greetings, > > Philip Alexiev > > Software Engineer, KIM Team > > > > On Nov 25, 2010, at 9:57 AM, Naaman Musawwir wrote: > > > > > > Hello, > > > > I want to add a few custom features to KIM documents. How should I do that? > I updated the propertycom.ontotext.kim.KIMConstants.DOCUMENT_FEAT_LIST in > conf/document.repository.properties but even after that I get the > error that > > > > Features [CUSTOM_FEATURE] are not in the feature schema. Feature schema is > currently: [SUBJECT, AUTHORS, SOURCE, LANGUAGE, DOCTYPE, KEYENTITIES, > KEYPHRASES, TIMESTAMP, URL, TITLE] > > > > What to do more in this regard? > > > > Regards, > > Naaman Musawwir. > > > > _______________________________________________ > Kim-discussion mailing list > Kim-discussion at ontotext.com > http://ontotext.com/mailman/listinfo/kim-discussion > > > > No virus found in this incoming message. > Checked by AVG - www.avg.com > Version: 9.0.872 / Virus Database: 271.1.1/3277 - Release Date: 11/25/10 > 00:34:00 > > > -- Boyan Kukushev Senior Software Engineer / Java Developer Ontotext AD @ Sirma Group Corp. No virus found in this message. Checked by AVG - www.avg.com Version: 10.0.1170 / Virus Database: 426/3288 - Release Date: 11/29/10 -- Philip Alexiev Software Engineer Ontotext AD _____ No virus found in this message. Checked by AVG - www.avg.com Version: 10.0.1170 / Virus Database: 426/3288 - Release Date: 11/29/10 -------------- next part -------------- An HTML attachment was scrubbed... URL: From naaman at truemeridian.com Tue Nov 30 09:26:27 2010 From: naaman at truemeridian.com (Naaman Musawwir) Date: Tue, 30 Nov 2010 19:26:27 +0500 Subject: [Kim-discussion] Help - Document Feature Schema In-Reply-To: <4CF503F9.9090202@ontotext.com> Message-ID: Here is output of KIM. Regards, Naaman Musawwir. _____ From: Philip Alexiev [mailto:philip.alexiev at ontotext.com] Sent: Tuesday, November 30, 2010 7:03 PM To: Naaman Musawwir Cc: kim-discussion at ontotext.com Subject: Re: [Kim-discussion] Help - Document Feature Schema Could you describe exactly how you are trying to add your custom feature to the document ? Please also provide the output of the tools (and KIM) you are using. Also you may set the log level to DEBUG for more verbose output. In config/log.prop change: log4j.rootLogger=INFO, aAll, cAll to log4j.rootLogger=DEBUG, aAll, cAll Philip On 11/30/2010 03:40 PM, Naaman Musawwir wrote: Hello, The problem I am facing is while using option 1 where we need to add a feature LENSID manually into the custom created documents. I fetched feature schema that also did not include LENSID in the list. What am I missing if just updating this list is sufficient? I followed the process below but that gives a nullpointer exception when trying to add LENSID. We have implemented a GATE plug-in with a custom IE application that is working fine. That adds NEAR_TOKENS feature automatically in the documents according tour custom logic. This works fine when we add documents using populator. Regards, Naaman Musawwir. From: Boyan Kukushev [mailto:boyan.kukushev at ontotext.com] Sent: Tuesday, November 30, 2010 4:53 PM To: kim-discussion at ontotext.com Cc: Naaman Musawwir; 'Philip Alexiev @ Ontotext' Subject: Re: [Kim-discussion] Help - Document Feature Schema Hello Naaman, Adding a custom feature to your documents is actually not a simple task to do, especially if you are trying to populate the documents using out populator tool. 1) If you are using the Java API to annotate and store documents into the KIM server, the procedure is as follows: - update the com.ontotext.kim.KIMConstants.DOCUMENT_FEAT_LIST property in kim-home/config/document.repository.properties configuration file, adding the name of your custom property to the list of properties - start the KIM server - you have to use the following (or similar) code to annotate, add the custom property value and store the document into the server: // retrieve all necessary server APIs KIMService service = GetService.from("localhost", 1099); DocumentRepositoryAPI dr = service.getDocumentRepositoryAPI(); SemanticAnnotationAPI sa = service.getSemanticAnnotationAPI(); CorporaAPI ca = service.getCorporaAPI(); // use corpora API to retrieve object of KIMDocument type // by invoking the most suitable method KIMDocument doc = ca.createDocument(new URL("someurl"), "UTF-8"); // semantically annotate the content of the document // read carefully the javadoc to understand what is happening doc = sa.execute(doc); // add your feature to the document // the features can be of any type // String is recommended Object myFeatureValue = ...; doc.putFeature("MYFEATURE", myFeatureValue); // store the document dr.addDocument(doc); For more detail on using KIM server APIs check our documentation at http://ontotext.com/kim/doc/KimDocs-3.0-EN/DevelopersGuide.html and http://nmwiki.ontotext.com/kim-javadoc/index.html 2) If you are using our populator tool, all this gets much more complex. As long as all things that the code above does happen in the populator tool JVM, you can't modify any object there. In order to be able to set your custom property, you have to add another step to the annotation process. That process is controlled by a special file: kim-home/context/default/resources/IE.gapp (by default!). This is the description of our GATE application; in short, GATE is a platform for text analysis and similar stuff, developed by our colleagues at the University of Sheffield . See http://gate.ac.uk for more info. If you are not familiar with GATE, I'm afraid it will be much harder to achieve your goal. With a few words - you have to add a new GATE processing resource to the GATE application. That processing resource would actually do the job of setting your custom property to the document. If you need more information, you can always ask us, but it is really recommended that you know how to do things with GATE. Hope this helps! Regards, Boyan Kukushev, KIM Platform developer, KIM team On Thu November 25 2010 16:48:30 Naaman Musawwir wrote: > Attached is the properties file. > > > > Regards, > > Naaman Musawwir. > > _____ > > From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at ontotext.com] > Sent: Thursday, November 25, 2010 7:07 PM > To: Naaman Musawwir > Cc: kim-discussion at ontotext.com > Subject: Re: [Kim-discussion] Help - Document Feature Schema > > > > Hi Naaman > > > > Adding your custom feature to the list is sufficient. Please send your > document.repository.properties if you still have problems with that. > > > > Greetings, > > Philip Alexiev > > Software Engineer, KIM Team > > > > On Nov 25, 2010, at 9:57 AM, Naaman Musawwir wrote: > > > > > > Hello, > > > > I want to add a few custom features to KIM documents. How should I do that? > I updated the propertycom.ontotext.kim.KIMConstants.DOCUMENT_FEAT_LIST in > conf/document.repository.properties but even after that I get the > error that > > > > Features [CUSTOM_FEATURE] are not in the feature schema. Feature schema is > currently: [SUBJECT, AUTHORS, SOURCE, LANGUAGE, DOCTYPE, KEYENTITIES, > KEYPHRASES, TIMESTAMP, URL, TITLE] > > > > What to do more in this regard? > > > > Regards, > > Naaman Musawwir. > > > > _______________________________________________ > Kim-discussion mailing list > Kim-discussion at ontotext.com > http://ontotext.com/mailman/listinfo/kim-discussion > > > > No virus found in this incoming message. > Checked by AVG - www.avg.com > Version: 9.0.872 / Virus Database: 271.1.1/3277 - Release Date: 11/25/10 > 00:34:00 > > > -- Boyan Kukushev Senior Software Engineer / Java Developer Ontotext AD @ Sirma Group Corp. No virus found in this message. Checked by AVG - www.avg.com Version: 10.0.1170 / Virus Database: 426/3288 - Release Date: 11/29/10 -- Philip Alexiev Software Engineer Ontotext AD _____ No virus found in this message. Checked by AVG - www.avg.com Version: 10.0.1170 / Virus Database: 426/3288 - Release Date: 11/29/10 -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: All.zip Type: application/x-zip-compressed Size: 48044 bytes Desc: not available URL: From boyan.kukushev at ontotext.com Tue Nov 30 10:13:36 2010 From: boyan.kukushev at ontotext.com (Boyan Kukushev) Date: Tue, 30 Nov 2010 17:13:36 +0200 Subject: [Kim-discussion] Help - Document Feature Schema In-Reply-To: References: Message-ID: <201011301713.36574.boyan.kukushev@ontotext.com> Hello, I tried your code - there were no exceptions for me and that makes things very strange. I am not able to see what could be null at this point - obviously, it is neither the initial KIM document, nor its feature map. Only possible (but quite improbable) reason could be that the primitive int value (2) you are trying to set as feature value is not auto-boxed to Integer. Try setting the value as an Integer object: kdocFromUrl.putFeature("LENSID", new Integer(2)); Also, information on the java distribution you are using may be helpful. Now on your base problem - adding custom feature to the document - well, IMO you have not restarted the KIM server after the property value change. KIM configuration files are not tracked for changes while the server is running - this might be the thing that have confused you. Stop and start the KIM server, then try adding the document again. Regards, Boyan On Tue November 30 2010 16:26:27 Naaman Musawwir wrote: > Here is output of KIM. > > > > Regards, > > Naaman Musawwir. > > _____ > > From: Philip Alexiev [mailto:philip.alexiev at ontotext.com] > Sent: Tuesday, November 30, 2010 7:03 PM > To: Naaman Musawwir > Cc: kim-discussion at ontotext.com > Subject: Re: [Kim-discussion] Help - Document Feature Schema > > > > Could you describe exactly how you are trying to add your custom feature to > the document ? Please also provide the output of the tools (and KIM) you > are using. Also you may set the log level to DEBUG for more verbose output. > In config/log.prop change: > log4j.rootLogger=INFO, aAll, cAll > to > log4j.rootLogger=DEBUG, aAll, cAll > > Philip > > On 11/30/2010 03:40 PM, Naaman Musawwir wrote: > > > Hello, > > > > The problem I am facing is while using option 1 where we need to add a > feature LENSID manually into the custom created documents. I fetched feature > schema that also did not include LENSID in the list. What am I missing if > just updating this list is sufficient? I followed the process below but that > gives a nullpointer exception when trying to add LENSID. > > > > We have implemented a GATE plug-in with a custom IE application that is > working fine. That adds NEAR_TOKENS feature automatically in the documents > according tour custom logic. This works fine when we add documents using > populator. > > > > Regards, > > Naaman Musawwir. > > From: Boyan Kukushev [mailto:boyan.kukushev at ontotext.com] > Sent: Tuesday, November 30, 2010 4:53 PM > To: kim-discussion at ontotext.com > Cc: Naaman Musawwir; 'Philip Alexiev @ Ontotext' > Subject: Re: [Kim-discussion] Help - Document Feature Schema > > > > Hello Naaman, > > Adding a custom feature to your documents is actually not a simple task to > do, > especially if you are trying to populate the documents using out populator > tool. > > 1) If you are using the Java API to annotate and store documents into the > KIM > server, the procedure is as follows: > > - update the com.ontotext.kim.KIMConstants.DOCUMENT_FEAT_LIST property > in > kim-home/config/document.repository.properties configuration file, adding > the > name of your custom property to the list of properties > - start the KIM server > - you have to use the following (or similar) code to annotate, add the > custom > property value and store the document into the server: > > // retrieve all necessary server APIs > KIMService service = GetService.from("localhost", 1099); > DocumentRepositoryAPI dr = service.getDocumentRepositoryAPI(); > SemanticAnnotationAPI sa = service.getSemanticAnnotationAPI(); > CorporaAPI ca = service.getCorporaAPI(); > > // use corpora API to retrieve object of KIMDocument type > // by invoking the most suitable method > KIMDocument doc = ca.createDocument(new URL("someurl"), "UTF-8"); > > // semantically annotate the content of the document > // read carefully the javadoc to understand what is happening > doc = sa.execute(doc); > > // add your feature to the document > // the features can be of any type > // String is recommended > Object myFeatureValue = ...; > doc.putFeature("MYFEATURE", myFeatureValue); > > // store the document > dr.addDocument(doc); > > For more detail on using KIM server APIs check our documentation at > http://ontotext.com/kim/doc/KimDocs-3.0-EN/DevelopersGuide.html and > http://nmwiki.ontotext.com/kim-javadoc/index.html > > 2) If you are using our populator tool, all this gets much more complex. As > long as all things that the code above does happen in the populator tool > JVM, > you can't modify any object there. In order to be able to set your custom > property, you have to add another step to the annotation process. That > process is controlled by a special file: > kim-home/context/default/resources/IE.gapp (by default!). > > This is the description of our GATE application; in short, GATE is a > platform > for text analysis and similar stuff, developed by our colleagues at the > University of Sheffield . See http://gate.ac.uk for more info. If you are > not > familiar with GATE, I'm afraid it will be much harder to achieve your goal. > > With a few words - you have to add a new GATE processing resource to the > GATE > application. That processing resource would actually do the job of setting > your custom property to the document. If you need more information, you can > always ask us, but it is really recommended that you know how to do things > with GATE. > > Hope this helps! > > Regards, > Boyan Kukushev, > KIM Platform developer, KIM team > > > On Thu November 25 2010 16:48:30 Naaman Musawwir wrote: > > Attached is the properties file. > > > > > > > > Regards, > > > > Naaman Musawwir. > > > > _____ > > > > From: Philip Alexiev @ Ontotext [mailto:philip.alexiev at ontotext.com] > > Sent: Thursday, November 25, 2010 7:07 PM > > To: Naaman Musawwir > > Cc: kim-discussion at ontotext.com > > Subject: Re: [Kim-discussion] Help - Document Feature Schema > > > > > > > > Hi Naaman > > > > > > > > Adding your custom feature to the list is sufficient. Please send your > > document.repository.properties if you still have problems with that. > > > > > > > > Greetings, > > > > Philip Alexiev > > > > Software Engineer, KIM Team > > > > > > > > On Nov 25, 2010, at 9:57 AM, Naaman Musawwir wrote: > > > > > > > > > > > > Hello, > > > > > > > > I want to add a few custom features to KIM documents. How should I do > that? > > I updated the propertycom.ontotext.kim.KIMConstants.DOCUMENT_FEAT_LIST in > > conf/document.repository.properties but even after that I get > the > > error that > > > > > > > > Features [CUSTOM_FEATURE] are not in the feature schema. Feature schema is > > currently: [SUBJECT, AUTHORS, SOURCE, LANGUAGE, DOCTYPE, KEYENTITIES, > > KEYPHRASES, TIMESTAMP, URL, TITLE] > > > > > > > > What to do more in this regard? > > > > > > > > Regards, > > > > Naaman Musawwir. > > > > > > > > _______________________________________________ > > Kim-discussion mailing list > > Kim-discussion at ontotext.com > > http://ontotext.com/mailman/listinfo/kim-discussion > > > > > > > > No virus found in this incoming message. > > Checked by AVG - www.avg.com > > Version: 9.0.872 / Virus Database: 271.1.1/3277 - Release Date: 11/25/10 > > 00:34:00 > > > > > > > > > > -- > Boyan Kukushev > Senior Software Engineer / Java Developer > Ontotext AD @ Sirma Group Corp. > > No virus found in this message. > Checked by AVG - www.avg.com > Version: 10.0.1170 / Virus Database: 426/3288 - Release Date: 11/29/10 > > > > > > -- Boyan Kukushev Senior Software Engineer / Java Developer Ontotext AD @ Sirma Group Corp.