{"id":700,"date":"2004-10-07T08:55:04","date_gmt":"2004-10-07T08:55:04","guid":{"rendered":"http:\/\/beta.robertprice.co.uk\/robblog\/2004\/10\/parsing_rdf_in_perl_with_rdf_core-shtml\/"},"modified":"2004-10-07T08:55:04","modified_gmt":"2004-10-07T08:55:04","slug":"parsing_rdf_in_perl_with_rdf_core-shtml","status":"publish","type":"post","link":"https:\/\/www.robertprice.co.uk\/robblog\/parsing_rdf_in_perl_with_rdf_core-shtml\/","title":{"rendered":"Parsing RDF In Perl With RDF::Core"},"content":{"rendered":"

\nIt is often said that parsing RDF<\/acronym> files is hard. It’s not. What most people really find hard is turning the RDF\/XML into a series of triples and extracting data from them.\n<\/p>\n

\nWhen stored in RDF\/XML, triples can be written in a variety of various ways, but still mean the same thing. This means using an XML parser may not always give you the same results. To solve this we use an RDF parser to get the triples for us. An RDF parser is usually built on top of an existing XML parser but with enough logic to know how to turn the data contained in an XML file into a list of triples correctly.\n<\/p>\n

\nThere are various RDF parsers for Perl<\/a>. These include RDF::Core<\/a>, RDF::Simple<\/a>, RDF::Redland<\/a> and several others.\n<\/p>\n

\nParsing is all well and good, each one of the above can give us a list of triples. What we really need is a way to query the data to extract the data we need.\n<\/p>\n

\nIn this article I’m going to use RDF::Core.\n<\/p>\n

\nRDF::Core is a bit of a beast and doesn’t have a very Perl’ish interface.\n<\/p>\n

\nI’m going to parse my FOAF file<\/a> and extract a list of my friends FOAF files.\n<\/p>\n

\nFOAF means Friend of a Friend and it allows you to describe relationships between people in a machine readable RDF format. Details of it can be found on the FOAF project website<\/a>.\n<\/p>\n

\nSo how do we do this using RDF::Core?\n<\/p>\n

\nFirstly we need to set it up. We’ll need to a model and define the storage method we want. RDF::Core allows data to be stored in a database, DB_File or memory. In this example I’ll just use memory as it’s the simplest.\n<\/p>\n

my $store = RDF::Core::Storage::Memory->new;
\nmy $model = RDF::Core::Model->new(Storage => $store;
\n<\/code><\/div>\n

\nNow we need create a parser, and parse the the RDF file. To do this we pass in our Model, BaseURI, Source, SourceType of the RDF data. In this example I’m going to use the file foaf.rdf<\/var> so I’ll have to set the SourceType<\/var> parameter to file<\/var>. The BaseURI<\/var> is used to resolve relative URI’s, so we’ll use the FOAF namespace URI http:\/\/xmlns.com\/foaf\/0.1\/<\/var> for this. Once we have our parser built, we just call it’s parse<\/code> method.\n<\/p>\n

my $parser = RDF::Core::Model::Parser->new(
\nModel => $model,
\nBaseURI => 'http:\/\/xmlns.com\/foaf\/0.1\/',
\nSource => '.\/foaf.rdf',
\nSourceType => 'file'
\n);
\n$parser->parse;
\n<\/code><\/div>\n

\nWe now have a list of triples in our memory store. That’s great, but we want to find out if any of my friends have FOAF files.\n<\/p>\n

\nIf you look at the example in my previous article on RDF triples<\/a>, you’ll know that my friends details are referenced by the #knows<\/var> predicate. So we need to find out all the triples that have that as a predicate and get their objects. Once we have these, we can look for all triples that have this as their subject and also have the predicate of #seeAlso<\/var>. The object of all these triples will be the address of my friend’s FOAF files.\n<\/p>\n

\nRefer to my article What Is An RDF Triple<\/a> for a detailed explanation and commented example of the above.\n<\/p>\n

\nRDF::Core needs all resources to be created as RDF::Core::Resource objects. We’ll need to create resources for #seeAlso<\/var> and #knows<\/var> if we are to query with them, so lets do that now.\n<\/p>\n

my $seealso = RDF::Core::Resource->new('http:\/\/www.w3.org\/2000\/01\/rdf-schema#seeAlso');
\nmy $knows = RDF::Core::Resource->new('http:\/\/xmlns.com\/foaf\/0.1\/knows');
\n<\/code><\/div>\n

\nWe can use the getStmts method in the model to get triples matching a given subject, predicate or object. We can either pass in RDF::Core::Resource’s with the values we want to check against, or undef<\/code> if we want to match everything. This returns an enumerator that we can use to get each matching triple in turn.\n<\/p>\n

\nTo start with we need to get a list of any triples that match our #knows<\/var> predicate. This is done like this.\n<\/p>\n

my $knows_enum = $model->getStmts(undef, $knows, undef);
\n<\/code><\/div>\n

\nNext we need to enumerate over any triples we have.\n<\/p>\n

my $statement = $knows_enum->getFirst;
\nwhile (defined $statement) {
\nmy $knows_object = $statement->getObject;
\n## code to handle each statement goes here
\n$statement = $knows_enum->getNext;
\n}
\n<\/code><\/div>\n

\nNow we know have a list of triples whose object represents the subject of the triples we want to query, We need to match those with this value as the subject and with the predicate of #seeAlso<\/var>.\n<\/p>\n

\nWe get get the triples using code very similar to code just used. If we insert the following code into the while<\/code> loop, we can extract this information.\n<\/p>\n

my $seealso_enum = $model->getStmts($knows_object, $seealso, undef);
\nmy $seealso_object = $seealso_enum->getFirst;
\nif (defined $seealso_object) {
\nprint $seealso_object->getObject->getLabel, \"n\";
\n}
\n<\/code><\/div>\n

\nAs we only wanted the first #seeAlso<\/var> value per #knows<\/var> triple, we don’t have to worry about going through every object in the enumerator, only the first.\n<\/p>\n

\nPutting it all together, we have a simple script to parse a FOAF file, and print out address of our friend’s FOAF files.\n<\/p>\n

#!\/usr\/bin\/perl -w
\n## Extract a list of seeAlso triples from a FOAF file
\n## Robert Price - http:\/\/www.robertprice.co.uk\/
\nuse strict;
\nuse RDF::Core::Model;
\nuse RDF::Core::Storage::Memory;
\nuse RDF::Core::Model::Parser;
\nuse RDF::Core::Resource;
\n## create our model and storage for triples.
\nmy $store = RDF::Core::Storage::Memory->new;
\nmy $model = RDF::Core::Model->new(Storage => $store);
\n## create our parse and parse the Source file.
\nmy $parser = RDF::Core::Model::Parser->new(
\nModel => $model,
\nBaseURI => 'http:\/\/xmlns.com\/foaf\/0.1\/',
\nSource => '.\/foaf.rdf',
\nSourceType => 'file'
\n);
\n$parser->parse;
\n## create a resource for seeAlso and knows triples.
\nmy $seealso = RDF::Core::Resource->new('http:\/\/www.w3.org\/2000\/01\/rdf-schema#seeAlso');
\nmy $knows = RDF::Core::Resource->new('http:\/\/xmlns.com\/foaf\/0.1\/knows');
\n## create an enumerator with all the knows triples.
\nmy $knows_enum = $model->getStmts(undef, $knows, undef);
\n## enumerate over each knows triple.
\nmy $statement = $knows_enum->getFirst;
\nwhile (defined $statement) {
\n## get the object of the current triple.
\nmy $knows_object = $statement->getObject;
\n## look for subject of the enumerator (knows), and predicate of
\n## seealso
\nmy $seealso_enum = $model->getStmts($knows_object, $seealso, undef);
\nmy $seealso_obj = $seealso_enum->getFirst;
\n## if it has a seealso triple, show the value of it.
\nif (defined $seealso_obj) {
\nprint $seealso_obj->getObject->getLabel, \"n\";
\n}
\n## get the next knows statement.
\n$statement = $knows_enum->getNext;
\n}
\n<\/code><\/div>\n

\nI hope this has started to demystify RDF parsing with Perl.<\/p>\n","protected":false},"excerpt":{"rendered":"

It is often said that parsing RDF files is hard. It’s not. What most people really find hard is turning the RDF\/XML into a series of triples and extracting data from them. When stored in RDF\/XML, triples can be written in a variety of various ways, but still mean the same thing. This means using … Continue reading “Parsing RDF In Perl With RDF::Core”<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"inline_featured_image":false,"footnotes":""},"categories":[2],"tags":[47,56],"class_list":["post-700","post","type-post","status-publish","format-standard","hentry","category-dev","tag-perl","tag-rdf"],"yoast_head":"\nParsing RDF In Perl With RDF::Core - Robert Price<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.robertprice.co.uk\/robblog\/parsing_rdf_in_perl_with_rdf_core-shtml\/\" \/>\n<meta property=\"og:locale\" content=\"en_GB\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Parsing RDF In Perl With RDF::Core - Robert Price\" \/>\n<meta property=\"og:description\" content=\"It is often said that parsing RDF files is hard. It’s not. What most people really find hard is turning the RDF\/XML into a series of triples and extracting data from them. When stored in RDF\/XML, triples can be written in a variety of various ways, but still mean the same thing. This means using … Continue reading "Parsing RDF In Perl With RDF::Core"\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.robertprice.co.uk\/robblog\/parsing_rdf_in_perl_with_rdf_core-shtml\/\" \/>\n<meta property=\"og:site_name\" content=\"Robert Price\" \/>\n<meta property=\"article:published_time\" content=\"2004-10-07T08:55:04+00:00\" \/>\n<meta name=\"author\" content=\"rob\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"rob\" \/>\n\t<meta name=\"twitter:label2\" content=\"Estimated reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"6 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/www.robertprice.co.uk\\\/robblog\\\/parsing_rdf_in_perl_with_rdf_core-shtml\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.robertprice.co.uk\\\/robblog\\\/parsing_rdf_in_perl_with_rdf_core-shtml\\\/\"},\"author\":{\"name\":\"rob\",\"@id\":\"https:\\\/\\\/www.robertprice.co.uk\\\/robblog\\\/#\\\/schema\\\/person\\\/fac6d5b076e0e14e1fb13e15b542a6c5\"},\"headline\":\"Parsing RDF In Perl With RDF::Core\",\"datePublished\":\"2004-10-07T08:55:04+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/www.robertprice.co.uk\\\/robblog\\\/parsing_rdf_in_perl_with_rdf_core-shtml\\\/\"},\"wordCount\":778,\"keywords\":[\"Perl\",\"RDF\"],\"articleSection\":[\"Dev\"],\"inLanguage\":\"en-GB\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.robertprice.co.uk\\\/robblog\\\/parsing_rdf_in_perl_with_rdf_core-shtml\\\/\",\"url\":\"https:\\\/\\\/www.robertprice.co.uk\\\/robblog\\\/parsing_rdf_in_perl_with_rdf_core-shtml\\\/\",\"name\":\"Parsing RDF In Perl With RDF::Core - Robert Price\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.robertprice.co.uk\\\/robblog\\\/#website\"},\"datePublished\":\"2004-10-07T08:55:04+00:00\",\"author\":{\"@id\":\"https:\\\/\\\/www.robertprice.co.uk\\\/robblog\\\/#\\\/schema\\\/person\\\/fac6d5b076e0e14e1fb13e15b542a6c5\"},\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.robertprice.co.uk\\\/robblog\\\/parsing_rdf_in_perl_with_rdf_core-shtml\\\/#breadcrumb\"},\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.robertprice.co.uk\\\/robblog\\\/parsing_rdf_in_perl_with_rdf_core-shtml\\\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.robertprice.co.uk\\\/robblog\\\/parsing_rdf_in_perl_with_rdf_core-shtml\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/www.robertprice.co.uk\\\/robblog\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Parsing RDF In Perl With RDF::Core\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.robertprice.co.uk\\\/robblog\\\/#website\",\"url\":\"https:\\\/\\\/www.robertprice.co.uk\\\/robblog\\\/\",\"name\":\"Robert Price\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.robertprice.co.uk\\\/robblog\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-GB\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/www.robertprice.co.uk\\\/robblog\\\/#\\\/schema\\\/person\\\/fac6d5b076e0e14e1fb13e15b542a6c5\",\"name\":\"rob\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/6f0eb511179100a4e968abc70403e33686e6ab3e992e392bedd2ccac01da666c?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/6f0eb511179100a4e968abc70403e33686e6ab3e992e392bedd2ccac01da666c?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/6f0eb511179100a4e968abc70403e33686e6ab3e992e392bedd2ccac01da666c?s=96&d=mm&r=g\",\"caption\":\"rob\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Parsing RDF In Perl With RDF::Core - Robert Price","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.robertprice.co.uk\/robblog\/parsing_rdf_in_perl_with_rdf_core-shtml\/","og_locale":"en_GB","og_type":"article","og_title":"Parsing RDF In Perl With RDF::Core - Robert Price","og_description":"It is often said that parsing RDF files is hard. It’s not. What most people really find hard is turning the RDF\/XML into a series of triples and extracting data from them. When stored in RDF\/XML, triples can be written in a variety of various ways, but still mean the same thing. This means using … Continue reading \"Parsing RDF In Perl With RDF::Core\"","og_url":"https:\/\/www.robertprice.co.uk\/robblog\/parsing_rdf_in_perl_with_rdf_core-shtml\/","og_site_name":"Robert Price","article_published_time":"2004-10-07T08:55:04+00:00","author":"rob","twitter_card":"summary_large_image","twitter_misc":{"Written by":"rob","Estimated reading time":"6 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.robertprice.co.uk\/robblog\/parsing_rdf_in_perl_with_rdf_core-shtml\/#article","isPartOf":{"@id":"https:\/\/www.robertprice.co.uk\/robblog\/parsing_rdf_in_perl_with_rdf_core-shtml\/"},"author":{"name":"rob","@id":"https:\/\/www.robertprice.co.uk\/robblog\/#\/schema\/person\/fac6d5b076e0e14e1fb13e15b542a6c5"},"headline":"Parsing RDF In Perl With RDF::Core","datePublished":"2004-10-07T08:55:04+00:00","mainEntityOfPage":{"@id":"https:\/\/www.robertprice.co.uk\/robblog\/parsing_rdf_in_perl_with_rdf_core-shtml\/"},"wordCount":778,"keywords":["Perl","RDF"],"articleSection":["Dev"],"inLanguage":"en-GB"},{"@type":"WebPage","@id":"https:\/\/www.robertprice.co.uk\/robblog\/parsing_rdf_in_perl_with_rdf_core-shtml\/","url":"https:\/\/www.robertprice.co.uk\/robblog\/parsing_rdf_in_perl_with_rdf_core-shtml\/","name":"Parsing RDF In Perl With RDF::Core - Robert Price","isPartOf":{"@id":"https:\/\/www.robertprice.co.uk\/robblog\/#website"},"datePublished":"2004-10-07T08:55:04+00:00","author":{"@id":"https:\/\/www.robertprice.co.uk\/robblog\/#\/schema\/person\/fac6d5b076e0e14e1fb13e15b542a6c5"},"breadcrumb":{"@id":"https:\/\/www.robertprice.co.uk\/robblog\/parsing_rdf_in_perl_with_rdf_core-shtml\/#breadcrumb"},"inLanguage":"en-GB","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.robertprice.co.uk\/robblog\/parsing_rdf_in_perl_with_rdf_core-shtml\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.robertprice.co.uk\/robblog\/parsing_rdf_in_perl_with_rdf_core-shtml\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.robertprice.co.uk\/robblog\/"},{"@type":"ListItem","position":2,"name":"Parsing RDF In Perl With RDF::Core"}]},{"@type":"WebSite","@id":"https:\/\/www.robertprice.co.uk\/robblog\/#website","url":"https:\/\/www.robertprice.co.uk\/robblog\/","name":"Robert Price","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.robertprice.co.uk\/robblog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-GB"},{"@type":"Person","@id":"https:\/\/www.robertprice.co.uk\/robblog\/#\/schema\/person\/fac6d5b076e0e14e1fb13e15b542a6c5","name":"rob","image":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/secure.gravatar.com\/avatar\/6f0eb511179100a4e968abc70403e33686e6ab3e992e392bedd2ccac01da666c?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/6f0eb511179100a4e968abc70403e33686e6ab3e992e392bedd2ccac01da666c?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/6f0eb511179100a4e968abc70403e33686e6ab3e992e392bedd2ccac01da666c?s=96&d=mm&r=g","caption":"rob"}}]}},"_links":{"self":[{"href":"https:\/\/www.robertprice.co.uk\/robblog\/wp-json\/wp\/v2\/posts\/700","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.robertprice.co.uk\/robblog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.robertprice.co.uk\/robblog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.robertprice.co.uk\/robblog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.robertprice.co.uk\/robblog\/wp-json\/wp\/v2\/comments?post=700"}],"version-history":[{"count":0,"href":"https:\/\/www.robertprice.co.uk\/robblog\/wp-json\/wp\/v2\/posts\/700\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.robertprice.co.uk\/robblog\/wp-json\/wp\/v2\/media?parent=700"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.robertprice.co.uk\/robblog\/wp-json\/wp\/v2\/categories?post=700"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.robertprice.co.uk\/robblog\/wp-json\/wp\/v2\/tags?post=700"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}