openRDF.org - View Thread - Sesame + Virtuoso

Welcome Guest | Login

Forum closing down
This forum will be closing down due to extensive spamming activities. As a first step, registration of new members has been disabled. Existing members will be able to use the forum for now, but please consider using the sesame-general mailing list instead.

openRDF.org Forum » Sesame & Rio: Help » Thread: Sesame + Virtuoso - Problem with rollback Error

Thread Status: Normal
Total posts in this thread: 2

[Add To My Favorites] [Watch this Thread] [Post new Thread]

Author

This topic has been viewed 1669 times and has 1 reply

Dec 1, 2008 8:13:13 AM

nipunb
Visitor

Joined: Nov 29, 2008
Posts: 1
Status: Offline

Sesame + Virtuoso - Problem with rollback Error

Reply to this Post
Reply with Quote

Hi
I am using the virtuoso sesame adapter to load 10 Million triples of Uniprot data into Virtuoso. However, after running for some time I get the following error:

Exception in thread "main" org.openrdf.repository.RepositoryException: Problem with rollback
at virtuoso.sesame2.driver.VirtuosoRepositoryConnection.rollback(Unknown Source)
at virtuoso.sesame2.driver.VirtuosoRepositoryConnection.add(Unknown Source)
at virtuoso.sesame2.driver.VirtuosoRepositoryConnection.add(Unknown Source)
at virtuoso.sesame2.driver.VirtuosoRepositoryConnection.add(Unknown Source)
at Loader.main(Loader.java:27)
Caused by: virtuoso.jdbc3.VirtuosoException: SR325: Transaction aborted because it's log after image size went above the limit
at virtuoso.jdbc3.VirtuosoConnection.rollback(Unknown Source)
... 5 more

Code Snippet:
Repository myRepository = new VirtuosoRepository("jdbc:virtuoso://localhost:1111","dba","dba"); myRepository.initialize();
File file = new File("C://Independent Study//uniprot_1M7.0.rdf");
long startSystemTime = System.currentTimeMillis();
RepositoryConnection con = myRepository.getConnection(); con.add(file, null, RDFFormat.RDFXML);
long elapsedSystemTime = System.currentTimeMillis() - startSystemTime;
System.out .println("System Time to Load data using Sesame + Virtuoso in (in ms):"+ elapsedSystemTime);
con.close();

Virtuoso ini file:
[Database]
DatabaseFile = virtuoso.db
ErrorLogFile = virtuoso.log
LockFile = virtuoso.lck
TransactionFile = virtuoso.trx
xa_persistent_file = virtuoso.pxa
ErrorLogLevel = 7
FileExtend = 200
MaxCheckpointRemap = 2000
Striping = 0
TempStorage = TempDatabase

[TempDatabase]
DatabaseFile = virtuoso-temp.db
TransactionFile = virtuoso-temp.trx
MaxCheckpointRemap = 2000
Striping = 0

Any help would be appreciated

Cheers

[Link]

Jul 7, 2009 5:00:54 PM

TallTed
Visitor

USA
Joined: Jul 7, 2009
Posts: 1
Status: Offline

Re: Sesame + Virtuoso - Problem with rollback Error

Reply to this Post
Reply with Quote

I'm sorry not to have noticed this post sooner. Hopefully you'll have found one of these solutions already. I'm posting a followup for the benefit of future web surfers.

When the graphs you're loading are available in RDF/XML or N3/Turtle, you can use one of the following functions for loading large RDF datasets into Virtuoso --

If the data is not local, you may be able to split the insertion of the graph data into smaller chunks so as to not exceed the transaction log file limit; or you can increase the log size limit through the INI file setting TransactionAfterImageLimit , as discussed in the docs. (Search the page for the setting name.)

Do note that the required log size is likely to be substantially greater than the space for the graph or the originating data file, so this last option is not always the best choice, though it may be considered easiest.

Be seeing you,

Ted

[Link]

[Show Printable Version of Thread] [Post new Thread]