Artifactory › Artifactory - Users

Oracle 10g database for Artifactory using 3x more space than it should

Classic

List

Threaded

4 messages Options

jschrantz

Oracle 10g database for Artifactory using 3x more space than it should

Hi,

I am trying to figure out why our Artifactory database is running out of space. We are currently using an Oracle 10g database with Artifactory 2.3.4.1 and around 70,000 artifacts.

We recently started getting out of table space errors with our 750GB schema and I have to track down the issue. I wrote a script using the REST api to grab the sizes of all the files in the system to try and find out where all this storage is being used, but the total size of artifacts in the system is coming out to 241GB. This matches what we saw during our last upgrade when we did a full export and then imported into a new database.

So my question is, where is this 500GB discrepancy coming from? We are using non-unique snapshots so I don’t think there are any old versions laying around, the garbage collector seems to be running every day with the default settings, and the number of artifacts has remained more or less constant since our previous upgrade.

Does anyone have any insight into what is going on here? Any tips on other settings to check or analysis tools to run?

The information contained in this communication may be CONFIDENTIAL and is intended only for the use of the recipient(s) named above. If you are not the intended recipient, you are hereby notified that any dissemination, distribution, or copying of this communication, or any of its contents, is strictly prohibited. If you have received this communication in error, please notify the sender and delete/destroy the original message and any copy of it from your computer or paper files.

------------------------------------------------------------------------------
Keep Your Developer Skills Current with LearnDevNow!
The most comprehensive online learning library for Microsoft developers
is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3,
Metro Style Apps, more. Free future releases when you subscribe now!
http://p.sf.net/sfu/learndevnow-d2d
_______________________________________________
Artifactory-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/artifactory-users

Remove Ads

Yoav Landman

Re: Oracle 10g database for Artifactory using 3x more space than it should

Hello John,

That doesn't seem right and there may be an error during storage reclaim on
your instance. There are a couple of reasons for why this may happen, but
it's hard to tell without getting more information.
In addition, artifacts are only one factor of the storage being used, so
only scanning the artifacts shows a partial picture, though I wouldn't
expect the difference to be that big.
Can you attach the Artifactory logs and your latest config so that we can
take a look at it? You can also send it privately to support@jfrog.com.

Thanks,
Yoav

jschrantz

Re: Oracle 10g database for Artifactory using 3x more space than it should

I am sending my artifactory.log files and artifactory.config.latest.xml to support@jfrog.com now. Let me know if you need any other files and I will be happy to send them.

jschrantz

Re: Oracle 10g database for Artifactory using 3x more space than it should

Update for anyone with a similar issue.

jFrog support had me run a query, select sum(length) from ds_DATASTORE;, to determine if the garbage collector was running. The result was around 300GB which is what we expect the size to be.

They then claimed that it was probably an Oracle fragmentation issue and that I should tell our DBA "that the natural order of all tables in Artifactory is irrelevant and so he can reclaim all tablespaces free space at will."

The DBA responded that he ran alter table {our user schema}.DS_DATASTORE modify lob (DATA) (shrink space cascade) which brought the total size from 800GB to 400GB.

Thanks for the help jFrog.