Quantcast

Indexer files not deleted in Tomcat/temp and store/c400.dat file growing

classic Classic list List threaded Threaded
6 messages Options
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Indexer files not deleted in Tomcat/temp and store/c400.dat file growing

Chris Law

Hello, I'm running:
Artifactory 2.0.2 on Windows Server 2003 R2 SP2
Tomcat 6.0.18
JRE Sun 1.6.0_11-b03

I installed on Mar 16, 2009 using the default indexer settings.

I discovered that a large amount of storage was being used by
Artifactory and investigated.  It appears that when the indexer runs,
about 80% of time the artifactory.log shows:

<pre>
2009-03-21 15:00:37,687 [INFO ] (o.a.r.HttpRepo      :152) - java.net.m2:
Retrieving
'http://download.java.net/maven/2/.index/nexus-maven-repository-index.zip'...
2009-03-21 15:00:37,890 [INFO ] (o.a.r.HttpRepo      :152) - java.net.m2:
Retrieving
'http://download.java.net/maven/2/.index/nexus-maven-repository-index.properties'...
2009-03-21 15:00:45,250 [WARN ] (o.a.i.NonClosingInputStream:52) - Failed to
delete temporary file
'C:\apache-tomcat-6.0.18\temp\nexus-maven-repository-index.zip8081858316636526469.tmp'.
2009-03-21 15:00:45,250 [WARN ] (o.a.i.NonClosingInputStream:52) - Failed to
delete temporary file
'C:\apache-tomcat-6.0.18\temp\nexus-maven-repository-index.properties1715803088839234450.tmp'.
</pre>

The [CATALINA_HOME]/temp directory is full of the tmp files that
couldn't be deleted.  It is always these two files (different tmp
files, but the same base file names).

I don't know if this is related, but the .artifactory/data/store/ is
growing at a phenominal rate.  It is currently at 9.67 Gb.  The
.artifactory/data/db directory is 221 Mb and the typical size of a
developer's up-to-date local repository is about 400 Mb.

The store/seg0/C400.dat and C411.dat are the largest tables are
apparently updated each time the indexer runs.

I've searched the forum and saw one reference to a Unix tmp directory
filling up with some indexer temporary files but I'm not sure if this
is directly related.

I've since turned off the indexer, but I do know that the developers
use the eclipse m2 plugin.

Any help or ideas about the either problem would be greatly appreciated.
Thank you.

--
View this message in context: http://www.nabble.com/Indexer-files-not-deleted-in-Tomcat-temp-and-store-c400.dat-file-growing-tp22928014p22928014.html
Sent from the Artifactory-Users mailing list archive at Nabble.com.


------------------------------------------------------------------------------
This SF.net email is sponsored by:
High Quality Requirements in a Collaborative Environment.
Download a free trial of Rational Requirements Composer Now!
http://p.sf.net/sfu/www-ibm-com
_______________________________________________
Artifactory-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/artifactory-users
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Indexer files not deleted in Tomcat/temp and store/c400.dat file growing

Yoav Landman
Administrator
Hi,

The storage growth issue you see was resolved in 2.0.4.
As for the temp files cleanup, this may be a bug - are you able to delete these files manually using the user running artifactory?

Thanks,

Yoav

On Tue, Apr 7, 2009 at 3:33 PM, Chris Law <[hidden email]> wrote:

Hello, I'm running:
Artifactory 2.0.2 on Windows Server 2003 R2 SP2
Tomcat 6.0.18
JRE Sun 1.6.0_11-b03

I installed on Mar 16, 2009 using the default indexer settings.

I discovered that a large amount of storage was being used by
Artifactory and investigated.  It appears that when the indexer runs,
about 80% of time the artifactory.log shows:

<pre>
2009-03-21 15:00:37,687 [INFO ] (o.a.r.HttpRepo      :152) - java.net.m2:
Retrieving
'http://download.java.net/maven/2/.index/nexus-maven-repository-index.zip'...
2009-03-21 15:00:37,890 [INFO ] (o.a.r.HttpRepo      :152) - java.net.m2:
Retrieving
'http://download.java.net/maven/2/.index/nexus-maven-repository-index.properties'...
2009-03-21 15:00:45,250 [WARN ] (o.a.i.NonClosingInputStream:52) - Failed to
delete temporary file
'C:\apache-tomcat-6.0.18\temp\nexus-maven-repository-index.zip8081858316636526469.tmp'.
2009-03-21 15:00:45,250 [WARN ] (o.a.i.NonClosingInputStream:52) - Failed to
delete temporary file
'C:\apache-tomcat-6.0.18\temp\nexus-maven-repository-index.properties1715803088839234450.tmp'.
</pre>

The [CATALINA_HOME]/temp directory is full of the tmp files that
couldn't be deleted.  It is always these two files (different tmp
files, but the same base file names).

I don't know if this is related, but the .artifactory/data/store/ is
growing at a phenominal rate.  It is currently at 9.67 Gb.  The
.artifactory/data/db directory is 221 Mb and the typical size of a
developer's up-to-date local repository is about 400 Mb.

The store/seg0/C400.dat and C411.dat are the largest tables are
apparently updated each time the indexer runs.

I've searched the forum and saw one reference to a Unix tmp directory
filling up with some indexer temporary files but I'm not sure if this
is directly related.

I've since turned off the indexer, but I do know that the developers
use the eclipse m2 plugin.

Any help or ideas about the either problem would be greatly appreciated.
Thank you.

--
View this message in context: http://www.nabble.com/Indexer-files-not-deleted-in-Tomcat-temp-and-store-c400.dat-file-growing-tp22928014p22928014.html
Sent from the Artifactory-Users mailing list archive at Nabble.com.


------------------------------------------------------------------------------
This SF.net email is sponsored by:
High Quality Requirements in a Collaborative Environment.
Download a free trial of Rational Requirements Composer Now!
http://p.sf.net/sfu/www-ibm-com
_______________________________________________
Artifactory-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/artifactory-users


------------------------------------------------------------------------------
This SF.net email is sponsored by:
High Quality Requirements in a Collaborative Environment.
Download a free trial of Rational Requirements Composer Now!
http://p.sf.net/sfu/www-ibm-com
_______________________________________________
Artifactory-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/artifactory-users
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Indexer files not deleted in Tomcat/temp and store/c400.dat file growing

Chris Law

Hello!  Thank you responding.

I will upgrade to 2.0.4.  As for the temp files - yah, I can delete the old
temp files - I deleted most of the older ones this morning and have had no
new files since then (because I "turned off" the indexer).

So, I after I upgrade to 2.0.4, can I turn the indexer back on, or will that
still be an issue?

Thank you again for responding so quickly!


Yoav  Landman wrote:

>
> Hi,
>
> The storage growth issue you see was resolved in 2.0.4.
> As for the temp files cleanup, this may be a bug - are you able to delete
> these files manually using the user running artifactory?
>
> Thanks,
>
> Yoav
>
> On Tue, Apr 7, 2009 at 3:33 PM, Chris Law <[hidden email]> wrote:
>
>>
>> Hello, I'm running:
>> Artifactory 2.0.2 on Windows Server 2003 R2 SP2
>> Tomcat 6.0.18
>> JRE Sun 1.6.0_11-b03
>>
>> I installed on Mar 16, 2009 using the default indexer settings.
>>
>> I discovered that a large amount of storage was being used by
>> Artifactory and investigated.  It appears that when the indexer runs,
>> about 80% of time the artifactory.log shows:
>>
>> <pre>
>> 2009-03-21 15:00:37,687 [INFO ] (o.a.r.HttpRepo      :152) - java.net.m2:
>> Retrieving
>> '
>> http://download.java.net/maven/2/.index/nexus-maven-repository-index.zip'.<http://download.java.net/maven/2/.index/nexus-maven-repository-index.zip%27.>
>> ..
>> 2009-03-21 15:00:37,890 [INFO ] (o.a.r.HttpRepo      :152) - java.net.m2:
>> Retrieving
>> '
>> http://download.java.net/maven/2/.index/nexus-maven-repository-index.properties'.<http://download.java.net/maven/2/.index/nexus-maven-repository-index.properties%27.>
>> ..
>> 2009-03-21 15:00:45,250 [WARN ] (o.a.i.NonClosingInputStream:52) - Failed
>> to
>> delete temporary file
>>
>> 'C:\apache-tomcat-6.0.18\temp\nexus-maven-repository-index.zip8081858316636526469.tmp'.
>> 2009-03-21 15:00:45,250 [WARN ] (o.a.i.NonClosingInputStream:52) - Failed
>> to
>> delete temporary file
>>
>> 'C:\apache-tomcat-6.0.18\temp\nexus-maven-repository-index.properties1715803088839234450.tmp'.
>> </pre>
>>
>> The [CATALINA_HOME]/temp directory is full of the tmp files that
>> couldn't be deleted.  It is always these two files (different tmp
>> files, but the same base file names).
>>
>> I don't know if this is related, but the .artifactory/data/store/ is
>> growing at a phenominal rate.  It is currently at 9.67 Gb.  The
>> .artifactory/data/db directory is 221 Mb and the typical size of a
>> developer's up-to-date local repository is about 400 Mb.
>>
>> The store/seg0/C400.dat and C411.dat are the largest tables are
>> apparently updated each time the indexer runs.
>>
>> I've searched the forum and saw one reference to a Unix tmp directory
>> filling up with some indexer temporary files but I'm not sure if this
>> is directly related.
>>
>> I've since turned off the indexer, but I do know that the developers
>> use the eclipse m2 plugin.
>>
>> Any help or ideas about the either problem would be greatly appreciated.
>> Thank you.
>>
>> --
>> View this message in context:
>> http://www.nabble.com/Indexer-files-not-deleted-in-Tomcat-temp-and-store-c400.dat-file-growing-tp22928014p22928014.html
>> Sent from the Artifactory-Users mailing list archive at Nabble.com.
>>
>>
>>
>> ------------------------------------------------------------------------------
>> This SF.net email is sponsored by:
>> High Quality Requirements in a Collaborative Environment.
>> Download a free trial of Rational Requirements Composer Now!
>> http://p.sf.net/sfu/www-ibm-com
>> _______________________________________________
>> Artifactory-users mailing list
>> [hidden email]
>> https://lists.sourceforge.net/lists/listinfo/artifactory-users
>>
>
> ------------------------------------------------------------------------------
> This SF.net email is sponsored by:
> High Quality Requirements in a Collaborative Environment.
> Download a free trial of Rational Requirements Composer Now!
> http://p.sf.net/sfu/www-ibm-com
> _______________________________________________
> Artifactory-users mailing list
> [hidden email]
> https://lists.sourceforge.net/lists/listinfo/artifactory-users
>
>

--
View this message in context: http://www.nabble.com/Indexer-files-not-deleted-in-Tomcat-temp-and-store-c400.dat-file-growing-tp22928014p22939581.html
Sent from the Artifactory-Users mailing list archive at Nabble.com.


------------------------------------------------------------------------------
This SF.net email is sponsored by:
High Quality Requirements in a Collaborative Environment.
Download a free trial of Rational Requirements Composer Now!
http://p.sf.net/sfu/www-ibm-com
_______________________________________________
Artifactory-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/artifactory-users
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Indexer files not deleted in Tomcat/temp and store/c400.dat file growing

Yoav Landman
Administrator
The indexer temp files are a separate issue, so please keep watching them and let us know if it persists (this might be a Win-only issue, BTW).

On Wed, Apr 8, 2009 at 1:26 AM, Chris Law <[hidden email]> wrote:

Hello!  Thank you responding.

I will upgrade to 2.0.4.  As for the temp files - yah, I can delete the old
temp files - I deleted most of the older ones this morning and have had no
new files since then (because I "turned off" the indexer).

So, I after I upgrade to 2.0.4, can I turn the indexer back on, or will that
still be an issue?

Thank you again for responding so quickly!


Yoav  Landman wrote:
>
> Hi,
>
> The storage growth issue you see was resolved in 2.0.4.
> As for the temp files cleanup, this may be a bug - are you able to delete
> these files manually using the user running artifactory?
>
> Thanks,
>
> Yoav
>
> On Tue, Apr 7, 2009 at 3:33 PM, Chris Law <[hidden email]> wrote:
>
>>
>> Hello, I'm running:
>> Artifactory 2.0.2 on Windows Server 2003 R2 SP2
>> Tomcat 6.0.18
>> JRE Sun 1.6.0_11-b03
>>
>> I installed on Mar 16, 2009 using the default indexer settings.
>>
>> I discovered that a large amount of storage was being used by
>> Artifactory and investigated.  It appears that when the indexer runs,
>> about 80% of time the artifactory.log shows:
>>
>> <pre>
>> 2009-03-21 15:00:37,687 [INFO ] (o.a.r.HttpRepo      :152) - java.net.m2:
>> Retrieving
>> '
>> http://download.java.net/maven/2/.index/nexus-maven-repository-index.zip'.<http://download.java.net/maven/2/.index/nexus-maven-repository-index.zip%27.>
>> ..
>> 2009-03-21 15:00:37,890 [INFO ] (o.a.r.HttpRepo      :152) - java.net.m2:
>> Retrieving
>> '
>> http://download.java.net/maven/2/.index/nexus-maven-repository-index.properties'.<http://download.java.net/maven/2/.index/nexus-maven-repository-index.properties%27.>
>> ..
>> 2009-03-21 15:00:45,250 [WARN ] (o.a.i.NonClosingInputStream:52) - Failed
>> to
>> delete temporary file
>>
>> 'C:\apache-tomcat-6.0.18\temp\nexus-maven-repository-index.zip8081858316636526469.tmp'.
>> 2009-03-21 15:00:45,250 [WARN ] (o.a.i.NonClosingInputStream:52) - Failed
>> to
>> delete temporary file
>>
>> 'C:\apache-tomcat-6.0.18\temp\nexus-maven-repository-index.properties1715803088839234450.tmp'.
>> </pre>
>>
>> The [CATALINA_HOME]/temp directory is full of the tmp files that
>> couldn't be deleted.  It is always these two files (different tmp
>> files, but the same base file names).
>>
>> I don't know if this is related, but the .artifactory/data/store/ is
>> growing at a phenominal rate.  It is currently at 9.67 Gb.  The
>> .artifactory/data/db directory is 221 Mb and the typical size of a
>> developer's up-to-date local repository is about 400 Mb.
>>
>> The store/seg0/C400.dat and C411.dat are the largest tables are
>> apparently updated each time the indexer runs.
>>
>> I've searched the forum and saw one reference to a Unix tmp directory
>> filling up with some indexer temporary files but I'm not sure if this
>> is directly related.
>>
>> I've since turned off the indexer, but I do know that the developers
>> use the eclipse m2 plugin.
>>
>> Any help or ideas about the either problem would be greatly appreciated.
>> Thank you.
>>
>> --
>> View this message in context:
>> http://www.nabble.com/Indexer-files-not-deleted-in-Tomcat-temp-and-store-c400.dat-file-growing-tp22928014p22928014.html
>> Sent from the Artifactory-Users mailing list archive at Nabble.com.
>>
>>
>>
>> ------------------------------------------------------------------------------
>> This SF.net email is sponsored by:
>> High Quality Requirements in a Collaborative Environment.
>> Download a free trial of Rational Requirements Composer Now!
>> http://p.sf.net/sfu/www-ibm-com
>> _______________________________________________
>> Artifactory-users mailing list
>> [hidden email]
>> https://lists.sourceforge.net/lists/listinfo/artifactory-users
>>
>
> ------------------------------------------------------------------------------
> This SF.net email is sponsored by:
> High Quality Requirements in a Collaborative Environment.
> Download a free trial of Rational Requirements Composer Now!
> http://p.sf.net/sfu/www-ibm-com
> _______________________________________________
> Artifactory-users mailing list
> [hidden email]
> https://lists.sourceforge.net/lists/listinfo/artifactory-users
>
>

--
View this message in context: http://www.nabble.com/Indexer-files-not-deleted-in-Tomcat-temp-and-store-c400.dat-file-growing-tp22928014p22939581.html
Sent from the Artifactory-Users mailing list archive at Nabble.com.


------------------------------------------------------------------------------
This SF.net email is sponsored by:
High Quality Requirements in a Collaborative Environment.
Download a free trial of Rational Requirements Composer Now!
http://p.sf.net/sfu/www-ibm-com
_______________________________________________
Artifactory-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/artifactory-users


------------------------------------------------------------------------------
This SF.net email is sponsored by:
High Quality Requirements in a Collaborative Environment.
Download a free trial of Rational Requirements Composer Now!
http://p.sf.net/sfu/www-ibm-com
_______________________________________________
Artifactory-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/artifactory-users
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Indexer files not deleted in Tomcat/temp and store/c400.dat file growing

Vudathu
In reply to this post by Yoav Landman

Hi Yova,
I am running into the same issue. Is it okay to delete all the *.dat files
under /artifactory-2.0.0/data/store/seg0/ file for example (C400.dat and
C411.dat)?

Thanks in advance.
Raghu

 

Hi,

The storage growth issue you see was resolved in 2.0.4.
As for the temp files cleanup, this may be a bug - are you able to delete
these files manually using the user running artifactory?

Thanks,

Yoav


--
View this message in context: http://www.nabble.com/Indexer-files-not-deleted-in-Tomcat-temp-and-store-c400.dat-file-growing-tp22928014p24510158.html
Sent from the Artifactory-Users mailing list archive at Nabble.com.


------------------------------------------------------------------------------
Enter the BlackBerry Developer Challenge  
This is your chance to win up to $100,000 in prizes! For a limited time,
vendors submitting new applications to BlackBerry App World(TM) will have
the opportunity to enter the BlackBerry Developer Challenge. See full prize  
details at: http://p.sf.net/sfu/Challenge
_______________________________________________
Artifactory-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/artifactory-users
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Indexer files not deleted in Tomcat/temp and store/c400.dat file growing

Yoav Landman
Administrator
No, since these files are the repository storage files. I was referring to the files under the tomcat temp (or /tmp) directory, which are ok to delete.

Yoav

On Thu, Jul 16, 2009 at 7:56 AM, Vudathu <[hidden email]> wrote:

Hi Yova,
I am running into the same issue. Is it okay to delete all the *.dat files
under /artifactory-2.0.0/data/store/seg0/ file for example (C400.dat and
C411.dat)?

Thanks in advance.
Raghu



Hi,

The storage growth issue you see was resolved in 2.0.4.
As for the temp files cleanup, this may be a bug - are you able to delete
these files manually using the user running artifactory?

Thanks,

Yoav


--
View this message in context: http://www.nabble.com/Indexer-files-not-deleted-in-Tomcat-temp-and-store-c400.dat-file-growing-tp22928014p24510158.html
Sent from the Artifactory-Users mailing list archive at Nabble.com.


------------------------------------------------------------------------------
Enter the BlackBerry Developer Challenge
This is your chance to win up to $100,000 in prizes! For a limited time,
vendors submitting new applications to BlackBerry App World(TM) will have
the opportunity to enter the BlackBerry Developer Challenge. See full prize
details at: http://p.sf.net/sfu/Challenge
_______________________________________________
Artifactory-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/artifactory-users


------------------------------------------------------------------------------
Enter the BlackBerry Developer Challenge  
This is your chance to win up to $100,000 in prizes! For a limited time,
vendors submitting new applications to BlackBerry App World(TM) will have
the opportunity to enter the BlackBerry Developer Challenge. See full prize  
details at: http://p.sf.net/sfu/Challenge
_______________________________________________
Artifactory-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/artifactory-users
Loading...