Very slow unpacking of archives

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

Very slow unpacking of archives

pscheir
This post was updated on .
Hi,

we are using Artifactory Pro 3.1.0

We use the "Deploy Artifacts from Archive" functionality: https://www.jfrog.com/confluence/display/RTF/Artifactory+REST+API#ArtifactoryRESTAPI-DeployArtifactsfromArchive

I.e. we use the Header "X-Explode-Archive: true" during upload.

We have the case of archive were unpacking by Artifactory is _very_ slow.

The archive’s size is 2.3 GB and it contains 300 files.
The upload of the archive takes 30 seconds.
Unpacking the archive locally takes 1 minute.
Unpacking the archive using Artifactory takes 9 minutes.

Any ideas what causes this difference in unpack time?

Thank you, Peter
Reply | Threaded
Open this post in threaded view
|

Re: Very slow unpacking of archives

dave_p
My first guess would be that artifactory is using a single-threaded unzip utility, while your desktop is using a multithreaded one. This should be easy to verify (upload file and watch top / activity monitor / task manager, depending on the server OS.)

Regards,

Dave

-----Original Message-----
From: pscheir [mailto:[hidden email]]
Sent: Wednesday, February 26, 2014 9:26 AM
To: [hidden email]
Subject: [Artifactory-users] Very slow unpacking of archives

Hi,

we are using Artifactory Pro 3.1.0

We use the "Deploy Artifacts from Archive" functionality:
https://www.jfrog.com/confluence/display/RTF/Artifactory+REST+API#ArtifactoryRESTAPI-DeployArtifactsfromArchive

I.e. we use the Header "X-Explode-Archive: true" during upload.

We have the case of archive were unpacking by Artifactory is _very_ slow.

The archive’s size is 2.3 GB and it contains 300 files.
The upload of the archive takes 30 seconds.
Unpacking the archive locally tales 1 minute.
Unpacking the archive using Artifactory takes 9 minutes.

Any ideas what causes this difference in unpack time?

Thank you, Peter



--
View this message in context: http://forums.jfrog.org/Very-slow-unpacking-of-archives-tp7579659.html
Sent from the Artifactory - Users mailing list archive at Nabble.com.

------------------------------------------------------------------------------
Flow-based real-time traffic analytics software. Cisco certified tool.
Monitor traffic, SLAs, QoS, Medianet, WAAS etc. with NetFlow Analyzer Customize your own dashboards, set traffic alerts and generate reports.
Network behavioral analysis & security monitoring. All-in-one tool.
http://pubads.g.doubleclick.net/gampad/clk?id=126839071&iu=/4140/ostg.clktrk
_______________________________________________
Artifactory-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/artifactory-users
------------------------------------------------------------------------------
Flow-based real-time traffic analytics software. Cisco certified tool.
Monitor traffic, SLAs, QoS, Medianet, WAAS etc. with NetFlow Analyzer
Customize your own dashboards, set traffic alerts and generate reports.
Network behavioral analysis & security monitoring. All-in-one tool.
http://pubads.g.doubleclick.net/gampad/clk?id=126839071&iu=/4140/ostg.clktrk
_______________________________________________
Artifactory-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/artifactory-users
Reply | Threaded
Open this post in threaded view
|

Re: Very slow unpacking of archives

pscheir
Hi Dave,

it seems that you are right!

I’ve used Process Explorer to take a look at the threads of artifactory-service.exe (see http://java.dzone.com/articles/java-thread-cpu-analysis )

And although artifactory-service.exe has about 60 threads, only 1 thread does the work.

Mh, anything I can do about this?

Thanks, Peter


dave_p wrote
My first guess would be that artifactory is using a single-threaded unzip utility, while your desktop is using a multithreaded one. This should be easy to verify (upload file and watch top / activity monitor / task manager, depending on the server OS.)

Regards,

Dave

-----Original Message-----
From: pscheir [mailto:[hidden email]]
Sent: Wednesday, February 26, 2014 9:26 AM
To: [hidden email]
Subject: [Artifactory-users] Very slow unpacking of archives

Hi,

we are using Artifactory Pro 3.1.0

We use the "Deploy Artifacts from Archive" functionality:
https://www.jfrog.com/confluence/display/RTF/Artifactory+REST+API#ArtifactoryRESTAPI-DeployArtifactsfromArchive

I.e. we use the Header "X-Explode-Archive: true" during upload.

We have the case of archive were unpacking by Artifactory is _very_ slow.

The archive’s size is 2.3 GB and it contains 300 files.
The upload of the archive takes 30 seconds.
Unpacking the archive locally tales 1 minute.
Unpacking the archive using Artifactory takes 9 minutes.

Any ideas what causes this difference in unpack time?

Thank you, Peter



--
View this message in context: http://forums.jfrog.org/Very-slow-unpacking-of-archives-tp7579659.html
Sent from the Artifactory - Users mailing list archive at Nabble.com.

------------------------------------------------------------------------------
Flow-based real-time traffic analytics software. Cisco certified tool.
Monitor traffic, SLAs, QoS, Medianet, WAAS etc. with NetFlow Analyzer Customize your own dashboards, set traffic alerts and generate reports.
Network behavioral analysis & security monitoring. All-in-one tool.
http://pubads.g.doubleclick.net/gampad/clk?id=126839071&iu=/4140/ostg.clktrk
_______________________________________________
Artifactory-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/artifactory-users
------------------------------------------------------------------------------
Flow-based real-time traffic analytics software. Cisco certified tool.
Monitor traffic, SLAs, QoS, Medianet, WAAS etc. with NetFlow Analyzer
Customize your own dashboards, set traffic alerts and generate reports.
Network behavioral analysis & security monitoring. All-in-one tool.
http://pubads.g.doubleclick.net/gampad/clk?id=126839071&iu=/4140/ostg.clktrk
_______________________________________________
Artifactory-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/artifactory-users