Hi..
I'm running a package that has a XML Task in the control flow. This task tranforms a XML file with a XSLT.
The file is about 2 megs on a daily basis, but at the end of the month there is a full dump of data that makes the file to be around 400 megs. There is where my problem is.
I run this on my 2 GB memory workstation and when the memory gauge on the task manager reaches about 1.5gb the package fails with an "Out of memory exception".
I also run this package on a 8GB Ram server, and same applies.
Is there any way of making this package utilize all the available memory, I even increased the virtual memory to see if that helped my issue, but nothing.
Thanks
Are you running on a 32-bit or 64-bit OS? 32-bit servers are generally limited to about 2 gb of addressable memory, unless you have made some changes to the server configuration.|||I'm running 32-bit... I wasn't aware of that!! I hope my admins knew that and made whatever change (I'm been highly opomistic, givin them the benefit of the doubt).
**UPDATE**
Yes... The server has the "/PAE" switch in the boot.ini, so its configured to use the 8 gigs of memory available to it.
|||Are other things running on the server - for example, the SQL Server relational engine? How much memory is allocated to it?|||I'm looking at the Performance Tab in Task Manager and there is
Total Physical Memory: 8.32 Gigs
Available Physical Mem: 7.12 Gigs
From that 1 gig of memory taken is about 600 Megs devoted to System Cache and the rest is commited to running programs like SQL Server.
The only SQL server 2005 services that are running are
SSIS (of course)
Full Text Search
SQL Server
SQL Server Agent
Again... Thanks for all your help
|||This is a good work around.
I used a Script Task (I find myself using it more and more as I find limitations in SSIS) and with 3 simple lines of code I resolved the issue.
Code Snippet
Dim xslt As New XslTransform()xslt.Load("C:\Temp\Template.xslt")
xslt.Transform("C:\Temp\XMLSource.xml", "C:\Temp\XMLSource_Revised.xml")
This code performs the task in 5 mins -/+ consumming about 900 megs of memory space, for a 500 meg file.
No comments:
Post a Comment