How to efficiently write a large text file in C#? -


I am making a method in C # which generates a text file for one. The feed will contain 30,000 records and currently weighs up to ~ 7 MB of text file.

Here is the code that I am currently using (some lines have been deleted for short). 

  public static zero generateTextFile (string file path) {var sb = new string builder (1000); Sb.Append ("availability") attached ("\ t"). Sb.Append ("condition") attached ("\ t"). Sb.Append ("Description") Engage ("\ t"). For summarized // iterative code is hidden ... sb.Append (EnvironmentalNewLine); Var Items = Inventory Repos GetItemsForSale (); Foreign objects (different P items) {sb.Append ("In Stock"). Attached ("\ t"); . Sb.Append ("old") attached ("\ t"); Sb.Append (p.Description) .Append ("\ t"); For summarized // iterative code is hidden ... sb.AppendLine (); } {Result.Append ("write text file on disk") using the StreamWriter outfile = new StreamWriter (filePath). Appendable (); Outfile.Write (sb.ToString ()); }}

I'm surprised that stringbillers are the right tools for the job, will I have performance advantages using TextWriter instead?

I do not know a ton about IO performance so any help or general improvement will be appreciated. Thank you.

File I / O operations are generally compatible with modern operating systems. You should not try to collect the whole string for the memory in memory ... just piece it in pieces. Flamestream will take care of buffering and other performance considerations.

You can easily move this change: 

 using  (StreamWriter outfile = new streamer (file path) at the top of the function { < Instead of getting rid of / pre> 
, and  StringBuilder , the file is writing directly. 
 
  There are several reasons to avoid making large stars in memory:  
 
     
  1.  This can actually perform poorly because  StringBuilder  to increase its capability as you write it, which results in a copy of the reallocation and memory. 
    2.  
  2.  You may need more memory than allocated physically - which is a virtual memory (swap file) that is much slower than RAM. 
    3.  
  3.  In fact, for large files (> 2 GB), you will participate in address space (on 32-bit platform) and will fail completely. 
    4.  
  4.  To write a  stringbinder  content, you have to use the  ToString ()  which effectively doubles the memory consumption of the process As both copies should be in memory for a period of time. This address may also fail if your address space is broken enough, such that an inner section of memory can not be allocated. 
    5.

-

Comments

Post a Comment

Popular posts from this blog

Eclipse CDT variable colors in editor -

I hope this is a good question to ask here. This programming is related, so I thought it would be better than the superuser, so I am using the CDT C ++ Eclipse plugin. I know how the editor changes colors for some things But is there a way to do that all the variables are different colors? For example in KDEValue, it sets the local variables and square variables in different colors and bold square squares. Can I copy it to CDT? Eclips provides some level of color customization for text editor syntax You can see it on the following: There are many elements, including the Window> Preferences> C / C ++> Editor> Syntax color code that can be changed, assembly, Comments, Preprocessor and Doxian Under the code, it is possible to change the color of some variable types, such as global variables, local variable announcements, local variable references, and parameter variables. But I do not think the code is capable of changing the color of each variable declared....
Read more

AJAX doesn't send POST query -

$ (दस्तावेज़) .ready (function () {function ajaxselectrss (rssurlvar) {var ajaxRequest; // वेरिएबल जो अजाक्स को संभव बनाता है! कोशिश करें कि {// ओपेरा 8.0+, फ़ायरफ़ॉक्स, सफारी अजाक्स अनुरोध} = नया एक्सएमएलएचटीपीआरइवेस्ट ();} कैच (ई) {// इंटरनेट एक्सप्लोरर ब्राउज़र्स {ajaxRequest = new ActiveXObject ("Msxml2.XMLHTTP");} पकड़ो (ई) {try {ajaxRequest = new ActiveXObject ("Microsoft.XMLHTTP");} कैच (ई) {// कुछ गलत चेतावनी ("आपका ब्राउज़र तोड़ दिया!"); वापसी झूठी;}}} // एक बनाएं फ़ंक्शन जो सर्वर से भेजे गए डेटा प्राप्त करेंगे ajaxRequest.onreadystatechange = function () {if (ajaxRequest.readyState == 4) {var ajaxDisplay = document.getElementById ('news'); ajaxDisplay.innerHTML = ajaxRequest.responseText;}} / / Var rssurlvar = $ (this) .attr ("title"); var queryString = "rurl =" + rssurlvar; var urltofile = "rssget.php"; ajaxRequest.open ("पोस्ट", urltofile, सच); ajaxRequ Est.setRequestHeader ("सामग्री-प्र...
Read more

wpf - Custom Message Box Advice -

Well, I'm using a custom window box that comes with some custom control boxes that accompany the text The producers who are displayed are called. I have a defined event, which has been subscribed through the original class, it gets burnt when clicking on the button. However, I can not see how to use it effectively, I would like to return one yes, whether yes or not, but obviously my code will continue to execute, so this Below is some example code to clarify the problem that the method has subscibed by clicking on the button. Message box window Public partial class custom message box: window {public representative message messagebox object sender, event events e); Public event messagebox handler messagebox document; Public Customs Box () {Initial group (); } Public Customsbox (String Message) {InitializeComponent (); This.txtdescription.Text = Message; } Public Customsbox (String Message, String Title, String First BTNtext) {Initialization (); This.lbltitle.Content =...
Read more