c# - Write file need to optimised for heavy traffic part 2 -


for interest see come can refer part 1, not necessary.

write file need optimised heavy traffic

below snippet of code have written capture financial tick data broker api. code run without error. need optimize code, because in peak hours zf_tickevent method call more 10000 times second. use memorystream hold data until reaches size, output text file.

the broker api single threaded. 

void zf_tickevent(object sender, zenfire.tickeventargs e) {      outputstring = string.format("{0},{1},{2},{3},{4}\r\n",                         e.timestamp.tostring(timefmt),                         e.product.tostring(),                         enum.getname(typeof(zenfire.ticktype), e.type),                         e.price,                         e.volume);      fillbuffer(outputstring);  }  public class memorystreamclass {     public static memorystream ms = new memorystream(); }  void fillbuffer(string outputstring) {      byte[] outputbyte = encoding.ascii.getbytes(outputstring);      memorystreamclass.ms.write(outputbyte, 0, outputbyte.length);      if (memorystreamclass.ms.length > 8192)     {         emptybuffer(memorystreamclass.ms);         memorystreamclass.ms.setlength(0);         memorystreamclass.ms.position = 0;     } }  void emptybuffer(memorystream ms) {     filestream outstream = new filestream("c:\\test.txt", filemode.append);      ms.writeto(outstream);     outstream.flush();     outstream.close(); }

question:

  1. any suggestion make faster? try vary buffer length in terms of code structure, (almost) fastest?

  2. when memorystream filled , emptying file, happen new data coming in? need implement second buffer hold data while emptying first buffer? or c# smart enough figure out?

thanks advice

the fastest way have 1 (or more) threads put byte[]'s blockingcollection , have 1 thread take items out fast possibly can , write them file. way producers , file-writing consumer totally decoupled. able sustain high load doing that.


Comments

Post a Comment

Popular posts from this blog

java - Play! framework 2.0: How to display multiple image? -

i need display gallery of photos. here template: @(photos: list[photo]) @title = { <bold>gallery</bold> } @main(title,"photo"){ <ul class="thumbnails"> @for(photo <- photos) { <li class="span3"> <a href="#" class="thumbnail"> <img src="@photo.path" alt=""> </a> </li> } </ul> } and here controller method: public static result getphotos() { return ok(views.html.photo.gallery.render(photo.get())); } and here photo bean : @entity public class photo extends model { @id public long id; @required public string label; public string path; public photo(string path, string label) { this.path = path; this.label = label; } private static finder<long, photo> find = new finder<long, photo>( long.class, photo.class); public static list<phot...
Read more

gmail - Is there any documentation for read-only access to the Google Contacts API? -

i want read-only access user's google contacts. there stackoverflow member wanted this, , received following answer : yes, there is, use https://www.googleapis.com/auth/contacts.readonly scope , "view contacts". this exchange reference read-only access google contacts can find using google. simply using access token obtained attempt read usual google contacts api (i.e. https://www.google.com/m8/feeds ) fails insufficient permissions. similarly, using google contacts api on new target fails 404 errors (for example https://www.googleapis.com/auth/contacts.readonly/default/full ). is there documentation anywhere on how use api, or permissible way access google contacts api full read-write access?
Read more

php - Controller/JToolBar not working in Joomla 2.5 -

relevant code: jtoolbarhelper::custom('savecategories', 'save', '', 'save', false, false); ... <input type="hidden" name="controller" value="easyblogcontroller"> according can dig docs , own previous questions, should call savecategories() function in easyblogcontroller . i've tried setting value easyblog , easyblog.php (file name) current easyblogcontroller (class name). clicking on save button refreshes page. not redirect, echo or var_dump test code put in savecategories() function. var_dump ing jrequest::getvar('controller') , 'task' return correct values. creating controller object , using $controller->execute('task'); works. the values going depend on location of controller trying call, , have couple options here. typically there controller in base folder of component (likely components/com_easyblog) in file called controller.php , class name inside ...
Read more