Skip to main content

How to Improve Linq Query Performance by using Parallel/ PLinq

How to Improve Linq Query Performance by using Parallel/ PLinq

I want to highlight the disadvantage first, because if you know the disadvantage you can make a choice if required in your project or not.

Don't use if you have a Single core or dual core CPU's. I found that depending on the complexity of For loop  the CPU performance reaches more than 70-80%  (Not talking about the simple For loop). So if you want to use the parallelism for complex loop make sure you have more than  2 CPU's
Parallelization sometimes cause a  PLinq query to run slower than Linq to object equivalent. Basically it said like queries with few data source elements and fast user delegates are reluctant to speed up much.

Parallel Linq is the parallel implementation of Linq. Parallel Linq implementation on loops provide better performance compared to sequential  loop. Parallel Linq also works like Linq queries operate on any in-memory IEnumerale(of T) data source. PLINQ make full use of all processors on the system. The parallelism is achieved by diving the data source into multiple segments and working each segment on different worker threads on multiple processor.

MaxDegreeOfParallelism  - Upper limit of number of processors irrespective of number of cores(We can only specify the maximum )limit.. So even if also if we don't use the CPU , no extra task will run in parallel. 

Implementation 

List testModelList=GetTestModelList();

Parallel.ForEach(testModelList,
                new ParallelOptions { MaxDegreeOfParallelism = 5 },
                tm=>; {//Do Operations
                  
              });


Reference:http://msdn.microsoft.com/en-us/library/dd460688.aspx

Comments

Post a Comment

Popular posts from this blog

Compiled Query- Improve the performance of Linq to Entity Query

Most of the small or medium IT firms are using the Entity framework for the Data Access layer (DAL). If we write a complex linq to Entity queries performance will always be an issue. But with the Compiled Query Performance can be improved. This below definitions are from MSDN and more details can be found on the MSDN Link that is at the end of this post           When you have an application that executes structurally similar queries many times in the Entity Framework, you can frequently increase performance by compiling the query one time and executing it several times with different parameters. For example, an application might have to retrieve all the QuoteRevision for a particular quotelineStatus, the quotelinestatus is specified at runtime. LINQ to Entities supports using compiled queries for this purpose.               The  compiled query class provides compilation and caching of queries for reuse . Co...
1 comment
Read more

Sql Server Internals - Named Pipes

Named pipes enables clients applications to request a reliable and two way connection between the client application and Sql Server, across a network. A named pipe has a name which follows the UNC naming convention : \\Server\pipe\name The default names pipe for SQL server is :                 \\Server\pipe\sql\query A named instance would have a named pipe of                \\server\pipe\MSSQL$instancename\sql\query Early versions of SQL Server only provided Named Pipes. Named Pipes also allows for impersonation of a clients credentials. The feature is used by SQL server when using Linked Servers. The clients logon credentials are passed across to the Linked Server for authentication. Named Pipes can operate over TCP/IP, NETBEUI or IPX as it indirectly relies on the Common Internet Files Sytems
Post a Comment
Read more

Bootstrap Server Side Pagination - alternative to data tables

Background Most of the Web developers are familiar with the Datatable.Net for pagination. DataTables can integrate seamlessly with  Bootstrap  using Bootstrap's  table styling options  to present a consistent interface with your Bootstrap driven site / app. The main disadvantage with Data table.net is it is applying the pagination at the client side and for the large data set it can take minutes to load the data. Like every other designer I also faced the problem with Data table.net. So what is the best option to replace the client side paging and searching. So I forced to create a custom module to do the pagination and searching. The below sample don’t support the sorting, but got an option to extend the functionality. Please check my Next Post for sorting functionality The technologies used include, MVC 4.0, HTML5, Bootstarp.css, Knockout. js, Ajax, Web Api 2.0, Linq to SQL and C#. Knockout.js Model’s Filter Model var filter = function (...
Post a Comment
Read more