Parth Mistry – Medium

Feb 28

Performing SCD-2 merge over a Billion Records Table with Standalone Local Spark

Dimensional Data Modeling and Change Data Capture (CDC) is important in every data warehouses. Kimball and his team introduced dimensional data modeling to the world in late 90s and since then it became kind of de-facto standard to structure data warehouses. One of the concept in dimensional data modeling is…

Spark

5 min read

Spark

5 min read

Dec 1, 2022

Project Loom and Project Reactor - Better Together

Project Loom is now available as a preview feature as part of Java 19. It introduces virtual threads to Java platform which is a lightweight implementation of threads that is provided by the JDK rather than the OS. About one year ago I came across this YouTube video where Brian…

Java

9 min read

Java

9 min read

Oct 10, 2022

Assessing web application performance on single-core machine

Modern web applications developed on top of non-blocking I/O facilities can easily serve tens of thousands of concurrent requests per host (with moderate sized hardware). Together with horizontal scalability, scenarios where applications serve millions of concurrent requests are not new. Each web application instance being deployed is supposed to handle…

Java

5 min read

Assessing web application performance on single-core machine

Java

5 min read

Aug 4, 2022

Tuning concurrent request settings for Apache HTTP Client

Apache HTTP client library is often used in Java applications. It is easy to use and comes with both blocking and non-blocking(async) variants. Even after introduction of built-in HTTP client inside modern JDK where developers may prefer to use built-in HTTP client - Apache HTTP client still could be part…

Java

5 min read

Java

5 min read

Jun 24, 2022

Tuning linux network stack - with examples - Part 2

In Tuning linux network stack - with examples - Part 1, I discussed about how tuning certain kernel level settings can affect capacity of the networking application. In this post I am going to discuss about settings which could affect throughput for the established socket connections Similar to the previous…

Linux

9 min read

Linux

9 min read

May 13, 2022

Tuning linux network stack - with examples - Part 1

By default Linux network stack (network related kernel settings) is configured for general-purpose networking requirement. This default configuration is usually adequate for typical usages such as running desktop applications and some sorts of server applications where full potential of available network capacity may not need to be utilized. …

Linux

10 min read

Linux

10 min read

Mar 10, 2022

Beware of calling long running native code together with high throughput workload in the same JVM

Sometimes there is a need to call native library functions (through JNI) from the application running on Java. For example, there are libraries available with fast native implementation algorithms like compression, cipher-suites, machine learning etc related use cases where processing can be done without all JVM overheads, in other cases…

Java

4 min read

Beware of calling long running native code together with high throughput workload in the same JVM

Java

4 min read

Jan 31, 2022

Checking performance of different SSL/TLS implementations for Java Applications

Java comes with built-in implementation of platform independent crypto algorithms which are used by default to handle SSL/TLS traffic. However this Java based built-in implementation is deemed slow and CPU intensive for many years. …

Java

3 min read

Java

3 min read