Improving Postgres Performance Tenfold Using Go Concurrency

By LakeFS - 2020-09-29

Description

In this article we will demonstrate how Go concurrency enabled us to cut through a daunting DB (Postgres) performance barrier

Summary

  • In this article I will show how Go concurrency enabled us to cut through a daunting DB performance barrier.
  • We need to create a traffic cop that will put them in line without an interface change.
  • You may create the table using just two sql statements from this sql file The test driver I wrote a test driver that generates 3 million random keys, and sends them via a channel to three hundred reading goroutine instances(tunable by constant) that perform the reads.
  • In a future post, we will discuss more ways in which we made Postgres pull the throughput and response time required in a big data environment.

 

Topics

  1. Database (0.17)
  2. Backend (0.17)
  3. NLP (0.07)

Similar Articles

Why Discord is switching from Go to Rust

By Medium - 2020-02-04

Rust is becoming a first class language in a variety of domains. At Discord, we’ve seen success with Rust on the client side and server…

Which of these 6 time traps is eating up all your time?

By ideas.ted.com - 2020-11-05

By identifying which of these is consuming your minutes and hours, you can start carving out more happy and meaningful moments for yourself, says time and happiness researcher Ashley Whillans.