Intel improving the performance of MariaDB Vector

As you have probably seen in earlier posts, the preview version of MariaDB Vector is out and ready for you to play with. We have had input from several different places during the development of this feature. This, of course, includes hardware manufacturers such as Intel.

In the background, Intel have been prototyping using AVX512 instructions for dot product and bloom filter. Both of these are functions are part of vector searches. If you haven’t heard of these terms, let me try and break them down.

AVX-512 – 512-bit extensions to the Intel Advanced Vector Extension

The AVX512 instructions themselves are CPU specific instructions that are designed to run calculations on large vectors of numbers simultaneously.

How Intel helps MariaDB become even faster

There are many forums in the past couple of years where I have talked about how non-code contributions are just as important to MariaDB Server and us at the MariaDB Foundation as the code contributions I typically help with. I’ve also highlighted in the past how Intel have provided some fantastic non-code contributions. They assist us by detecting performance issues on their new and future platforms, as well guidance in finding the root cause of these issues.

The outcome: Over a million NOPM in HammerDB

Today I want to discuss some of the performance improvements that Intel has helped with, which have led to MariaDB Server achieving 1 million NOPM (new orders per minute) in the HammerDB TPROC-C test.

Accelerating MariaBackup with Intel QuickAssist

With Intel QuickAssist Technology, you can see a 5x performance in your MariaBackup compression, and lower CPU usage as well. Today I’m going to show you how.

What is Intel QuickAssist?

Nearly a decade ago, Intel released a technology called QuickAssist, which started out as a PCI-e card and then became integrated in many Xeon processes starting with the Skylake generation. QuickAssist Technology (often called QAT) is a special unit that the CPU can offload compression and encryption tasks onto.

I was lucky enough to have early access to this technology back when it was new.

The value of sponsoring MariaDB Foundation

Why does Intel sponsor the MariaDB Foundation? I had the opportunity to interview Steve Shaw, Principal Engineer at Intel and a Board Member at MariaDB Foundation.

I strongly urge you to look at the 09:34 long video on YouTube – Steve is well articulated and a pleasure to listen to. Still, here is a glimpse of what he goes into:

  1. MariaDB Server is incredibly popular software. Just the Docker image alone has had more than a billion downloads. The majority of MariaDB installations run on Intel servers and developers coding on Intel laptops and desktops.

MariaDB Non-Code Contributions by Intel

I’ve mentioned in past blog posts that not every contribution is a code contribution. There are many possible contributions that are valuable, including testing, bug reports, helping the community, etc.

Non-code contributions are quite invisible

Unfortunately, non-code contributions are sometimes invisible to the wider community, so today I wanted to shine a light on some such contributions. In this case, contributions made by one of our sponsors, Intel.

Intel is open source friendly

Intel have been an open source friendly company for a long time. But have recently pushed harder than ever towards open source, even giving their first ever new Innovation Award to Linus Torvalds.