Hussein Nasser
Hussein Nasser
  • Видео 896
  • Просмотров 23 144 272
IO uring gets Zero Copy network operations
Fundamentals of Operating Systems Course
os.husseinnasser.com
Linux I/O expert and subsystem maintainer Jens Axboe has submitted all of the IO_uring feature updates ahead of the imminent Linux 6.10 merge window.
In this video I explore this with a focus on what zerocopy.
0:00 Intro
0:30 IO_uring gets faster
2:00 What is io_uring
7:00 How Normal Copying Work
12:00 How Zero Copy Works
13:50 ZeroCopy and TLS
www.phoronix.com/news/Linux-6.10-IO_uring
lore.kernel.org/io-uring/fef75ea0-11b4-4815-8c66-7b19555b279d@kernel.dk/?s=09
Backend Troubleshooting Course
performance.husseinnasser.com
Fundamentals of Backend Engineering (link redirects to udemy with coupon)
backend.husseinnasser.com
Fundamentals of Netw...
Просмотров: 9 966

Видео

They made Python faster with this compiler option
Просмотров 11 тыс.Месяц назад
Fundamentals of Operating Systems Course oscourse.win Looks like fedora is compiling cpython with the -o3 flag, which does aggressive function inlining among other optimizations. This seems to improve python benchmarks performance by at most 1.16x at a cost of an extra 3MB in binary size (text segment). Although it does seem to slow down some benchmarks as well though not significantly. O1 - lo...
They made Kafka 80% faster by switching file systems
Просмотров 33 тыс.Месяц назад
Allegro improved their Kafka produce tail latency by over 80% when they switched from ext4 to xfs. What I enjoyed most about this article is the detailed analysis and tweaking the team made to ext4 before considering switching to xfs. This is a classic case of how a good tech blog looks like in my opinion. 0:00 Intro 0:30 Summary 2:35 How Kafka Works? 5:00 Producers Writes are Slow 7:10 Tracing...
Fundamentals of Operating Systems
Просмотров 11 тыс.Месяц назад
Head to os.husseinnasser.com to grab my new OS course Operating systems (their kernel specifically) orchestrate many processes, allow access to memory, disk, network and execute processes by scheduling them to the CPU. Sounds simple when we put it this way but this task is vast. Writing efficient programs depends on how much understanding the engineer has in OS kernel. When we access a 32 bit i...
Google Patches Linux kernel with 40% TCP performance
Просмотров 127 тыс.3 месяца назад
Google submitted a patch to Linux Kernel 6.8 to improve TCP performance by 40%, this is done via rearranging the tcp structures for better cpu cache lines, I explore this here. 0:00 Intro 0:30 Google improves Linux Kernel TCP by 40% 1:40 How CPU Cache Line Works 6:45 Reviewing the Google Patch www.phoronix.com/news/Linux-6.8-Networking lore.kernel.org/netdev/20231129072756.3684495-1-lixiaoyan@g...
Cloudflare Open sources Pingora (NGINX replacement)
Просмотров 29 тыс.3 месяца назад
Cloudflare has announced they are open sourcing Pingora as a networking framework! This is their in-house Rust proxy they built few years ago to replace NGINX This is kind of Big news for few reasons, let us discuss blog.cloudflare.com/pingora-open-source/? 0:00 Intro 0:30 Reasons why Cloudflare built Pingora? 3:00 It is a framework! 7:30 What in Pingora? 11:50 Security in Pingora 13:45 Multi-t...
The Cost of Memory Fragmentation
Просмотров 7 тыс.4 месяца назад
Fragmentation is a very interesting topic to me, especially when it comes to memory. While virtually memory does solve external fragmentation (you can still allocate logically contiguous memory in non-contiguous physical memory) it does however introduce performance delays as we jump all over the physical memory to read what appears to us for example as contiguous array in virtual memory. You s...
How a Machine Becomes a Router | ip_forward
Просмотров 6 тыс.5 месяцев назад
Recently I learned how the Linux option net.ipv4.ip_forward can turn your machine into a router. I have been using this option in past when working with iptables but never paid attention to how it works. I explore this here. You see, when your NIC receives a frame from the network with a MAC address the frame is copied to the kernel if the MAC address matches the NIC’s. If doesn’t match the NIC...
The Real Hidden Cost of a Request
Просмотров 28 тыс.6 месяцев назад
In this video I explore the hidden costs of sending a request from the frontend to the backend More details here medium.com/@hnasr/the-journey-of-a-request-to-the-backend-c3de704de223 Discovering Backend Bottlenecks: Unlocking Peak Performance performance.husseinnasser.com Fundamentals of Backend Engineering Design patterns udemy course (link redirects to udemy with coupon) backend.husseinnasse...
Why create Index blocks writes
Просмотров 11 тыс.7 месяцев назад
Fundamentals of Database Engineering udemy course (link redirects to udemy with coupon) database.husseinnasser.com Why create Index blocks writes In this video I explore how create index, why does it block writes and how create index concurrently work and allow writes. 0:00 Intro 1:28 How Create Index works 4:45 Create Index blocking Writes 5:00 Create Index Concurrently Discovering Backend Bot...
Before you move to HTTP/3 ...
Просмотров 16 тыс.8 месяцев назад
HTTP/3 is getting popular in the cloud scene but before you migrate to HTTP/3 consider its cost. I explore it here. 0:00 Intro HTTP/3 is getting popular 3:40 HTTP/1.1 Cost 5:18 HTTP/2 Cost 6:30 HTTP/3 Cost blog.apnic.net/2023/09/25/why-http-3-is-eating-the-world/ Discovering Backend Bottlenecks: Unlocking Peak Performance performance.husseinnasser.com Fundamentals of Backend Engineering Design ...
Deep dive on how static files are served with HTTP (kernel, sockets, file system, memory, zero copy)
Просмотров 20 тыс.8 месяцев назад
In this video I do a deep dive on how serving static files work in web servers. 0:00 Intro 2:00 Overview 3:00 Request handling and Receive Queue 8:50 Reading file from disk 13:50 Response and the Send Queue 24:00 Sending Response to the Client Discovering Backend Bottlenecks: Unlocking Peak Performance performance.husseinnasser.com Fundamentals of Backend Engineering Design patterns udemy cours...
The Pros and Cons of Encrypted Client Hello
Просмотров 6 тыс.8 месяцев назад
Discovering Backend Bottlenecks: Unlocking Peak Performance performance.husseinnasser.com The Encrypted Client Hello or ECH is a new RFC that encrypts the TLS client hello to hide sensitive information like the SNI. In this video I go through pros and cons of this new rfc. 0:00 Intro 2:00 SNI 4:00 Client Hello 8:40 Encrypted Client Hello 11:30 Inner Client Hello Encryption 18:00 Client-Facing O...
The effect of Random UUID on database performance
Просмотров 69 тыс.10 месяцев назад
In this video I whiteboard how UUIDs hurt write (and read performance) when used on secondary and primary indexes. UUIDv4 are the most popular but they are truly random. Compared to snowflakes, ULID or UUIDv7 or even UUIDv1. 0:00 UUIDv4 2:30 B Tree Indexes and UUID 5:30 Random UUIDv4 Insert Workload 12:40 Ordered Insert Workload (UUID7/ULID, Sequence) 14:00 Shared buffer pool flushes 15:00 Shop...
how greedy are your processes? | Linux niceness
Просмотров 16 тыс.10 месяцев назад
how greedy are your processes? | Linux niceness
How CPU Efficient is your App?
Просмотров 14 тыс.10 месяцев назад
How CPU Efficient is your App?
How does the Kernel manage backend Connections?
Просмотров 11 тыс.10 месяцев назад
How does the Kernel manage backend Connections?
What happens before the Backend gets the Request
Просмотров 47 тыс.10 месяцев назад
What happens before the Backend gets the Request
They Enabled Postgres Partitioning and their Backend fell apart
Просмотров 38 тыс.Год назад
They Enabled Postgres Partitioning and their Backend fell apart
New course alert - Unlocking Backend Performance
Просмотров 16 тыс.Год назад
New course alert - Unlocking Backend Performance
WebTransport is a Game Changer Protocol
Просмотров 53 тыс.Год назад
WebTransport is a Game Changer Protocol
Your SSD lies but that's ok .. I think | Postgres fsync
Просмотров 20 тыс.Год назад
Your SSD lies but that's ok .. I think | Postgres fsync
The problem with software engineering
Просмотров 64 тыс.Год назад
The problem with software engineering
Clustered Collections makes Mongo faster but there is a cost
Просмотров 22 тыс.Год назад
Clustered Collections makes Mongo faster but there is a cost
Prime Video Swaps Microservices for Monolith: 90% Cost Reduction
Просмотров 157 тыс.Год назад
Prime Video Swaps Microservices for Monolith: 90% Cost Reduction
A Deep Dive in How Slow SELECT * is
Просмотров 36 тыс.Год назад
A Deep Dive in How Slow SELECT * is
AWS Serverless Lambda Supports Response Streaming
Просмотров 26 тыс.Год назад
AWS Serverless Lambda Supports Response Streaming
The Cloudflare mTLS vulnerability - A Deep Dive Analysis
Просмотров 9 тыс.Год назад
The Cloudflare mTLS vulnerability - A Deep Dive Analysis
The Virgin Media ISP outage - What happened?
Просмотров 6 тыс.Год назад
The Virgin Media ISP outage - What happened?
GitHub SSH key is Leaked - How bad is this?
Просмотров 67 тыс.Год назад
GitHub SSH key is Leaked - How bad is this?

Комментарии

  • @wisdompeters4521
    @wisdompeters4521 День назад

    you literally just pulled me out from a realm of perplexities!!! just starting out, and lately I don't really know how to go about it, but with this mini-roadmap you spilled out, oh boy! I'm like 70% relieved and revived. Thank you so much sir for this eye-opening golden information.

  • @MrJloa
    @MrJloa День назад

    Considering that a budget phone has octa-core cpu nowadays which costs like 200$ and the fact that in most of the world the isp speed is still crap like 20mbs, its probably a good bargain to trade off the cpu usage. Coz atm the only bottleneck is the connection speed imo. Even in western Europe in most countries u get a 20-30mbs furthermore its expensive 🫰 While the cpu/ram cost nothing

  • @sk-x001
    @sk-x001 День назад

    GOLD...

  • @OctaloopAI
    @OctaloopAI 2 дня назад

    well explained

  • @mohamedgabr5623
    @mohamedgabr5623 2 дня назад

    I miss when Hussein was creating a content for juniors 😢😂

  • @vmdcortes
    @vmdcortes 2 дня назад

    I love your explanation, awesome!!! 🎉

  • @mossaabboudchicha84
    @mossaabboudchicha84 2 дня назад

    In 13:46 you have made a mistake about the directories and files used by kafka to ensure storage,according to the articles you relying on,the directory is not the topic but the partition and the segment files are used to store messages,juste a clarification.

    • @hnasr
      @hnasr День назад

      good catch, thanks !

  • @m_codes
    @m_codes 2 дня назад

    Love your content bro. Very appreciated

  • @adooken1019
    @adooken1019 2 дня назад

    Please do a refresh of that Kafka video !

  • @noraalsulttan1437
    @noraalsulttan1437 2 дня назад

    thank you, was easy to follow through :)

  • @andrewithnowsite1557
    @andrewithnowsite1557 3 дня назад

    Yes, it's now available AI/machine learning...seems you were predicting the future

  • @andrewithnowsite1557
    @andrewithnowsite1557 3 дня назад

    I think user experience should be the first step.

  • @mohamedshahrul1750
    @mohamedshahrul1750 3 дня назад

    for remote port forwading why are using two machines 10.0.0.3:8080 and 10.0.0.4? by the way 10.0.0.4 is not even used in the SSH command. can u please clarify?

  • @priyanshugupta5893
    @priyanshugupta5893 3 дня назад

    CPU Bound - index can fit in memory IO Bound - index cannot fit in memory

  • @PtYt24
    @PtYt24 3 дня назад

    They could have saved themselves a lot of time by using the timescaledb postgresql extension.

  • @hangduong9608
    @hangduong9608 3 дня назад

    Such an amazing sharing from you, Hussein! I wonder among those backend domains (network, DB, Security,...) what are yours favorites/strongest?

  • @savingday
    @savingday 3 дня назад

    It's like tuning in to a radio station lol

  • @user-lc9gn2hr6h
    @user-lc9gn2hr6h 3 дня назад

    Thanks for the video!! Clears a lot of things up for me. The bottleneck of using socat disappeared after I switched to iptables.

  • @pauloiscoding
    @pauloiscoding 4 дня назад

    Deixei o like logo no início do vídeo, mas no final tirei o like pra poder dar like de novo.

  • @dtmhyoutu
    @dtmhyoutu 5 дней назад

    @hnasr I got pending when creating offer with lc in chrome, but it returned ice candidate on firefox. What should I do to get ice candidate from lc.create_offer on chrome?

  • @rv0_0
    @rv0_0 5 дней назад

    I dont know how did i landed here, but i am glad that i landed here.

  • @energy-tunes
    @energy-tunes 5 дней назад

    you really seem hyperautistic in a good way and knowledgeable its a shame you shill your courses every 2 minutes </3

  • @vasujain2
    @vasujain2 5 дней назад

    What a beautiful thumbnail man!

  • @Hamza-Shreef
    @Hamza-Shreef 5 дней назад

    I don't know but i felt confused some times and got no clue whether it's SQL or Mongo that he is talking about at the first part cuz of row terminology that he abused its usage a lot. but overall the video is nice.

  • @wreckless_gaming
    @wreckless_gaming 6 дней назад

    WE NEED MORE IIS VIDEOS!!!

  • @thebrijpatel
    @thebrijpatel 6 дней назад

    I remember watching this 3 years ago. Back then I was a Jr. dev and was not interviewing anyone. Now that I've started interviewing folks as a Sr. I always make sure to ask this question to the right candidates.

  • @tobbymarchal3140
    @tobbymarchal3140 6 дней назад

    Is the real katana?

  • @MaxPrehl
    @MaxPrehl 7 дней назад

    This is a great breakdown! Wish you also had some visual aids!

  • @ProgrammingWIthRiley
    @ProgrammingWIthRiley 7 дней назад

    Hey Dude you’re right

  • @mrstatler
    @mrstatler 7 дней назад

    It's confusing... has the firewall only one network interface or it's just to explain the idea?

  • @SEASLU
    @SEASLU 8 дней назад

    Thanks Hussein. You explain everything so well. I wonder if there's a way for server to know if messages were delivered successfully? What if some messages are dropped?

  • @alainpannetier2543
    @alainpannetier2543 8 дней назад

    2:46 TCP window size?

  • @theroadofchampion
    @theroadofchampion 8 дней назад

    I think, i finish of all your 3 playlist, before this month end. Challenge accepted. And thank you for content 👍

  • @jhguygih
    @jhguygih 8 дней назад

    Great content. I have one question, where can I find material explaining the pros and cons of each tree? You mentioned range querie on B tree is not as efficient. Why is that? Why we need a find for every node and not collect results once we find the end of the range

  • @naryno3999
    @naryno3999 8 дней назад

    That's very helpful! Thanks.

  • @imanshirkhodaee1704
    @imanshirkhodaee1704 8 дней назад

    great tnx

  • @danielbocelli
    @danielbocelli 9 дней назад

    Please explain to me why a second column with a timestamp couldn’t serve this purpose?

  • @cheikhcheikh-hi5ey
    @cheikhcheikh-hi5ey 9 дней назад

    Very nice story

  • @KrAsHeDD
    @KrAsHeDD 9 дней назад

    It was very short indeed. lol I totally enjoyed watching and learnt something. Thank you!

  • @Alysha-nx7ko
    @Alysha-nx7ko 10 дней назад

    baddo desuka, lmaooooo watching too much anime? baddo desu yo!