Gentoo Forums
Gentoo Forums
Gentoo Forums
Quick Search: in
Poor performance on 100 Gbps adapter
View unanswered posts
View posts from last 24 hours

 
Reply to topic    Gentoo Forums Forum Index Networking & Security
View previous topic :: View next topic  
Author Message
mcbarlo
Tux's lil' helper
Tux's lil' helper


Joined: 18 Jul 2005
Posts: 130

PostPosted: Wed Jul 04, 2018 7:33 am    Post subject: Poor performance on 100 Gbps adapter Reply with quote

I need to configure BGP router for very high throughput. My hardware is:

Lenovo x3550 M5
1x E5-2697v3 CPU
Mellanox ConnectX-4 ethernet adapter 2x100GE

BGP daemon is Bird, kernel 4.9.95-gentoo.

Everything works fine to 30 Gbps bandwitch. Above this value CPU load caused by sys rise dramatically.

What I do to optimize:

1. Irqbalance daemon is disabled. SoftIRQ balancing fine.
2. Enabled jumbo frames.
3. Set net.core.netdev_budget to 600. May be shoud be higher?
4. Turn off adaptive-rx. Adaptive-tx was turned off default.

What can I do more? What kernel options I should watch for? Set tick to 100HZ or 1000HZ, use real time kernel sources?

I will be glad for any suggestion.
Back to top
View user's profile Send private message
massimo
Veteran
Veteran


Joined: 22 Jun 2003
Posts: 1226

PostPosted: Wed Jul 04, 2018 9:20 am    Post subject: Reply with quote

Eventually you find some clues at https://fasterdata.es.net/assets/Papers-and-Publications/100G-Tuning-TechEx2016.tierney.pdf and/or https://community.mellanox.com/docs/DOC-1523 .
_________________
Hello 911? How are you?
Back to top
View user's profile Send private message
Display posts from previous:   
Reply to topic    Gentoo Forums Forum Index Networking & Security All times are GMT
Page 1 of 1

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum