Tux's lil' helper
Joined: 18 Jul 2005
|Posted: Wed Jul 04, 2018 7:33 am Post subject: Poor performance on 100 Gbps adapter
|I need to configure BGP router for very high throughput. My hardware is:
Lenovo x3550 M5
1x E5-2697v3 CPU
Mellanox ConnectX-4 ethernet adapter 2x100GE
BGP daemon is Bird, kernel 4.9.95-gentoo.
Everything works fine to 30 Gbps bandwitch. Above this value CPU load caused by sys rise dramatically.
What I do to optimize:
1. Irqbalance daemon is disabled. SoftIRQ balancing fine.
2. Enabled jumbo frames.
3. Set net.core.netdev_budget to 600. May be shoud be higher?
4. Turn off adaptive-rx. Adaptive-tx was turned off default.
What can I do more? What kernel options I should watch for? Set tick to 100HZ or 1000HZ, use real time kernel sources?
I will be glad for any suggestion.