v1.0-beta

[xieus]

Release Summary

This release focuses solely on performance and scalability enhancement on agent, controller and end-to-end workflow.

Some highlight of the v1.0 release:

• Redesign ACA orchestration layer with high-performance threading model, and achieve 75% latency reduction for one-million ovs flows programming.
• Improve port/subnet/vpc api throughout by 5X compared to last release, and achieve up to 30x port throughout gain compared to Neutron at performance tipping point.
• Measure single host on-demand throughput up to 300K request/second with enhanced Alcor benchmarking framework based on CBench.
• End-to-end integrate new Goal State V2 message with SDN southbound messaging workflow
• Redesign cache/db schema in multiple microservices to remove chock point and support higher concurrency

Alcor components

• Regional control plane: https://github.com/futurewei-cloud/alcor
• Host control agent: https://github.com/futurewei-cloud/alcor-control-agent
• Python client: https://github.com/futurewei-cloud/python-alcorclient
• Performance and scalability test
  • Perf summary: https://github.com/futurewei-cloud/alcor-perf
  • Rally framework (SDN northbound top-down test): https://github.com/futurewei-cloud/rally-openstack-alcor
  • CBench framework (SDN southbound bottom-up test): https://github.com/futurewei-cloud/alcor_oflops
• E2E integration: https://github.com/futurewei-cloud/alcor-int
• Meeting note: https://github.com/futurewei-cloud/alcor-meeting

Features Added

New Features Development

• Alcor Control Agent orchestration layer v2.0 Design & Development
  • New orchestration layer to enhance scheduling of programming task to data plane (Agent PR #275)
  • ACA threading model redesign to support high concurrency (Perf report)
  • Evaluation of high performance task framework and integrate CBench with ACA (Oflops PR #1)
  • Add finish call for gRPC server (Agent PR #272)
• Alcor Goal State V2 E2E integration
  • Data Plane Manager supports GSv2 for unicast and multicast (Controller PRs [Data-Plane Mgr] Support GoalStateV2 for UnicastGS and MulticastGS #625, Fix data plane manager to support goal state v2 #699)
  • Network Configuration Manager supports new GSv2 (Controller PR Send GoalStateV2 from DPM, NCM and ACA #704)
  • Alcor Control Agent supports routing rule update with GSv2 (Agent PR #267)
  • Make GS version configurable and support backward compatibility to GSv1 (Controller PR Add GoalStateV1 support #718)

Alcor Performance & Scalability

• Performance/Scalability report and plan
  • NCM stress test report (Perf PR #13)
  • ACA threading model and task scheduler engine (Perf report)
• Microservice Performance Design & Improvement
  • Improve caching performance for port/ip/vpc managers and common libraries (Controller PR Improve caching performance for port/ip/vpc manager #690)
  • Refactor db/cache codes in DPM to support GSv2 (Controller PRs [DPM] Refactor db/cache codes to support GoalStateV2 design #713)
  • Support SQL field query in Alcor (Controller PR [DB] Support SQL Field Query in Alcor #703)
  • Ignite watch feature test framework (Perf PR #11)
  • Reduce distribute lock and improve concurrency for Ip Manager ipAddrRangeCache (Controller PR Improve ip manger performance #702)
  • DPM reduces message redundancy to NCM (Controller PR Improve DPM and NCM performance #734)
  • Test control enhancement with new configuration options (Controller PR Test controller enhancement with new configuration options #694)
  • Support coexistence of gRPC and REST APIs (Controller PR [Netw Config Manager] Support coexist of gRPC and REST APIs  #706)
• Message Queue scale path improvement
  • Enable pulsar client support VPC-topic mode based on GSv1 and GSv2 (Controller PR Enable pulsar client support VPC-topic mode based on GSv1 and GSv2 #695)
  • Add rollback mechanism for failure of sending TopicInfo (Controller PR [DPM] Add rollback mechanism for failure of sending TopicInfo #726)
  • Map vpcId to hostIp in MulticastGoalStateV2 (Controller PR [DPM] Map vpcId to hostIp in MulticastGoalStateV2 #728)
  • Add listeners for multicast and unicast consumers (Agent PR #268)

Alcor Fundamental

• Alcor DevOps and CI/CD enhancement
  • Kolla Ansible test scripts and Rally task configurations (Perf PR #6)
  • Alcor K8s deployment improvement (Controller PRs Update ignite k8s config #692, [K8s Deployment] Improve deployment configuration and scripts #693, [Deployments] Update service link configs for K8s yaml #675, [Deployment] DPM and NCM to use standalone Ignite DB. #732, [Deployment] K8s deployment enhancement #733, Fix ignite configuration #736, Improve DPM and NCM performance #734)
  • Jenkins workflow bug fix (Controller PRs [CI/CD] Fix Jenkins workflow bug to avoid false positive #697, [CI/CD] Improve handling of Jenkins error and exit #709)
• Alcor distributed tracing framework
  • Enable Jaeger/OpenTracing in NCM and TC (Controller PR [Tracing] Support Jaeger tracing in NCM and TC #707)
• Dependency upgrade (Controller PRs [Dependency] Upgrade Ignite to 2.10.0 #691, [Dependency] Upgrade guava package to 30.0+ #714, Bump protobuf-java from 3.8.0 to 3.16.1 in /legacy #723, Bump protobuf-java from 3.8.0 to 3.16.1 in /schema #724, Bump protobuf-java from 3.8.0 to 3.16.1 in /lib #725)
• Code stabilization
  • Agent bug fix (Agent PRs #270, PR #271, PR #277)

---

This discussion was created from the release v1.0-beta.