communications

On the resolution of a theoretical question related to the nature of local training in federated learning

-

B1 L3 R3119

In this talk, I will explain the problem, its solution, and some subsequent work generalizing, extending and improving the ProxSkip method in various ways. We study distributed optimization methods based on the local training (LT) paradigm - achieving improved communication efficiency by performing richer local gradient-based training on the clients before parameter averaging - which is of key importance in federated learning. Looking back at the progress of the field in the last decade, we identify 5 generations of LT methods: 1) heuristic, 2) homogeneous, 3) sublinear, 4) linear, and 5) accelerated. The 5th generation, initiated by the ProxSkip method of Mishchenko et al (2022) and its analysis, is characterized by the first theoretical confirmation that LT is a communication acceleration mechanism.

Prof. Alouini selected as an IEEE Communications Society Distinguished Lecturer for 2016 and 2017

1 min read ·
Congratulations to Prof. Alouini for being selected to give a Distinguished Lecture for 2016 and 2017 in IEEE Communications Society

Marie Sklodowska-Curie Fellowships in Photonics @ CEMSE – call 4 - 2018

1 min read ·
A group of professors working in the area of photonics at KAUST, most of them with CEMSE Division, offer hosting of outgoing Marie Sklodowska-Curie Fellowships in their research groups within the EU H2020 COFUND Postdoctoral Fellowship Programme MULTIPLY.

Lighting the way to the underwater Internet of things

1 min read ·
An optical system for monitoring underwater sensor positions could enable large networks of devices to be deployed for ocean measurements.

Tiny, fast, accurate technology on the radar

1 min read ·
A tiny, portable radar device could allow visually impaired people, or unmanned moving devices, to detect objects in real time.

Patterned optical chips keep secrets perfectly safe

1 min read ·
Chaos could help put cyberhackers out of business with a patterned silicon chip that will be uncrackable even in the future.

Angling for underwater WiFi

1 min read ·
Scuba divers could send sea life shots in real time using an aquatic internet service.

Mohamed-Slim Alouini

Al-Khawarzmi Distinguished Professor, Electrical and Computer Engineering
Professor Alouini, a co-founder of KAUST's ECE program, inspires future engineers through his pioneering work in wireless communications. His integrated space-air-ground networks and optical communication systems research shape connectivity's future and embody KAUST's scientific excellence and global impact.