Dynamic Priority Coflow Scheduling in Optical Circuit Switched Networks

Hongkun Ren, Hong Shen, Xin Wang

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

OCS (Optical Circuit Switch) is increasingly popular for accelerating data transmission of coflows due to its higher bandwidth and lower power consumption compared with EPS (Electronic Packet Switch), where a coflow is a collection of related parallel flows between two computation stages in data-intensive applications. However, the extra port constraints and reconfiguration delay of OCS obstruct the efficiency of OCS operations. This paper studies the problem of coflow scheduling in the OCS of datacenter networks to minimize the total Coflow Completion Time (CCT). We propose a Dynamic Priority Coflow Scheduling Algorithm that schedules coflows preemptively by considering coflow transmission time and OCS reconfiguration delay jointly to dynamically update each coflow's priority, which can significantly reduce the waiting time of small coflows and reduce head-of-line blocking. Extensive simulations based on Facebook data traces show that our approach outperforms the state-of-the-art scheme OMCO [19] significantly, and transmits multiple coflows 1.30× faster than OMCO.

Original languageEnglish
Title of host publicationParallel and Distributed Computing, Applications and Technologies - Proceedings of PDCAT 2023
EditorsJi Su Park, Hiroyuki Takizawa, Hong Shen, James J. Park
PublisherSpringer Science and Business Media Deutschland GmbH
Pages215-226
Number of pages12
ISBN (Print)9789819982103
DOIs
Publication statusPublished - 2024
Event24th International Conference on Parallel and Distributed Computing, Applications and Technologies, PDCAT 2023 - Jeju, Korea, Republic of
Duration: 16 Aug 202318 Aug 2023

Publication series

NameLecture Notes in Electrical Engineering
Volume1112 LNEE
ISSN (Print)1876-1100
ISSN (Electronic)1876-1119

Conference

Conference24th International Conference on Parallel and Distributed Computing, Applications and Technologies, PDCAT 2023
Country/TerritoryKorea, Republic of
CityJeju
Period16/08/2318/08/23

Keywords

  • Coflow Scheduling
  • Optical Circuit Switch

Fingerprint

Dive into the research topics of 'Dynamic Priority Coflow Scheduling in Optical Circuit Switched Networks'. Together they form a unique fingerprint.

Cite this