Search results

[core] Very slow task scheduling during Dataset.sort on 100TB

bugSomething that is supposed to be working; but isn'tSomething that is supposed to be working; but isn't

coreIssues that should be addressed in Ray CoreIssues that should be addressed in Ray Core

P3Issue moderate in impact or severityIssue moderate in impact or severity

pending-cleanupThis issue is pending cleanup. It will be removed in 2 weeks after being assigned.This issue is pending cleanup. It will be removed in 2 weeks after being assigned.

Status: Closed (completed).

#27410 In ray-project/ray;

· by stephanie-wang was closed on Jun 30, 2025

· 

Large-scale shuffle on Ray

[dataset] Reduce tasks in push-based shuffle are not evenly distributed

bugSomething that is supposed to be working; but isn'tSomething that is supposed to be working; but isn't

P2Important issue, but not time-criticalImportant issue, but not time-critical

pending-cleanupThis issue is pending cleanup. It will be removed in 2 weeks after being assigned.This issue is pending cleanup. It will be removed in 2 weeks after being assigned.

Status: Closed (completed).

#25468 In ray-project/ray;

· by stephanie-wang was closed on Jun 30, 2025

· 

Large-scale shuffle on Ray

[core] GC of spilled objects falls behind under load, causing out-of-disk errors

bugSomething that is supposed to be working; but isn'tSomething that is supposed to be working; but isn't

P1Issue that should be fixed within a few weeksIssue that should be fixed within a few weeks

Status: Closed (completed).

#25467 In ray-project/ray;

· by stephanie-wang was closed on Jun 16, 2022

· 

Large-scale shuffle on Ray

[core] Node sometimes marked as dead due to lagging heartbeats in Datasets shuffle

bugSomething that is supposed to be working; but isn'tSomething that is supposed to be working; but isn't

dataRay Data-related issuesRay Data-related issues

P1Issue that should be fixed within a few weeksIssue that should be fixed within a few weeks

Status: Closed (completed).

#25231 In ray-project/ray;

· by stephanie-wang was closed on Sep 9, 2022

· 

Large-scale shuffle on Ray

[Core][GCS] Raylet crashes after losing connection to GCS

bugSomething that is supposed to be working; but isn'tSomething that is supposed to be working; but isn't

coreIssues that should be addressed in Ray CoreIssues that should be addressed in Ray Core

P2Important issue, but not time-criticalImportant issue, but not time-critical

Status: Closed (completed).

#25175 In ray-project/ray;

· by mwtian was closed on Dec 13, 2022

· 

Large-scale shuffle on Ray

[core][tests] Make dataset_shuffle_push_based_random_shuffle_1tb release test stable

P1Issue that should be fixed within a few weeksIssue that should be fixed within a few weeks

Status: Closed (completed).

#25163 In ray-project/ray;

· by stephanie-wang was closed on Aug 8, 2022

· 

Large-scale shuffle on Ray

[Core] Infinite retry when spill fails

bugSomething that is supposed to be working; but isn'tSomething that is supposed to be working; but isn't

P1Issue that should be fixed within a few weeksIssue that should be fixed within a few weeks

Status: Closed (completed).

#25085 In ray-project/ray;

· by jjyao was closed on May 28, 2022

· 

Large-scale shuffle on Ray

[Core] Owner has incorrect in-memory locations of object

bugSomething that is supposed to be working; but isn'tSomething that is supposed to be working; but isn't

triageNeeds triage (eg: priority, bug/not-bug, and owning component)Needs triage (eg: priority, bug/not-bug, and owning component)

Status: Closed (completed).

#25084 In ray-project/ray;

· by jjyao was closed on May 24, 2022

· 

Large-scale shuffle on Ray

[Core] driver occasionally hangs after node is preempted

bugSomething that is supposed to be working; but isn'tSomething that is supposed to be working; but isn't

coreIssues that should be addressed in Ray CoreIssues that should be addressed in Ray Core

needs-repro-scriptIssue needs a runnable script to be reproducedIssue needs a runnable script to be reproduced

P0Issues that should be fixed in short orderIssues that should be fixed in short order

Status: Closed (completed).

#24969 In ray-project/ray;

· by dirkweissenborn was closed on Jan 17, 2023

· 

Large-scale shuffle on Ray

[Dataset] Report peak memory usage during task in Dataset stats

dataRay Data-related issuesRay Data-related issues

enhancementRequest for new feature and/or capabilityRequest for new feature and/or capability

P2Important issue, but not time-criticalImportant issue, but not time-critical

Status: Closed (completed).

#24557 In ray-project/ray;

· by stephanie-wang was closed on Dec 19, 2023

· 

Large-scale shuffle on Ray

[Dataset][core] Scale Dataset.random_shuffle and sort to 100TB

enhancementRequest for new feature and/or capabilityRequest for new feature and/or capability

P1Issue that should be fixed within a few weeksIssue that should be fixed within a few weeks

Status: Closed (completed).

#24480 In ray-project/ray;

· by stephanie-wang was closed on Jul 1, 2022

· 

Large-scale shuffle on Ray

[Datasets] Sort should support fusion with previous stages

dataRay Data-related issuesRay Data-related issues

enhancementRequest for new feature and/or capabilityRequest for new feature and/or capability

P2Important issue, but not time-criticalImportant issue, but not time-critical

Status: Closed (completed).

#24270 In ray-project/ray;

· by stephanie-wang was closed on Dec 19, 2023

· 

Large-scale shuffle on Ray