How to Clean Cache Files that Use More Disk Space

Issue

This article provides the steps to be followed to clean up the disk space.

Cause

The disk space in all node managers is less and this causes yarn to stop executing all jobs.

Solution

Use the following script:

#! /bin/bash ### To be run by admins echo "Started!!!" for i in $(seq 0 7); do yes | ssh wn${i}-infowo -t sudo rm -rf /mnt/resource/hadoop/yarn/local/usercache /mnt/resource/hadoop/yarn/local/filecache; done

Reference

Other Details