Resource management for parallel processing frameworks with load awareness at worker side