ISISTAN 23985
INSTITUTO SUPERIOR DE INGENIERIA DEL SOFTWARE
Unidad Ejecutora - UE
congresos y reuniones científicas
Título:
Job Schedulers for Machine Learning and Data Mining algorithms distributed in Hadoop
Autor/es:
CORNEJO, M.; MURAZZO, M.; ZUNINO, A.
Lugar:
La Plata
Reunión:
Jornada; VI Jornadas de Cloud Computing & Big Data; 2018
Institución organizadora:
Facultad de Informática, UNLP
Resumen:
The standard scheduler of Hadoop does not consider the characteristics of jobs such as computational demand, inputs / outputs, dependencies, location of the data, etc., which could be a valuable source to allocate resources to jobs in order to optimize their use. The objective of this research is to take advantage of this information for planning, limiting the scope to ML / DM algorithms, in order to improve the execution times with respect to existing schedulers. The aim is to improve Hadoop job schedulers, seeking to optimize the execution times of machine learning and data mining algorithms in Clusters.
