Article citationsMore>>

Topcuoglu, H., et al. (2022) Edge Scheduling of Deep Neural Networks for Real-Time Inference. IEEE Transactions on Industrial Informatics, 18, 4986-4995.

has been cited by the following article:

• TITLE: Parallel Inference for Real-Time Machine Learning Applications

  AUTHORS: Sultan Al Bayyat, Ammar Alomran, Mohsen Alshatti, Ahmed Almousa, Rayyan Almousa, Yasir Alguwaifli

  KEYWORDS: Machine Learning Models, Computational Efficiency, Parallel Computing Systems, Random Forest Inference, Hyperparameter Tuning, Python Frameworks (TensorFlow, PyTorch, Scikit-Learn), High-Performance Computing

  JOURNAL NAME: Journal of Computer and Communications, Vol.12 No.1, January 30, 2024

  ABSTRACT: Hyperparameter tuning is a key step in developing high-performing machine learning models, but searching large hyperparameter spaces requires extensive computation using standard sequential methods. This work analyzes the performance gains from parallel versus sequential hyperparameter optimization. Using scikit-learn’s Randomized SearchCV, this project tuned a Random Forest classifier for fake news detection via randomized grid search. Setting n_jobs to -1 enabled full parallelization across CPU cores. Results show the parallel implementation achieved over 5× faster CPU times and 3× faster total run times compared to sequential tuning. However, test accuracy slightly dropped from 99.26% sequentially to 99.15% with parallelism, indicating a trade-off between evaluation efficiency and model performance. Still, the significant computational gains allow more extensive hyperparameter exploration within reasonable timeframes, outweighing the small accuracy decrease. Further analysis could better quantify this trade-off across different models, tuning techniques, tasks, and hardware.