.. blogpost:: :title: Performance :keywords: linear algebra, CPU :date: 2021-05-03 :categories: performance Quelques articles sur la performance. * `How to optimize GEMM on CPU `_ * `SLIDE : In Defense of Smart Algorithms over Hardware Acceleration for Large-Scale Deep Learning Systems `_ * `Scalable and Sustainable Deep Learning via Randomized Hashing `_ * `Accelerating SLIDE Deep Learning on Modern CPUs: Vectorization, Quantizations, Memory Optimizations, and More `_ Other papers: * `ZeRO: Memory Optimizations Toward Training Trillion Parameter Models `_ Fairness: * `How Facebook got addicted to spreading misinformation `_ * `Fairness and machine learning `_ Neural networks: * `Neural Tangent Kernel: Convergence and Generalization in Neural Networks `_ Arbres : * `Unbiased Measurement of Feature Importance in Tree-Based Methods `_ Collèges de France * `Une vision mathématique du "Deep Learning" `_ * `Stéphane Mallat, Représentation Parcimonieuse `_ * `Algorithmes quantiques : quand la physique quantique défie la thèse de Church-Turing `_ Autres * `Invariant Risk Minimization `_ (... Bottou ...) * `Deep Neural Networks Motivated by Partial Differential Equations `_ * `Lagrangian Neural Networks `_ ML * `A Hierarchical Model for Data-to-Text Generation `_ Apprentissage par renforcement * `Dynamic Programming in Distributional Reinforcement Learning `_ * `A Distributional Perspective on Reinforcement Learning `_ Ethique * `Quelle responsabilité pour les algorithmes `_ Quelques autres directions : * `plaidml `_, `Stripe: Tensor Compilation via the Nested Polyhedral Model `_ Une énième implémentation de pipeline de machine learning : `kedro `_. Quelques PR intéressantes (scikit-learn) : * `Improve near constant feature detection in scalers `_ * `MNT Avoid catastrophic cancellation in mean_variance_axis `_