• Feed
  • Discussions
Model compression

Model compression

#model-compression
0 followers·2 articles

Model compression

#model-compression·0 followers·2 articles
Model compression
Nandeesh
Nandeesh
1bytenand.hashnode.dev·Apr 17, 2023
Apr 17, 2023

Compression of deep neural networks: P-1

Since the inception of the Deep Neural Network, their complexity has been increasing. For a small comparison, look at the table below [1]. ArchitectureModel parameters (in Millions)Alex-Net60Basic-L2440 Alex-Net was introduced in 2012. The current m...

Discuss·57 reads
ML
Jordan Hsu
Jordan Hsu
jordanhsu.dev·Mar 10, 2020
Mar 10, 2020

The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks

paper link: https://arxiv.org/abs/1803.03635 Published in ICLR 2019 前景提要 樂透彩券的特性為一堆彩券中,真正中獎的只有那幾張,本文藉由樂透彩券來比喻神經網路的架構,真正對整體預測結果有關鍵影響的sub-network(中獎彩券)可能只有一小部分,其他的部分(沒中獎的)就可以prune掉,來加速模型的訓練時間和降低複雜度 本文方法 文章中對彩票假設的正式定義為:一個隨機初始化的密集神經網絡包含一個初始化的子網絡,在單獨訓練時,最...

The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks
Discuss·5 reads
Paper Reading
AI

Changelog

New steps component and improved accessibility on Hashnode's blog and docs product.

New steps component and improved accessibility on Hashnode's blog and docs product.

Nov 05, 2024·
new

Trending Articles

Understanding Oone Gas and Fees: The Fuel Behind Every Blockchain Transaction.

Patience Uyire·55 reads

SolvBTC Rolls Out a Next-Gen Platform for Secure, Scalable, and Transparent Bitcoin DeFi

Wissy Ak·45 reads

SolvBTC, 안전하고 확장 가능하며 투명한 비트코인 디파이 플랫폼 출시

Wissy Ak·36 reads

Top commenters this week

Writing Challenges

#2Articles1Week Challenge

Become better at technical writing; accept Hashnode's writing challenge for four weeks.

#2Articles1Week Challenge
#WomenWhoTech

Share your story, achievements, or experiences as a woman, non-binary folk in tech or as a #WomenWhoTech ally!

#WomenWhoTech
Self Starter

Publish your first article on Hashnode and become a self starter!

Self Starter
Serial Blogger

Publish an article every day for 7 days and earn a cool serial blogger badge!

Serial Blogger
Talk of the town

Write a story that drives amazing engagement on Hashnode and become the talk of the town!

Talk of the town
Word Warrior

Write an in-depth article on your Hashnode blog that's more than 2000 words and become a word warrior!

Word Warrior
Lyn Alden
Lyn Alden
Kora Benson
Kora Benson
alejandro saenz
alejandro saenz
Manjiri C
Manjiri C
Ritesh
Ritesh