Excerpt
torchtune: Easy and Accessible Finetuning in Native PyTorch - Evan Smothers, MetaAs open-source LLMs have become more capable, a substantial ecosystem has deâŠ
PyTorch
55.1K subscribers
<__slot-el>
<__slot-el>
183 views 12 days ago
torchtune: Easy and Accessible Finetuning in Native PyTorch - Evan Smothers, Meta As open-source LLMs have become more capable, a substantial ecosystem has developed around the fine-tuning of these models. A thriving community of researchers, developers, practiti âŠ
âŠmore
Ukraine Donation Appeal 2024
Sponsored
warchild.org.uk/ukraine/donate
[
Give ÂŁ5
](https://www.googleadservices.com/pagead/aclk?sa=L&ai=CUDHQJg0NZ-GiN7nJp-oPpvKv6QH87uXJerfP4rKgErCQHxABIABgu76ug9AKggEXY2EtcHViLTYyMTk4MTE3NDcwNDkzNzGgAZ-CtJkDqQLQ2MAuvee1PqgDBKoEtANP0GBauRNhbARn2ARDOBv_0qJsaFbv7LK-c3dUsxQXVqBRF3qnM5PueffZsdVOab3FskfWLynU7GKEmL6EM79w3S4m3KfOf4HnWEWfXwHGLk10IGJP2v9q1j3w2ZgQHPybwXhr58eWyZCS9smIbRhzFpQmBta9lqka6jJMM0cYjvckTOpZaDytLwiSKMmyJ2eP7AiK085M8Khd50hY2j53Hv1GkHM-6ZWpdlYDUhD4-6QF46qBe5BNFOPL66DoYdSRCpClp_JXuYQ6cge8YlrVhaSkE2fkzaToZa4c0YKKmTgPAN-ASv25NqMmnSxBuCApePiyMXOfkQ0PkhR7FGzFGxwjL3q6WXJ2rVD-IgQzWtPLSeq2QuxoDIrto2dmvswXBZUJkAc3trgVO8s2omnDhdFVlvDaKwmSvfGZvU9vwnuLMIW4fP7iPllrMpFhoYgIQo6l8MRePZ3uTb04RtMTrWZLTTO2QNjTJwn-Q0lrHaj2LKdWo7dnWFfeG0obvC3Bzex2vJ_LgKJ1I_cK9PhJxqivnLoMYCCbRQKh7MAGOwuRImF-x5Vu4i9N8s0fRU30h_7uiAW8rMn6TZIFBAgDEAKgBlSAB8n9y2aIBwGQBwKoB_mxsQKoB4C6sQKoB_LAsQKoB-edsQKoB-idsQKoB-q3sQKoB6e1sQKoBâ1sQKoB_C1sQKoB4KqsQKoB4QIqAeo0huoB7YHqAekmrECqAeRn7ECqAewm7ECqAeusbECqAfmvLECqAemqrECqAfKurECqAfswLECqAf9srECqAf3uLECqAf4uLECqAeBxhuoB_yvsQKoB6vFG6gHnNwbqAfmnbECqAe3obECqAfetbECqAfqsbECqAe-t7ECqAeZtbECqAeFwbECqAfrpbECqAfKqbECkggLQ3pQWTJaa2l6QVmoCAHSCDMIgICAEBACGFoyBaCAgMIfOhGP0ICAgICECMCAgICAmIbgA0jZoNI1UBRY2Lm7r-6NiQPyCB9jYS15dC1ob3N0LXB1Yi0xNDQzOTkzMzM4NzM5OTI3mgkvaHR0cHM6Ly93d3cud2FyY2hpbGQub3JnLnVrL2RvbmF0ZS15b3V0dWJlLWRydHaxCbeIHUh0LY5KyAkYyAmPAcgJkAGYCwGhCxlEWNfZqtwbuguJAQgBEAEYBSABKAEwEEABSAFgAGgAcAKIAQCYAQGiAV4KGyAD2rgEFTITOhEKDygwSJuZhI2lAZgZAbggARgAIABYAWAAcAHQAQGoAgWyAisIAxABGgwI-6mwmQYQt7y-lAPauAQVMhM6EQoPKDBIm5mEjaUBmBkBuCABwAICqAEB2AEBgAIBiAIF0AsS2gwmCgsQ8NGfhZnTpozEARICAQMaDRi8rMn6TSCj66uS1gRAAUoCEB-aDQESoA0Bqg0CR0LIDQHSDS9odHRwczovL3d3dy53YXJjaGlsZC5vcmcudWsvZG9uYXRlLXlvdXR1YmUtZHJ0drgT____________AYgUCLAUAcAVyYCAQNAVAdgVAZAWAZgWAeIWAggBgBcBihcWCAMYASABKAEwATgBQAFIAVABWAFgAqAXAakX7_vaOpgniOO6FwQoADAA&ase=2&gclid=Cj0KCQjwgrO4BhC2ARIsAKQ7zUmhyztsQPPS-5GzH4abDKtW4KoBR3bNBJCtSNnlNQPZsJHkML7SPrAaArD5EALw_wcB&num=1&cid=CAESD-D2pcPLa289aFXoqmliMA&ad_cpn=%5BAD_CPN%5D&sig=AOD64_1pR1Sh0wzXPxKO3fZtv75P5a2JxQ&label=video_click_to_advertiser_site&ctype=110&ms=%5BCLICK_MS%5D )
All From PyTorch Watched
Cast Iron Radiators - Shop The Range 10 Year Warranty | Price Match Promise | Finance Options | Free Delivery
Sponsored
Trade Radiators
[
Shop now
](https://www.googleadservices.com/pagead/aclk?sa=L&ai=COS0LJg0NZ7-uN42rp-oPo8nrqAen5v7feqjIkOfmEmQQASAAYLu-roPQCoIBF2NhLXB1Yi02MjE5ODExNzQ3MDQ5MzcxoAHMmvD3A6kC0NjALr3ntT6oAwTIAwqqBOcCT9BMNaKoAjY4m05W0m1L7W3dt-RemaroEec-rD9rsSVfdyWCmzXbASJmBneKwcYFuWrB3BhKPR2GOdPRVNAwQH4gNNNJDgRlRI2RNWlKZM3DPqGPOjfY4D0am-mfnfWpvfooPncpgkXx9KDNhQDEG7tPfbT2CiSa1h2yzORXwDnBSAp1zah3pBqc4fL3WPmWr0dNFW5jJi7tifQlPdXnVohrgBN8zBGmlYsu-jUSW7uVUCl1L-kzAwu3hf80JXoafIFTNw4T_lGvo12bT6pGIMvPhLstehRZCOU2MAEpXqYgU1NKhUKZY0sBUUD9YNyxPTueh7npBhQuvvbybmZ6LFhdCeTpI9yoVZBAd7P_5XJ2jrOxBN06cDgguguhUhlVu4cSoQ0f3aVSCye2I_uqrK3bIAmpDiu2Hfd3vlY4XJkN2UauNEvqJuy_nnqkX2qSz2gUXSdâFgtig54qCoZG17dkcNZhi6SBQkIE2gCeMCMuQegBm6AB5zljwiIBwGQBwKoB_mxsQKoB4C6sQKoB_LAsQKoB-edsQKoB-idsQKoB-q3sQKoB6e1sQKoBâ1sQKoB_C1sQKoB4KqsQKoB4QIqAeo0huoB7YHqAex3BuoB6SasQKoB5GfsQKoB7CbsQKoB66xsQKoB-a8sQKoB6aqsQKoB8q6sQKoB-zAsQKoB_2ysQKoB_e4sQKoB_i4sQKoB4HGG6gH_K-xAqgHq8UbqAfmnbECqAe3obECqAfetbECqAfqsbECqAe-t7ECqAeZtbECqAeFwbECqAfrpbECqAfKqbEC0ggzCICAgBAQAhhaMgWggIDCHzoRj9CAgICAhAjAgICAgJiG4ANI2aDSNVAUWNi5u6_ujYkD8ggfY2EteXQtaG9zdC1wdWItMTQ0Mzk5MzMzODczOTkyN5oJO2h0dHA6Ly93d3cudHJhZGVyYWRpYXRvcnMuY29tL3JhZGlhdG9ycy9jYXN0LWlyb24tcmFkaWF0b3JzsQmc57s5brpL6MgJAMgJigKYCwGhCxlEWNfZqtwbuguBAQgBEAUYBCAIKAEwBkABSABYAWAAaABwAYgBAJgBAaIBVAobIAPauAQVMhM6EQoPKDBIm5mEjaUBmBkBuCAB0AEBqAIFsgIrCAMQARoMCPupsJkGELe8vpQD2rgEFTITOhEKDygwSJuZhI2lAZgZAbggAcACAqgBAdgBAYACAYgCBdALEtoMJgoLEODinLy51duzgAESAgEDGg0YiarNkFEg6cqp5PAEQAFKAhAfmg0BEqANAaoNAkdCyA0B0g07aHR0cDovL3d3dy50cmFkZXJhZGlhdG9ycy5jb20vcmFkaWF0b3JzL2Nhc3QtaXJvbi1yYWRpYXRvcnO4E____________wGwFAHAFYGAgEDQFQHYFQGYFgHiFgIIAYAXAYoXFggDGAEgASgBMAE4AUABSAFQAVgBYAKgFwGpFwZGi26cMF04uhcEKAAwAA&ase=2&gclid=Cj0KCQjwgrO4BhC2ARIsAKQ7zUnTQ2guLCNmU-RAaxLEiLKTs792jBbp07wdBtlZkP34pDgKTPsg2YgaAk30EALw_wcB&num=1&cid=CAESD-D2R6hlFqF1BgLz19eImQ&sig=AOD64_3iyrXypWYlsmP0mfOvUk6jbAyqMw&ms=%5BCLICK_MS%5D&nb=8&nx=%5BNX%5D&ny=%5BNY%5D&dim=%5BDIM%5D )
[
DL Compiler Mini-Summit at PyTorch Conference 2024
PyTorch · Playlist
](https://www.youtube.com/watch?v=hCvlWZEXRrg&list=PL_lsbAsL_o2DyFOVyBzDS5scLfUotrG52&pp=iAQB )
[
Building Scientific Computing Infrastructure Software with the PyTorch Ecosystem - Bharath Ramsundar
PyTorch
](https://www.youtube.com/watch?v=Ru-CDK_79NQ )
[
Itâs Not About Scale, Itâs About Abstraction
Machine Learning Street Talk
](https://www.youtube.com/watch?v=s7_NlkBwdj8 )
[
llm.câs Origin and the Future of LLM Compilers - Andrej Karpathy at CUDA MODE
Latent Space
](https://www.youtube.com/watch?v=BmdOt6A6tHM )
[
Building Trusted AI with LLMs with Richard Socher of You.com
Industrial AI Consortium
](https://www.youtube.com/watch?v=9mXCTivuXRE )
[
Running State-of-Art Gen AI Models on-Device with NPU Acceleration - Felix Baum, Qualcomm
PyTorch
](https://www.youtube.com/watch?v=wd57g2IM3C4 )
[
Letâs Talk About Panels
Marques Brownlee
](https://www.youtube.com/watch?v=65ciAONXv0M )
[
The End of Ad Blockers In Chrome
Mental Outlaw
](https://www.youtube.com/watch?v=TO48wxdjWMg )
[
Recruitment is broken, what are businesses doing to fix it? | FT Working It
Financial Times
](https://www.youtube.com/watch?v=FrQFFH2V8g0 )
[
Xbox Lost the Console War. Now Itâs Redefining Gaming. | WSJ The Economics Of
The Wall Street Journal
](https://www.youtube.com/watch?v=yuZtbsSrdwo )
[
The Challenges of Building an Opinionated Open Source LLM Framework - Wing Lian, Axolotl AI
PyTorch
](https://www.youtube.com/watch?v=bp9xioJv0gw )
[
PyTorch
](https://www.youtube.com/watch?v=XOIuFIl2-Ao )
[
How a Murder Changed Gay Rights Forever
Spectacles
](https://www.youtube.com/watch?v=5U3-RKTs1cY )
[
My dream died, and now Iâm here
Sabine Hossenfelder
](https://www.youtube.com/watch?v=LKiBlGDfRU8 )
[
why is it always rubidium?
Angela Collier
](https://www.youtube.com/watch?v=UnpFu5k-o3A )
[
DL Compiler Panel Discussion - P. Tillet, J. Ansel, J. Pienaar, T. Chen, M. Zolotukhin, P. Wu
PyTorch
](https://www.youtube.com/watch?v=YWDzHGx8PrY )
[
YouTube is about to change.
Colin and Samir
](https://www.youtube.com/watch?v=jSDeOk1-8YM )
[
PyTorch
](https://www.youtube.com/watch?v=ibgW_ali0Gc )
[
Why does the US spend so much on its military?
Johnny Harris
](https://www.youtube.com/watch?v=iqJ0kg9xvLs )
[
Japanâs Ridiculous Weatherwoman Fiasco
Japanalysis
](https://www.youtube.com/watch?v=z7QG9owYEUY )