torchtune: Easy and Accessible Finetuning in Native PyTorch - Evan Smothers, Meta - YouTube

Excerpt

torchtune: Easy and Accessible Finetuning in Native PyTorch - Evan Smothers, MetaAs open-source LLMs have become more capable, a substantial ecosystem has de



PyTorch

55.1K subscribers

<__slot-el>

<__slot-el>

183 views 12 days ago

torchtune: Easy and Accessible Finetuning in Native PyTorch - Evan Smothers, Meta As open-source LLMs have become more capable, a substantial ecosystem has developed around the fine-tuning of these models. A thriving community of researchers, developers, practiti 



more

Ukraine Donation Appeal 2024

Sponsored

warchild.org.uk/ukraine/donate

[

Give ÂŁ5

](https://www.googleadservices.com/pagead/aclk?sa=L&ai=CUDHQJg0NZ-GiN7nJp-oPpvKv6QH87uXJerfP4rKgErCQHxABIABgu76ug9AKggEXY2EtcHViLTYyMTk4MTE3NDcwNDkzNzGgAZ-CtJkDqQLQ2MAuvee1PqgDBKoEtANP0GBauRNhbARn2ARDOBv_0qJsaFbv7LK-c3dUsxQXVqBRF3qnM5PueffZsdVOab3FskfWLynU7GKEmL6EM79w3S4m3KfOf4HnWEWfXwHGLk10IGJP2v9q1j3w2ZgQHPybwXhr58eWyZCS9smIbRhzFpQmBta9lqka6jJMM0cYjvckTOpZaDytLwiSKMmyJ2eP7AiK085M8Khd50hY2j53Hv1GkHM-6ZWpdlYDUhD4-6QF46qBe5BNFOPL66DoYdSRCpClp_JXuYQ6cge8YlrVhaSkE2fkzaToZa4c0YKKmTgPAN-ASv25NqMmnSxBuCApePiyMXOfkQ0PkhR7FGzFGxwjL3q6WXJ2rVD-IgQzWtPLSeq2QuxoDIrto2dmvswXBZUJkAc3trgVO8s2omnDhdFVlvDaKwmSvfGZvU9vwnuLMIW4fP7iPllrMpFhoYgIQo6l8MRePZ3uTb04RtMTrWZLTTO2QNjTJwn-Q0lrHaj2LKdWo7dnWFfeG0obvC3Bzex2vJ_LgKJ1I_cK9PhJxqivnLoMYCCbRQKh7MAGOwuRImF-x5Vu4i9N8s0fRU30h_7uiAW8rMn6TZIFBAgDEAKgBlSAB8n9y2aIBwGQBwKoB_mxsQKoB4C6sQKoB_LAsQKoB-edsQKoB-idsQKoB-q3sQKoB6e1sQKoB—1sQKoB_C1sQKoB4KqsQKoB4QIqAeo0huoB7YHqAekmrECqAeRn7ECqAewm7ECqAeusbECqAfmvLECqAemqrECqAfKurECqAfswLECqAf9srECqAf3uLECqAf4uLECqAeBxhuoB_yvsQKoB6vFG6gHnNwbqAfmnbECqAe3obECqAfetbECqAfqsbECqAe-t7ECqAeZtbECqAeFwbECqAfrpbECqAfKqbECkggLQ3pQWTJaa2l6QVmoCAHSCDMIgICAEBACGFoyBaCAgMIfOhGP0ICAgICECMCAgICAmIbgA0jZoNI1UBRY2Lm7r-6NiQPyCB9jYS15dC1ob3N0LXB1Yi0xNDQzOTkzMzM4NzM5OTI3mgkvaHR0cHM6Ly93d3cud2FyY2hpbGQub3JnLnVrL2RvbmF0ZS15b3V0dWJlLWRydHaxCbeIHUh0LY5KyAkYyAmPAcgJkAGYCwGhCxlEWNfZqtwbuguJAQgBEAEYBSABKAEwEEABSAFgAGgAcAKIAQCYAQGiAV4KGyAD2rgEFTITOhEKDygwSJuZhI2lAZgZAbggARgAIABYAWAAcAHQAQGoAgWyAisIAxABGgwI-6mwmQYQt7y-lAPauAQVMhM6EQoPKDBIm5mEjaUBmBkBuCABwAICqAEB2AEBgAIBiAIF0AsS2gwmCgsQ8NGfhZnTpozEARICAQMaDRi8rMn6TSCj66uS1gRAAUoCEB-aDQESoA0Bqg0CR0LIDQHSDS9odHRwczovL3d3dy53YXJjaGlsZC5vcmcudWsvZG9uYXRlLXlvdXR1YmUtZHJ0drgT____________AYgUCLAUAcAVyYCAQNAVAdgVAZAWAZgWAeIWAggBgBcBihcWCAMYASABKAEwATgBQAFIAVABWAFgAqAXAakX7_vaOpgniOO6FwQoADAA&ase=2&gclid=Cj0KCQjwgrO4BhC2ARIsAKQ7zUmhyztsQPPS-5GzH4abDKtW4KoBR3bNBJCtSNnlNQPZsJHkML7SPrAaArD5EALw_wcB&num=1&cid=CAESD-D2pcPLa289aFXoqmliMA&ad_cpn=%5BAD_CPN%5D&sig=AOD64_1pR1Sh0wzXPxKO3fZtv75P5a2JxQ&label=video_click_to_advertiser_site&ctype=110&ms=%5BCLICK_MS%5D)

All From PyTorch Watched

Cast Iron Radiators - Shop The Range10 Year Warranty | Price Match Promise | Finance Options | Free Delivery

Sponsored

Trade Radiators

[

Shop now

](https://www.googleadservices.com/pagead/aclk?sa=L&ai=COS0LJg0NZ7-uN42rp-oPo8nrqAen5v7feqjIkOfmEmQQASAAYLu-roPQCoIBF2NhLXB1Yi02MjE5ODExNzQ3MDQ5MzcxoAHMmvD3A6kC0NjALr3ntT6oAwTIAwqqBOcCT9BMNaKoAjY4m05W0m1L7W3dt-RemaroEec-rD9rsSVfdyWCmzXbASJmBneKwcYFuWrB3BhKPR2GOdPRVNAwQH4gNNNJDgRlRI2RNWlKZM3DPqGPOjfY4D0am-mfnfWpvfooPncpgkXx9KDNhQDEG7tPfbT2CiSa1h2yzORXwDnBSAp1zah3pBqc4fL3WPmWr0dNFW5jJi7tifQlPdXnVohrgBN8zBGmlYsu-jUSW7uVUCl1L-kzAwu3hf80JXoafIFTNw4T_lGvo12bT6pGIMvPhLstehRZCOU2MAEpXqYgU1NKhUKZY0sBUUD9YNyxPTueh7npBhQuvvbybmZ6LFhdCeTpI9yoVZBAd7P_5XJ2jrOxBN06cDgguguhUhlVu4cSoQ0f3aVSCye2I_uqrK3bIAmpDiu2Hfd3vlY4XJkN2UauNEvqJuy_nnqkX2qSz2gUXSd—Fgtig54qCoZG17dkcNZhi6SBQkIE2gCeMCMuQegBm6AB5zljwiIBwGQBwKoB_mxsQKoB4C6sQKoB_LAsQKoB-edsQKoB-idsQKoB-q3sQKoB6e1sQKoB—1sQKoB_C1sQKoB4KqsQKoB4QIqAeo0huoB7YHqAex3BuoB6SasQKoB5GfsQKoB7CbsQKoB66xsQKoB-a8sQKoB6aqsQKoB8q6sQKoB-zAsQKoB_2ysQKoB_e4sQKoB_i4sQKoB4HGG6gH_K-xAqgHq8UbqAfmnbECqAe3obECqAfetbECqAfqsbECqAe-t7ECqAeZtbECqAeFwbECqAfrpbECqAfKqbEC0ggzCICAgBAQAhhaMgWggIDCHzoRj9CAgICAhAjAgICAgJiG4ANI2aDSNVAUWNi5u6_ujYkD8ggfY2EteXQtaG9zdC1wdWItMTQ0Mzk5MzMzODczOTkyN5oJO2h0dHA6Ly93d3cudHJhZGVyYWRpYXRvcnMuY29tL3JhZGlhdG9ycy9jYXN0LWlyb24tcmFkaWF0b3JzsQmc57s5brpL6MgJAMgJigKYCwGhCxlEWNfZqtwbuguBAQgBEAUYBCAIKAEwBkABSABYAWAAaABwAYgBAJgBAaIBVAobIAPauAQVMhM6EQoPKDBIm5mEjaUBmBkBuCAB0AEBqAIFsgIrCAMQARoMCPupsJkGELe8vpQD2rgEFTITOhEKDygwSJuZhI2lAZgZAbggAcACAqgBAdgBAYACAYgCBdALEtoMJgoLEODinLy51duzgAESAgEDGg0YiarNkFEg6cqp5PAEQAFKAhAfmg0BEqANAaoNAkdCyA0B0g07aHR0cDovL3d3dy50cmFkZXJhZGlhdG9ycy5jb20vcmFkaWF0b3JzL2Nhc3QtaXJvbi1yYWRpYXRvcnO4E____________wGwFAHAFYGAgEDQFQHYFQGYFgHiFgIIAYAXAYoXFggDGAEgASgBMAE4AUABSAFQAVgBYAKgFwGpFwZGi26cMF04uhcEKAAwAA&ase=2&gclid=Cj0KCQjwgrO4BhC2ARIsAKQ7zUnTQ2guLCNmU-RAaxLEiLKTs792jBbp07wdBtlZkP34pDgKTPsg2YgaAk30EALw_wcB&num=1&cid=CAESD-D2R6hlFqF1BgLz19eImQ&sig=AOD64_3iyrXypWYlsmP0mfOvUk6jbAyqMw&ms=%5BCLICK_MS%5D&nb=8&nx=%5BNX%5D&ny=%5BNY%5D&dim=%5BDIM%5D)

[

DL Compiler Mini-Summit at PyTorch Conference 2024

PyTorch · Playlist

](https://www.youtube.com/watch?v=hCvlWZEXRrg&list=PL_lsbAsL_o2DyFOVyBzDS5scLfUotrG52&pp=iAQB)

[

Building Scientific Computing Infrastructure Software with the PyTorch Ecosystem - Bharath Ramsundar

PyTorch

](https://www.youtube.com/watch?v=Ru-CDK_79NQ)

[

It’s Not About Scale, It’s About Abstraction

Machine Learning Street Talk

](https://www.youtube.com/watch?v=s7_NlkBwdj8)

[

llm.c’s Origin and the Future of LLM Compilers - Andrej Karpathy at CUDA MODE

Latent Space

](https://www.youtube.com/watch?v=BmdOt6A6tHM)

[

Building Trusted AI with LLMs with Richard Socher of You.com

Industrial AI Consortium

](https://www.youtube.com/watch?v=9mXCTivuXRE)

[

Running State-of-Art Gen AI Models on-Device with NPU Acceleration - Felix Baum, Qualcomm

PyTorch

](https://www.youtube.com/watch?v=wd57g2IM3C4)

[

Let’s Talk About Panels

Marques Brownlee

](https://www.youtube.com/watch?v=65ciAONXv0M)

[

The End of Ad Blockers In Chrome

Mental Outlaw

](https://www.youtube.com/watch?v=TO48wxdjWMg)

[

Recruitment is broken, what are businesses doing to fix it? | FT Working It

Financial Times

](https://www.youtube.com/watch?v=FrQFFH2V8g0)

[

Xbox Lost the Console War. Now It’s Redefining Gaming. | WSJ The Economics Of

The Wall Street Journal

](https://www.youtube.com/watch?v=yuZtbsSrdwo)

[

The Challenges of Building an Opinionated Open Source LLM Framework - Wing Lian, Axolotl AI

PyTorch

](https://www.youtube.com/watch?v=bp9xioJv0gw)

[

Meta Llama 3 and the Future of Responsible AI Development - Spencer Whitman & Vincent Gonguet, Meta

PyTorch

](https://www.youtube.com/watch?v=XOIuFIl2-Ao)

[

How a Murder Changed Gay Rights Forever

Spectacles

](https://www.youtube.com/watch?v=5U3-RKTs1cY)

[

My dream died, and now I’m here

Sabine Hossenfelder

](https://www.youtube.com/watch?v=LKiBlGDfRU8)

[

why is it always rubidium?

Angela Collier

](https://www.youtube.com/watch?v=UnpFu5k-o3A)

[

DL Compiler Panel Discussion - P. Tillet, J. Ansel, J. Pienaar, T. Chen, M. Zolotukhin, P. Wu

PyTorch

](https://www.youtube.com/watch?v=YWDzHGx8PrY)

[

YouTube is about to change.

Colin and Samir

](https://www.youtube.com/watch?v=jSDeOk1-8YM)

[

State of PyTorch - Ji Li & Damien Sereni, Meta

PyTorch

](https://www.youtube.com/watch?v=ibgW_ali0Gc)

[

Why does the US spend so much on its military?

Johnny Harris

](https://www.youtube.com/watch?v=iqJ0kg9xvLs)

[

Japan’s Ridiculous Weatherwoman Fiasco

Japanalysis

](https://www.youtube.com/watch?v=z7QG9owYEUY)