Daniela V
@valdan@sigmoid.social
- 35 Followers
- 65 Following
- 80 Posts
Computer Scientist in the making PhD candidate in the intersection of #NLProc #leadership #digitaltransformation
still 😷 | Views own.
Python Software FoundationAre you a PSF Member yet? Check out the various levels of membership and join us! https://bit.ly/49POAHa
We don't want cost to be a barrier to you being a part of the PSF or to your voice helping direct our future, which is why we have a sliding scale option: https://bit.ly/3NhcbXE
Compsci Weekly[R] Rethinking Compression: Reduced Order Modelling of Latent Features in Large Language Models
https://arxiv.org/abs/2312.07046
Discussions: https://discu.eu/q/https://arxiv.org/abs/2312.07046
Rethinking Compression: Reduced Order Modelling of Latent Features in Large Language Models
Due to the substantial scale of Large Language Models (LLMs), the direct application of conventional compression methodologies proves impractical. The computational demands associated with even minimal gradient updates present challenges, particularly on consumer-grade hardware. This paper introduces an innovative approach for the parametric and practical compression of LLMs based on reduced order modelling, which entails low-rank decomposition within the feature space and re-parameterization in the weight space. Notably, this compression technique operates in a layer-wise manner, obviating the need for a GPU device and enabling the compression of billion-scale models within stringent constraints of both memory and time. Our method represents a significant advancement in model compression by leveraging matrix decomposition, demonstrating superior efficacy compared to the prevailing state-of-the-art structured pruning method.
Federico Pianzolahttps://www.rug.nl/about-ug/work-with-us/job-opportunities/?details=00347-02S000AI7P
Fully-paid PhD position Narratives in Argumentation (1.0 FTE) - computational approaches
Come work with me in the Netherlands!
#AcademicJobs #NLP #nlproc #DigitalHumanities #academicchatter #academicmastodon #computationalscience #DH
Dan PiponiPlant care web sites are all like this:
Here's our handy guide on identifying exactly what's wrong with your plant:
• leaves turning brown? Too much water
• leaves turning brown? Not enough water
• leaves turning brown? Too much sun
• leaves turning brown? Too much shade
• leaves turning brown? Soil too acid
• leaves turning brown? Bacterial infection
• leaves turning brown? This is normal for older leaves
Erica Seubert, PhDFor #SilentSunday I present my nearly sixteen year old #Dachshund snuggled into bed last night, wishing his humans were already sleeping next to him. We always keep him up too late according to him.
#DogsOfMastodon
#DogsOfMastodon
Rohit Farmer, Ph.D.I am looking for a new position in computational biology/bioinformatics preferably in #academia in the #USA.
I am an experienced Computational Biologist with eight years of post-PhD experience in applying computational methods across diverse domains, from molecular modeling to #highdimensional and #machinelearning based single-cell flow/mass cytometry and serum proteomics data analysis.
Any leads would be helpful.
#computationalbiology #bioinformatics #jobsearch #lookingforwork
OFAIOFAI's 2023 Fall Lecture Series kicks off with Nafise Sadat Moosavi's talk on the challenges of end-to-end reasoning in #NLProc: https://ofai.at/events/2023-10-11moosavi Join us online on Wednesday, 11 October at 18:30 CEST!
