“…and so that I think is where the power of the system lies like it’s not perfect but neither are you…”
#GPT4
#GPT4
| BioHPC @ UTSW-Dallas | https://www.biohpc.work |
Paniz Karbasi
- 28 Followers
- 26 Following
- 22 Posts
Computational Research Scientist - HPC Engineer
I do research and development on: On-Prem HPCs and cloud infrastructures, Container Orchestrators, Automation, Virtualization, and Scaling DeepLearning Pipelines.
I am very interested in HPC education. Also a GPU geek!
Promoting science, tech and education.
Sometimes I may promote art too! 🩰
Views are my own.
#Matlab kernel for #Jupyter is released, for real 🎈. https://blogs.mathworks.com/matlab/2023/01/30/official-mathworks-matlab-kernel-for-jupyter-released/
Official MathWorks MATLAB kernel for Jupyter released
Jupyter Notebooks allow users to combine rich text, code, data and computational results in a way that’s similar to our own Live Scripts. Jupyter, however, supports a range of languages including Python, R and even compiled languages such as C++ and Fortran. They are widely used in many areas of computational research, exploration and dissemination. I’ve been a fan and enthusiastic
Jason Bowen 🇺🇦Unfortunate trajectory for Rackspace
https://www.expressnews.com/business/article/Rackspace-Yoo-ransomware-attack-17703197.php
Some hpc #encryption tool here https://hpc.uni.lu/old/blog/2018/sensitive-data-encryption-using-gocryptfs/ - Do you have any preferred tools for data encryption?
Here is some reminder/introduction of VirtualBMC which is a great tool for controlling VMs using IPMI commands: https://github.com/kurokobo/virtualbmc-for-vsphere . It is easy to install and configure, and great for building an experimental environment to test the node power management.
GitHub - kurokobo/virtualbmc-for-vsphere: VirtualBMC for vSphere, a virtual BMC for controlling virtual machines using IPMI commands for the VMware vSphere environment.
VirtualBMC for vSphere, a virtual BMC for controlling virtual machines using IPMI commands for the VMware vSphere environment. - GitHub - kurokobo/virtualbmc-for-vsphere: VirtualBMC for vSphere, a ...
nixCraft 🐧A Gentle Introduction to Assembly Language Programming https://github.com/pkivolowitz/asm_book
GitHub - pkivolowitz/asm_book: A book teaching assembly language programming on the ARM 64 bit ISA. Along the way, good programming practices and insights into code development are offered which apply directly to higher level languages.
A book teaching assembly language programming on the ARM 64 bit ISA. Along the way, good programming practices and insights into code development are offered which apply directly to higher level la...
#SLURM presentations from #SC22 now available: https://slurm.schedmd.com/publications.html
There’s one I specifically had been hoping to be discussed for so long, and it finally happened: Slurm and/or/versus Kubernetes
It talks about potentially getting the slurm to work with K8s. Something that may not exactly be necessary as engineers do the on-prem and k8s separately, but there are still good reasons to think about the possibility of integration; like managing one infrastructure vs. two.
There’s one I specifically had been hoping to be discussed for so long, and it finally happened: Slurm and/or/versus Kubernetes
It talks about potentially getting the slurm to work with K8s. Something that may not exactly be necessary as engineers do the on-prem and k8s separately, but there are still good reasons to think about the possibility of integration; like managing one infrastructure vs. two.
I’ll be doing some benchmarks on a few (#deeplearning #hpc) frameworks/languages including #jax and #julialang, and will eventually present to our user community. I think I would dedicate a full slide to #jax logo as it’s kinda a modernized Penrose triangle and is really amazing. #ImpossibleObjects
Miguel Dias Costa@hpcgenome XCAT and Warewulf, at least, can also do stateless provisioning, where you centrally manage the images that are booted over the network (which among other things allows effortless switching and rollbacks) instead of the configuration of what's installed in the nodes (stateful). One can also have a mix (Warewulf calls it hybridisation iirc)
As usual, all approaches have their pros and cons. @DrCuff 's advice of choosing one and sticking with it also applies to these I'd say
During #SC22 I attended a presentation about using xCAT with Git for cluster provisioning. It was an amazing talk. Some prefer xCAT to Foreman based on my observations during SC22. I’d be happy to know what you all think about it. Also, in your experience what’s a good way of pushing changes to nodes after they are provisioned? Is Puppet the best way?