--- title: Blog - Colossal-AI (4) description: Read this blog and learn more about Colossal-AI, the open source software for deep learning training and inference optimization. (4) --- # Blog Discover the latest news, tips and tricks to accelerate deep learning training and inference with Colossal-AI. [ Subscribe ](https://company.hpc-ai.com/blog/subscribe) [![EMNLP 2023](https://company.hpc-ai.com/hubfs/emnlp-2023-logo-1.png) ](https://company.hpc-ai.com/blog/emnlp-2023) ### [Unveiling Colossal-AI Booth and Exciting Hiring Opportunities at EMNLP 2023!](https://company.hpc-ai.com/blog/emnlp-2023) December 7, 2023 [Read more](https://company.hpc-ai.com/blog/emnlp-2023) [![](https://company.hpc-ai.com/hubfs/Screenshot%202023-11-28%20160646-1.png) ](https://company.hpc-ai.com/blog/enhanced-moe-parallelism-open-source-moe-model-training-can-be-9-times-more-efficient) ### [Enhanced MoE Parallelism, Open-source MoE Model Training Can Be 9 Times More Efficient](https://company.hpc-ai.com/blog/enhanced-moe-parallelism-open-source-moe-model-training-can-be-9-times-more-efficient) November 9, 2023 [Read more](https://company.hpc-ai.com/blog/enhanced-moe-parallelism-open-source-moe-model-training-can-be-9-times-more-efficient) [![](https://company.hpc-ai.com/hubfs/Colossal-ai%20llama2%20(4).png) ](https://company.hpc-ai.com/blog/one-half-day-of-training-using-a-few-hundred-dollars-yields-similar-results-to-mainstream-large-models-open-source-and-commercial-free-domain-specific-llm-solution) ### [One half-day of training using a few hundred dollars yields similar results to mainstream large models, open-source and commercial-free domain-specific LLM solution](https://company.hpc-ai.com/blog/one-half-day-of-training-using-a-few-hundred-dollars-yields-similar-results-to-mainstream-large-models-open-source-and-commercial-free-domain-specific-llm-solution) September 25, 2023 [Read more](https://company.hpc-ai.com/blog/one-half-day-of-training-using-a-few-hundred-dollars-yields-similar-results-to-mainstream-large-models-open-source-and-commercial-free-domain-specific-llm-solution) [![](https://company.hpc-ai.com/hubfs/lux-1.png) ](https://company.hpc-ai.com/blog/luxprovide-and-hpc-ai-tech-join-forces-to-revolutionize-ai-with-supercomputer-and-colossal-ai-solutions) ### [LuxProvide and HPC-AI Tech Join Forces to Revolutionize AI with SuperComputer and Colossal-AI Solutions](https://company.hpc-ai.com/blog/luxprovide-and-hpc-ai-tech-join-forces-to-revolutionize-ai-with-supercomputer-and-colossal-ai-solutions) September 6, 2023 [Read more](https://company.hpc-ai.com/blog/luxprovide-and-hpc-ai-tech-join-forces-to-revolutionize-ai-with-supercomputer-and-colossal-ai-solutions) [![](https://company.hpc-ai.com/hubfs/f2.png) ](https://company.hpc-ai.com/blog/70b-llama2-training) ### [70 billion parameter LLaMA2 model training accelerated by 195% with best foundation model practice upgraded](https://company.hpc-ai.com/blog/70b-llama2-training) September 4, 2023 [Read more](https://company.hpc-ai.com/blog/70b-llama2-training) [![](https://company.hpc-ai.com/hubfs/24.png) ](https://company.hpc-ai.com/blog/fine-tuning-private-gpt-using-colossal-ais-cloud-platform) ### [Fine-tuning Private GPT using Colossal-AI's Cloud Platform](https://company.hpc-ai.com/blog/fine-tuning-private-gpt-using-colossal-ais-cloud-platform) August 30, 2023 [Read more](https://company.hpc-ai.com/blog/fine-tuning-private-gpt-using-colossal-ais-cloud-platform) [![](https://company.hpc-ai.com/hubfs/Business%20woman%20typing%20on%20keyboard%20with%20global%20system%20concept.jpeg) ](https://company.hpc-ai.com/blog/colossal-ai-platform) ### [Colossal-AI Platform made its debut at ICML, ushering in a new era of large-scale model training](https://company.hpc-ai.com/blog/colossal-ai-platform) August 8, 2023 [Read more](https://company.hpc-ai.com/blog/colossal-ai-platform) [![](https://company.hpc-ai.com/hubfs/2216x1244.jpg) ](https://company.hpc-ai.com/blog/join-colossal-ai-at-icml-2023-and-try-our-newly-released-colossal-ai-platform) ### [Join Colossal-AI at ICML 2023 and Try Our Newly Released Colossal-AI Platform](https://company.hpc-ai.com/blog/join-colossal-ai-at-icml-2023-and-try-our-newly-released-colossal-ai-platform) July 22, 2023 [Read more](https://company.hpc-ai.com/blog/join-colossal-ai-at-icml-2023-and-try-our-newly-released-colossal-ai-platform) [![](https://company.hpc-ai.com/hubfs/v2-f46afc558023ca86e88843726deebc51_r-1.png) ](https://company.hpc-ai.com/blog/large-model-pretraining) ### [65-billion-parameter large model pretraining accelerated by 38%, best practices for building LLaMA-like base models open-source](https://company.hpc-ai.com/blog/large-model-pretraining) July 17, 2023 [Read more](https://company.hpc-ai.com/blog/large-model-pretraining) [![](https://lh3.googleusercontent.com/pvW-hz2s_MZSskTPkAUdOMKp5UhkFBXvjEoePIzlcoOOD6JuUZJ9FRcppi84xdhtMM_ivPhlIu9F7EtgcPSiIeUnA2J-g9R83b9HkXM_qg8w-CaorJCSTgU-DMV5DpOiLbqtJgC3vdNYlC7cylOCMKE) ](https://company.hpc-ai.com/blog/collaborative-innovation-building-an-arabic-chat-based-system-in-partnership-with-watad-and-hpc-ai-tech) ### [Collaborative Innovation: Building an Arabic Chat-Based System in Partnership with Watad and HPC-AI Tech](https://company.hpc-ai.com/blog/collaborative-innovation-building-an-arabic-chat-based-system-in-partnership-with-watad-and-hpc-ai-tech) June 23, 2023 [Read more](https://company.hpc-ai.com/blog/collaborative-innovation-building-an-arabic-chat-based-system-in-partnership-with-watad-and-hpc-ai-tech) [![](https://company.hpc-ai.com/hubfs/Google%20Drive%20Integration/ROI%20white%20paper%20blog%20announcement.png) ](https://company.hpc-ai.com/blog/white-paper-roi-custom-ai-solutions) ### [New White Paper Alert: Maximize ROI with Custom AI Solutions](https://company.hpc-ai.com/blog/white-paper-roi-custom-ai-solutions) May 25, 2023 [Read more](https://company.hpc-ai.com/blog/white-paper-roi-custom-ai-solutions) [![](https://company.hpc-ai.com/hubfs/isc23_logo_motto_datum_rgb_web.png) ](https://company.hpc-ai.com/blog/isc-high-performance-2023) ### [Join the Colossal-AI Team for two Tutorials at ISC High Performance 2023](https://company.hpc-ai.com/blog/isc-high-performance-2023) May 15, 2023 [Read more](https://company.hpc-ai.com/blog/isc-high-performance-2023)