Skip links

Learn Generative AI

生成式人工智能:端到端開發與 LLMs​

51小時

為什麼生成式人工智能對公司發展很重要,但很多企業對ChatGPT使用存在疑慮?

為什麼我們需要學習建立個人化的虛擬助手,而不能單單使用Bard、ChatGPT來推動企業創新?

其實生成式人工智能不止是ChatGPT!

了解生成式人工智慧(GAI)的運作方式

基於最新的GAI發展評估商業應用案例

針對股票LLM聊天機器人進行性能調優

編寫個人化LLM驅動聊天機器人

使用您的個人風格/選定領域配置和部署LLM驅動的聊天機器人

課程大綱

課程內容

The course will equip you with the skills and knowledge necessary to develop cutting-edge LLM solutions for selected domain.

WEEK 1 Introduction to Python: 1/3

Understand the building blocks of virtually all programming languages.

Content: Variables, input/output, data types, control structure, scope, function, error handling

WEEK 2 Introduction to Python 2/3

More on data type and control structure. introduction to object oriented programming

Content: Dictionaries, iteratives, OOP,  Pydantic, Modules in Python

WEEK 3 Introduction to Python 3/3

Introduction to Microservices and Environment Setup

Content: Restful API, Flask, FastAPI, Conda, venv, pip, Jupyter notebook

WEEK 4 Understanding Neuron Networks: 1/3

Understanding what neuron network is and how to build it with PyTorch

Content: Structure of neuron network. Why does it matter? Build your first NN using PyTorch

WEEK 5 Understanding Neuron Networks: 2/3

More on PyTorch. Why is GAN important?

Content: More hands-on development with Pytorch (e.g. CNN). Introduction to GAN.

WEEK 6 Understanding Neuron Networks: 3/3

Have fun on building your own GPT model

Content: Build your own GPT model with PyTorch (nanoGPT)

WEEK 7 Introduction to Cloud: 1/3

Introduction to most common cloud services. Introduction to docker.

Content: Compute, block storage, serverless, VPCs. Docker, Jupyter in docker, build your first docker image.

WEEK 8 Introduction to Cloud: 2/3

Introduction to kubernetes. Running your first Kubernetes Cluster and introduction to Terraform.

Content: Introduction to Kubernetes. Running your first cluster (with GPU). Replicate the cluster with Terraform script.

WEEK 9 Introduction to LLM: 1/3

Play around with LLMs on the market and understand the difference. Deploy your first LLM.

Content: Understanding LLMs configurations and parameters. Deploy a minimum LLM virtual assistant.

WEEK 10 Introduction to LLM: 2/3

Natural Language Processing: Why LLM rocks (transformer). Introduction to Prompt Engineering.

Content: Introduction to legacy NLP. What is transformer. Basic prompt engineering technical and concepts.

WEEK 11 Introduction to LLM: 3/3

Common LLM problems. How to improve LLM’s performance: PEFT and RAG

Content: Introduction to common LLM issues such as hallucination. Model fine-tuning vs RAG.

WEEK 12 LLM Orchestration: 1/3

What is LLM Orchestration and why do we need it. Introduction to LangChain.

Content: Introduction to LangChain concepts.

WEEK 13 LLM Orchestration: 2/3

Building RAG using Langchain. What is embedding? What is vector database? What is similarity search?

Content: Hands-on session on building a RAG using Langchain and vector database. Address common embedding issues.

WEEK 14 LLM Orchestration: 3/3

Dealing with structured database with Langchain. How to write your pre/post processor? Connecting your LLM to GUI.

Content: Hands-on session on using Langchain and structured data. How to extend Langchain. Building a simple GUI for your virtual assistant (e.g. streamlit).

WEEK 15 Capstone Project: 1/4

Picking your problem statement. Defining deliverables and acceptance criteria. Prepare solution architecture, model selection

WEEK 16 Capstone Project: 2/4

Preparing data, decide how to improve the performance (fine-tuning vs prompt engineering). Data pipeline design and implementation.

WEEK 17 Capstone Project: 3/4

Baseline your LLM’s performance, improve prompt template. Resolve known issues.

WEEK 18 Capstone Project: 4/4

Prepare terraform for the solution. Deploying to Cloud. Troubleshooting.

即將開班

5月30日 2025

- 51 小時
- 晚上7:00 -10:00
- 鑽石山課室

課程簡介講座

課程簡介會

- 時長兩小時
- 時間: 7:30-9:30 PM
- 地點: 銅鑼灣辦公室

WhatsApp 查詢

Generative AI: End-to-end development with LLMs

課程介紹

這個課程旨在教授您如何快速利用大型語言模型(LLM)的強大功能。從了解LLMs的概念和運作方式,到將其應用和優化,透過提示工程、模型管控、前端開發和性能調優等方面的學習,本課程將使您掌握開發選定領域的尖端LLM解決方案所需的技能和知識。

課程內容​


• 了解生成式人工智慧(GAI)的運作方式
• 基於最新的GAI發展評估商業應用案例
• 針對股票LLM聊天機器人進行性能調優
• 編寫個人化LLM驅動聊天機器人
• 使用您的個人風格/選定領域配置和部署LLM驅動的聊天機器人

Trainer

Henry Fong

業界經驗

• 全球技術咨詢公司中負責全球銀行和保險業的生成式人工智能項目經理
• 擁有數據科學、全棧開發、雲工程等方面的強大技• 術背景 擁有數據分析碩士學位和軟體工程學士學位
• AWS和GCP認證持有者

FAQ

Frequently Asked Questions

A1: To enroll in this course, you should have a general understanding of IT concepts, such as the difference between front-end and back-end development. A basic familiarity with programming concepts like loops and for loops is also recommended. While knowledge of Python is a significant advantage, it is not a strict requirement for this course.

A2: Studying this course is beneficial even if you're not planning a career in IT. The skill of developing generative AI use-cases is rare and highly valued in the market. By understanding how to integrate AI into business, you can significantly enhance your value in various job markets. The course also prepares you for the upcoming trend of innovation within various business sectors.

A3: This course is highly suitable for those considering a career switch to IT. AI's presence in Hong Kong is expanding, and large companies are likely to establish AI and workplace automation teams in the near future. By taking this course, you can practice these skills in your current job, gaining relevant experience for your transition into the IT industry.

 

A4: After completing the course, you can explore a variety of job opportunities. Roles such as AI Specialist and Business Analyst are particularly relevant, as they involve a deep understanding of AI applications in business.
 
It means accounting team, procurement team, HR team, Sales team, marketing team, are all looking for someone with their domain knowledge, to also know Generative AI to facilitate innovation within the team.
This will be the trend moving forward.
 
After studying this course, you may completely switch field to IT with the positions mentioned above, or you may seek to stay in your current industry but look for a new role that encourages innovation within your team.

A5: If you aspire to become a Business Analyst, studying a course in generative AI is highly beneficial as it equips you with cutting-edge data analysis tools and techniques essential for identifying and solving complex business problems. This knowledge enhances your ability to improve performance, lower operation costs, increase project ROI, and make effective decisions. Furthermore, understanding generative AI fosters better team collaboration and risk management, crucial skills for any business analyst aiming to drive success and growth in an organization.

A6: The skill of “Can build a generative AI use case for own business/ company usage” will be very rare and hot in the market in the near future.
If they know the business insight and can develop an AI tools into business use, will be very valuable
“Innovate within the department” will come soon

BA that don’t know coding will start to lose their value.

A7: After completing a course in generative AI, students typically come away with tangible projects or applications they've developed, such as a custom-designed chatbot or a unique AI-driven project. These creations showcase their practical skills in utilizing AI for real-world applications, demonstrating their ability to design, implement, and manage AI systems. Such projects serve as a portfolio piece, evidencing their proficiency in AI technologies and their application in business analysis, which can be valuable for career advancement or academic pursuits.

A8: The ideal candidates for this course are those interested in understanding how AI can be integrated into business practices. This course is suitable for individuals from any industry who wish to gain insights into AI applications in business contexts.