–
Cross-Domain Smart Chip Design Course Promotion Program
跨域智慧晶片設計課程推廣計畫
Projects
Funded research projects led or co-led by Prof. Yang, and the open-source code and systems built in the lab.
Funded projects 1
Ongoing
Code and systems 10
Hears how someone feels from both what they say and how they say it, and answers with a spread of likely emotions instead of one label.
Bidirectional Mamba versus Transformer backbones for text-and-audio emotion recognition on IEMOCAP, with a joint valence-arousal probability head; code release for the arXiv preprint 2609.05755.
People Kuan-Wei Chen, Ting-Yi Lin
Lets you in only when both your face and your voice match, with an ordinary webcam and microphone.
A two-step authentication design in which a VGG16 face classifier identifies an enrolled user and a ResCNN speaker encoder then verifies their voice, using only an ordinary webcam and microphone; published at ICETA 2024.
People Kuan-Wei Chen, Ting-Yi Lin
A camera helps proctor exams: it recognizes each examinee's face and understands the scene, on hardware light enough for the classroom.
Vision-based exam invigilation that combines Swin-T semantic segmentation (92.74% accuracy) with ShuffleNet V2 face identification (98.58%), fused at decision level for edge deployment.
People Ting-Yi Lin
AI and Edge Computing for the Campus Battery Energy Storage System
Small computers beside the campus battery bank compress its measurements and forecast how it will behave.
Helping run the 1-MW battery energy storage system on the NCUE campus: edge devices process measurements with the discrete wavelet transform, short-time Fourier transform and Huffman coding, LSTM networks predict the system's behavior, and power quality is analyzed together with solar integration, toward a zero-energy campus (SDG 7).
People Kuan-Chun Chu
Takes the roll by recognizing faces through a webcam.
A Tkinter and OpenCV desktop app that captures face images, trains a recognizer, and logs attendance in real time to CSV files or a MySQL database, with manual entry as a fallback. Supported by TEEP.
Reads an ECG and tells heartbeat types apart on a low-cost microcontroller.
Wavelet-based preprocessing and feature extraction of ECG heartbeat signals, with ANN and CNN heartbeat classifiers deployed on low-cost microcontrollers (Arduino Nano, ESP8266 with MicroPython).
Learns how two campus buildings use electricity and predicts what they will use next.
Analysis and prediction of campus electricity consumption from September 2022 smart-meter data of two NCUE buildings (HT5 and HT9), implemented in a Jupyter notebook.
PatrolBot
ArchivedA small robot car that patrols on its own, holding a straight course and measuring distances with a laser sensor.
Design and construction of an autonomous patrol robot vehicle, using an MPU-6050 IMU with PID control to hold a straight course, VL53L-series distance sensing on ESP32, and Blynk-based monitoring.
American Sign Language Translation with T5 and Linear Projection
ArchivedTurns American Sign Language into English sentences.
Translates American Sign Language into English text by projecting sign features into a T5 language model through a linear layer.
Sign Language Translation
ArchivedRecognizes signing from video and turns it into text or speech.