Introduction

2024-01-01

Greetings To Visitor

You are so awesome ! Thank you for stopping by ! 😉😉

I am currently a Ph.D. student at the University of Hong Kong (HKU), Department of Computer Science. 🧐🧐 I am fortunately conducting my robotics research under the supervision of Dr. Jia Pan and Prof. Anthony G.O. Yeh. I also collaborate closely with HKU AIoT Lab.

My research lies in 🤖Robotics, 📡Wireless Sensing and 🏗️Construction Inspection. My long-term research aims to integrate WiFi sensing technologies into mobile robotic systems to enhance SLAM tasks.

I am still serving as R&D manager for VizGuard Limited and as engineer for TransGP. 👷‍♂️👷‍♂️Prior to that, I worked for HKU iLab and HKUST HKCRC where I enhanced my skills and deepened my understanding of intelligent construction field.

Please feel free to reach me out via email (Pan dot yp at outlook dot com) 📩📩 if you might offer any available opportunity or are interested in potential collaborations. 🤗🤗

Prototypes

For more photos and videos of my hardware prototypes,
please refer to my:
▶ Portfolio
▶ Demos (selected)

I have rich experience in R&D 🛠️🛠️. I developed several prototypes:

● i-Core (ITF 2020 Project)
[News] Successfully implemented at HKU Student Residence
[News] Awarded the ICT Gold Award (Smart Mobility Group) 2022

● MetaCam (Start-up Project)
[Sites] A well-known product
[News] Overall Champion in Elevator Pitch Competition (EPIC) 2023

Awards

For more details,
please refer to my ▶ Awards.

Skills

Language: C / C++ / Java / Python
GUI :Qt (C++) , Android (Java), IOS (Objective - C)
Cooperation: Git
Computer Vision: OpenCV, Halcon
Robotics: Linux Shell, ROS
Mechanical Design: AutoCAD, SolidWorks, 3D Printing
Electronics: Verilog HDL (FPGA), STM32 (HAL, STD), Arduino, PCB Layout (SMT)
Math: Linear Algebra, Optimization
Word: LaTeX, Markdown
Media: PS, PR

Hobbies

🚴Cycling, 🏔️Hiking, 🏊Swimming

🎸Electric Guitar, 🥁Drum Kit

📱Electronic Product

Curriculum Vitae

More details are listed in my ▶ CV.

full text >>

Portfolio

2024-01-01

▶ Portfolio

▶ Demos (selected)

Tracking Drone (2017)

[Background]
● Second Prize winner in National Electronic Design Competition
● Led the computer vision hardware and algorithm development

[Function]
● The drone can autonomously take off, hover and land. It can also automatically track and follow a remote-control car (by learning to follow targets of different colors)

[Realization]
● Flight Controller Module: APM (Ardupilot Mega)
● Camera Module: OV7725
● Control Algorithm: Dual-loop PID
● Computer Vision: Tradition CV algorithm on morphology, with color standard conversion

Gesture Recognizer (2018)

[Background]
● Second Prize winner in Provincial Electronic Design Competition

[Function]
● Recognize the gestures of the finger-guessing game
● Learn to recognize special gestures

[Realization]
● Two 3-channel capacitance sensors collect capacitance values from multiple locations, enabling recognition and learning functions through the K-means clustering algorithm
● A resistive touch-screen human-computer interface is designed for real-time display

Smart Incubator (Device+Server+APP) (2019)

[Background]
● Graduation Project (School’s Excellent Graduation Design winner, the proportion of which is 2%)

[Function]
● The design realizes:
① the visual tracking of the GPS positioning of the box
② the curve display of real-time temperature
③ the display of the medicine status
④ the monitoring of the lid
● The hardware and software of the system are composed of four weakly-coupled subsystems：
① the incubator system
② the acquisition and communication system
③ the server and host computer system
④ the hardware power supply system

[Realization]
● On the platform of STM32 and with incremental PID arithmetic, adjustable constant temperature storage of medicines is realized. Then an incubator system is constructed.
● The server is deployed in Windows Server 2012 and the host computer is based on Android OS. The related programs are written in Java.
● The acquisition and communication system adopts multiple sensor modules to collect the environment and state data of the box and upload them to the server through the GPRS communication module. Both acquisition and transmission delays are within 1 second.
● 18650 lithium batteries and switched-mode power supply are both applied in the hardware power supply system.

Pipe Counting Software (2020)

[Background]
● Successfully deployed in the factory
● Open-sourced on Gitee

[Function]
● Software to assist steel pipes counting tasks to get rid of heavy visual fatigue in factories
● The picture can choose from your computer files, from an independent camera, or even screenshots. What’s more, the final marked picture can be saved.
● To avoid some errors of machine vision in complex cases, the final count can be manually corrected.

[Realization]
● Computer Vision: Hough Transform
● Coding: Qt (Cross-platform), OpenCV

Coupler Inspector (2021)

[Background]
● Adopted by the New World Development Company
● 柏傲莊III兩幢樓宇須拆卸重建據報涉錯用強度較低混凝土

[Function]
● Android APP sends measurement command via Bluetooth

● E-paper can displayed the depth along with QR-Code of current coupler
● Built-in battery supports charged wirelessly
● Inspection form will be automatically generated on server

i-Core for MiC(2021)

[Background]
● Funded by ITF 2020 (ITP/029/20LP) (details)
● Homepage: e-inspection
● Won the ICT Award (Press: 港大智能城市建造實驗室之跨境組裝合成建築模塊（MiC）物流遙距電子檢測系統榮獲2022香港資訊及通訊科技智慧物流金獎)

[Function]
● The data combined with IMU, GPS, UWB and other sensors will be upload to the universal platform which implied BIM, Blockchain and other technologies, aiming to better manage the building flow and supply chain.
● The results can be displayed on Apps and Websites.

MetaCam – 3D Scanning Equipment（2022）

[Background]
● Took the responsibility of hardware designing and time synchronization, including circuit design and component communication
[Function]
● Portable and handy devices to get colored point cloud maps

● This board can trigger peripheral sensors such as multi-line Lidar, IMU, camera and motor encoder, to achieve a better time synchronization performance

Human-robot Collaboration（2022）

[Background]
● A framework that combined AR HMD (HoloLens) and robot (UR5) to boost the efficiency in waste manual sorting

[Function]
● Contours of waste objects on the table or conveyor belt are detected through a depth camera. The operator selects the object for classification using AR HMD

● If there are any misclassifications by the computer vision sorting algorithms, the operator can correct them using the AR HMD, demonstrating human-robot collaboration and interactive features