Games

 
 

Work Experience

Autodesk Inc., San Francisco, CA, U.S.

Emerging Technology Team, OCTO

Manager: Hans Kellner

 

Immersive Design in AR and VR

  • Work as an intern in the Emerging Technology team in OCTO at Autodesk. Explore the intersection of emerging technologies and industry to provide Autodesk potential directions for innovative design and technology solutions. 

  • Designed and developed one AR application, DreamCatch AR Viewer, using Apple ARkit, and one VR application, BIDS VR ,using SteamVR.

  • Dream Catcher AR Viewer helps 3D designers visualize and manipulate their generative design models in context of real environment. It plays a big role in helping users have better understanding of generative design, and accelerate design iteration by validating the design in AR before fabrication.

  • BIDS VR is created to generate 3D floor layout from a 2D sketch of floor plan. It could help designers fast visualize and validate how his sketch will end up in 3D real world in the VR space. (Details are confidential)

​Projects

 

Carnegie Mellon University, Pittsburgh, PA, U.S.

Entertainment Technology Center

Supervisor: Carl Rosendahl, Melanie Lam

Ako

  • Ako Homepage

  • Ako is a fun conversational Augmented Reality companion to help a player learn a physical table-top game.

  • People usually rely on instruction booklets, online videos or another player to learn the rules of a board game, which can be time consuming and confusing. 

  • Our project targets to make the learning process easier by introducing a friendly AR teaching companion for a player to ask questions and get answers in an AR interactive experience. 

  • In this project, I designed and implemented the tech framework, and developed the AR parts including marker based recognition & tracking, AR events & speech sychronization and hand interaction with virtual objects using Leap Motion, to bring our cute AR teacher in live and make the teaching experience magical and engaging.

Carnegie Mellon University, Pittsburgh, PA, U.S.

Entertainment Technology Center

Supervisor: Prof. Dave Culyba

Alice's Adventure

  • Alice’s Adventure Homepage

  • Alice’s Adventure is an ETC project for Alice, to design an adventure game creation tool that can be used to teach introductory game design concepts, with the head fake of learning computer science and programming concepts. The project works towards creating a platform different from animation-centric Alice, and draws parallels from successful adventure games to enable users to create new experiences.

  • Worked on system architecture design, game engine APIs and user experience design.

Carnegie Mellon University, Pittsburgh, PA, U.S.

Entertainment Technology Center

Supervisor: Prof. Jessica Hammer, Heather Kelly

Abode

  • Abode Homepage​

  • Abode is a semester long client project at Carnegie Mellon University’s Entertainment Technology Center that is focused on researching the potential of virtual reality home spaces; what makes a home feel like home, and how we can bring that into an experience in a virtual space. Specifically, our team is focusing on multi-user experiences where a user can invite a guest into their home and have the experience of hosting (or being hosted).​

  • We are working on a variety of prototypes exploring different facets of this social interaction; entry/exit, activities performed in the home space, and the social engagement of multiple users. Our objective is to be able to present our prototypes and findings to our clients, Jessica Hammer and Verizon, with the aim to show the potential of further research in this area of virtual reality.

Tsinghua University, Beijing, P.R. China

Knowledge Engineering Group

Advisor: Prof. Jie Tang

THUPOST Second-hand Items Trading Website 

  • THUPOST is the first secondhand items trading website in Tsinghua University, launched in July 2016. This project was inspired by my intern life in Stanford University, where the SUPOST online campus second-hand market impressed me a lot by its convenience and efficiency. I realized that Tsinghua University had a greater demand for it and it came into my mind that I could create our own online second-hand market with Tsinghua features to benefit Tsinghua students. Therefore, in the practice work on Service Oriented Software Design and Development course, I proposed my blueprint and formed a team to implement this idea together. Through months’ hard work and our joint effort, THUPOST has been officially operating now, serving tens of thousands of students in Tsinghua.

  • THUPOST implements e-commerce functionalities and has following features: a safe trading environment, a P2P information exchange mechanism, online auctions with real-time product status sharing and prompt notifications via SMS or email.

  • I built the system from scratch and designed the user experience. Developed both front-end webpages and back-end facilities for second-hand trading and exchange on campus using Ruby on Rails. Took charge of its production and maintenance.

Achievement

  • As the First secondhand items trading website in Tsinghua University, THUPOST has got a $30,000 investment from KEG laboratory of Tsinghua University.

Tsinghua University, Beijing, P.R. China

Supervisor: Prof. Lifeng Sun and Feng Xian

Real Color Scheme

  • The RCS application transforms photos into artworks using the artwork styles of famous artists and recommends color schemes of the pictures. RCS pigment producer can drop out certain pigment of the color transferred from App by mixing 5 basic colors (CMYK+White) in precise proportion. AR in the camera view allows users to foresee the final result on an empty canvas, and the selected color will be highlighted on the canvas. Finally users are able to fill the highlighted area with the produced pigment just like coloring a kid’s coloring book.

  • Proposed the idea, developed the Android Application from scratch, designed the user interfaces and experiences, implemented the color scheme extraction function and created the auto pigment mixer prototype with Arduino.

Awards

  • Outstanding Project from Computer Engineering Department (1st prize out of 24 projects) in University Student Innovation and Entrepreneurship Program (2016);

  • China-US Young Maker Competition Third Prize (Regionals, July 4, 2016) and Grand Finals (Finals, August 15, 2016)

 

Research

Carnegie Mellon University, Pittsburgh, PA, U.S.

Articulab, HCI Department

Supervisor: PhD. Zhen Bai and Prof. Justine Cassell

 

SCIPR

  • SCIPR introduction

  • Virtual agent in SCIPR system is located in a multi-party social environment and should be aware and interact with the physical game information in the game. Our goal is to implement a non-verbal behavior generator to make the virtual agent act as a peer-like virtual game player. 

  • I designed and implemented the non-verbal behavior generation for SCIPR based on BEAT framework, which can generate non-verbal behaviors that are synchronized with verbal behaviors, game information integrated, interactive with environment and vivid among the game knowledge base.

Carnegie Mellon University, Pittsburgh, PA, U.S.

Auto Lab, Computer Science Department

Supervisor: Prof. David O’Hallaron

 

Fast Deployment for Autolab Project Using Docker

  • One of the major barriers to worldwide adoption for the open-source Autolab autograding service is the difficulty of deploying the complex Internet service from scratch. We sought to utilize Docker to realize a new comprehensive deployment method to simplify the deployment and make it simple and seamless for remote users of Autolab.

  • Independently dockerized the whole Autolab project and achieved a one-click installation on both local VM and real server.

  • Evaluated and optimized the installation process via user studies and composed the instruction in detail.

Stanford University, Stanford, CA, U.S.

Ling Lab, Medical Center

Supervisor: Ph.D. Bruce Xuefeng Ling

Biological Network behind Kawasaki Disease

  • To understand the biological mechanisms underlying IVIG resistance in Kawasaki Disease (KD) patients with elevated GGT levels, we explored the association between elevated GGT levels and IVIG-resistance with 686 KD patients and used R square statistic and false discovery analysis to identify genes that were differentially represented in patients with elevated GGT levels with regard to IVIG responsiveness.

  • Participated in conceptualizing and designing the study, took charge of data pre-processing as well as global gene expression analyses with false discovery analysis and R square statistic. Independently achieved a valuable discovery of the base gene sets discussed in our paper.

Publication

Tsinghua University, Beijing, P.R. China

Knowledge Engineering Group

Supervisor: Prof. Jie Tang

Reviewer-recommend System

  • Reviewer-recommend system is developed to help the organizers and editors assign multiple paper review tasks to experts in a conference with accurate and effective matching by considering field relevance, authority and their workloads, based on the large-scale academic database of Aminer.

  • Independently developed the system in form of a website to help recommend paper reviewers to editors in a conference based on the data and APIs of Aminer Academic Social Network System.

  • Designed the user interfaces and implemented front-end as well as back-end web services such as paper keyword extraction, recommendation methods and data accesses using Scala on Play.

  • Grey LinkedIn Icon
  • Grey Facebook Icon
  • Grey Instagram Icon