Siqi Wang
Courant Institute of Mathematical Sciences, New York University

60 Fifth Avenue
5th Floor, Office 506
New York University
New York, NY 10011, USA

Email: siqi.wang[at]nyu.edu


I'm a fifth-year Computer Science PhD student at Courant Institute of Mathematical Sciences of New York University where I joined Geometric Computing Lab and started to work with professor Denis Zorin and professor Daniele Panozzo. Prior to NYU, I got my Bachelor's degree at Shanghai Jiao Tong University and worked at DALab (Digital ART Laboratory) of SJTU.

My research interests are Computer Graphics, Geometry Processing and Physical Simulation. Here is my resume! You can also view my Google Scholar profile.


What's New

 08/05/2023

I have one paper accepted for SIGGRAPH Asia 2023!

 07/26/2022

I am invited to give a talk at the University of Toronto's Dynamic Graphics Project (DGP).

 06/06/2022

I am selected as one of the WiGRAPH’s Rising Stars 2022!

 05/23/2022

I start a research scientist internship at Adobe research, working with Alec Jacobson.

 09/21/2021

I have been awarded a DeepMind scholarship by the NYU Department of Computer Science.

 08/01/2020

I have two papers accepted for SIGGRAPH Asia 2020!

 09/27/2019

My homepage is built today!


Publications

A1

2D Neural Fields with Learned Discontinuities

Chenxi Liu, Siqi Wang, Matthew Fisher, Deepali Aneja, Alec Jacobson.
arXiv preprint arXiv:2408.00771

Effective representation of 2D images is fundamental in digital image processing, where traditional methods like raster and vector graphics struggle with sharpness and textural complexity respectively. Current neural fields offer high-fidelity and resolution independence but require predefined meshes with known discontinuities, restricting their utility. We observe that by treating all mesh edges as potential discontinuities, we can represent the magnitude of discontinuities with continuous variables and optimize. Based on this observation, we introduce a novel discontinuous neural field model that jointly approximate the target image and recovers discontinuities. Through systematic evaluations, our neural field demonstrates superior performance in denoising and super-resolution tasks compared to InstantNGP, achieving improvements of over 5dB and 10dB, respectively. Our model also outperforms Mumford-Shah-based methods in accurately capturing discontinuities, with Chamfer distances 3.5x closer to the ground truth. Additionally, our approach shows remarkable capability in handling complex artistic drawings and natural images.
@article{liu20242d,
title={2D Neural Fields with Learned Discontinuities},
author={Liu, Chenxi and Wang, Siqi and Fisher, Matthew and Aneja, Deepali and Jacobson, Alec},
journal={arXiv preprint arXiv:2408.00771},
year={2024}
}
C1

Bézier Spline Simplification Using Locally Integrated Error SIGGRAPH Asia '23

Siqi Wang, Chenxi Liu, Daniele Panozzo, Denis Zorin, Alec Jacobson.
SIGGRAPH Asia 2023

Inspired by surface mesh simplification methods, we present a technique for reducing the number of Bézier curves in a vector graphics while maintaining high fidelity. We propose a curve-to-curve distance metric to repeatedly conduct local segment removal operations. By construction, we identify all possible lossless removal operations ensuring the smallest possible zero-error representation of a given design. Subsequent lossy operations are computed via local Gauss-Newton optimization and processed in a priority queue. We tested our method on the OpenClipArts dataset of 20,000 real-world vector graphics images and show significant improvements over representative previous methods. The generality of our method allows us to show results for curves with varying thickness and for vector graphics animations.
@inproceedings{wang2023bezier,
title={B{\'e}zier Spline Simplification Using Locally Integrated Error Metrics},
author={Wang, Siqi and Liu, Chenxi and Panozzo, Daniele and Zorin, Denis and Jacobson, Alec},
booktitle={SIGGRAPH Asia 2023 Conference Papers},
pages={1--11},
year={2023}
}
C2

Appearance-Preserving Tactile Optimization SIGGRAPH Asia '20

Chelsea Tymms, Siqi Wang, Denis Zorin.
ACM Transactions on Graphics (SIGGRAPH Asia 2020)

Textures are encountered often on various common objects and surfaces. Many textures combine visual and tactile aspects, each serving important purposes; most obviously, a texture alters the object’s appearance or tactile feeling as well as serving for visual or tactile identification and improving usability. The tactile feel and visual appearance of objects are often linked, but they may interact in unpredictable ways. Advances in high-resolution 3D printing enable highly flexible control of geometry to permit manipulation of both visual appearance and tactile properties. In this paper, we propose an optimization method to independently control the tactile properties and visual appearance of a texture. Our optimization is enabled by neural network-based models, and allows the creation of textures with a desired tactile feeling while preserving a desired visual appearance at a relatively low computational cost, for use in a variety of applications.
@article{tymms2020appearance,
title={Appearance-preserving tactile optimization},
author={Tymms, Chelsea and Wang, Siqi and Zorin, Denis},
journal={ACM Transactions on Graphics (TOG)},
volume={39},
number={6},
pages={1--16},
year={2020},
publisher={ACM New York, NY, USA}
}
C3

An Adaptive Staggered-Tilted Grid for Incompressible Flow Simulation SIGGRAPH Asia '20

Yuwei Xiao, Szeyu Chan, Siqi Wang, Bo Zhu, Xubo Yang.
ACM Transactions on Graphics (SIGGRAPH Asia 2020)

Enabling adaptivity on a uniform Cartesian grid is challenging due to its highly structured grid cells and axis-aligned grid lines. In this paper, we propose a new grid structure – the adaptive staggered-tilted (AST) grid – to conduct adaptive fluid simulations on a regular discretization. The key mechanics underpinning our new grid structure is to allow the emergence of a new set of tilted grid cells from the nodal positions on a background uniform grid. The original axis-aligned cells, in conjunction with the populated axis-tilted cells, jointly function as the geometric primitives to enable adaptivity on a regular spatial discretization. By controlling the states of the tilted cells both temporally and spatially, we can dynamically evolve the adaptive discretizations on an Eulerian domain. Our grid structure preserves almost all the computational merits of a uniform Cartesian grid, including the cache-coherent data layout, the easiness for parallelization, and the existence of high-performance numerical solvers. Further, our grid structure can be integrated into other adaptive grid structures, such as an Octree or a sparsely populated grid, to accommodate the T-junction-free hierarchy. We demonstrate the efficacy of our AST grid by showing examples of large-scale incompressible flow simulation in domains with irregular boundaries.
@article{xiao2020adaptive,
title={An adaptive staggered-tilted grid for incompressible flow simulation},
author={Xiao, Yuwei and Chan, Szeyu and Wang, Siqi and Zhu, Bo and Yang, Xubo},
journal={ACM Transactions on Graphics (TOG)},
volume={39},
number={6},
pages={1--15},
year={2020},
publisher={ACM New York, NY, USA}
}
C4

Reconstructing Human Joint Motion with Computational Fabrics UbiComp '19

Ruibo Liu, Qijia Shao, Siqi Wang, Christina Ru, Devin Balkcom, and Xia Zhou.
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies.
Presented at ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp), London, September 2019.

Accurate and continuous monitoring of joint rotational motion is crucial for a wide range of applications such as physical rehabilitation and motion training. Existing motion capture systems, however, either need instrumentation of the environment, or fail to track arbitrary joint motion, or impose wearing discomfort by requiring rigid electrical sensors right around the joint area. This work studies the use of everyday fabrics as a flexible and soft sensing medium to monitor joint angular motion accurately and reliably. Specifically we focus on the primary use of conductive stretchable fabrics to sense the skin deformation during joint motion and infer the joint rotational angle. We tackle challenges of fabric sensing originated by the inherent properties of elastic materials by leveraging two types of sensing fabric and characterizing their properties based on models in material science. We apply models from bio-mechanics to infer joint angles and propose the use of dual strain sensing to enhance sensing robustness against user diversity and fabric position offsets. We fabricate prototypes using off-the-shelf fabrics and micro-controller. Experiments with ten participants show 9.69° median angular error in tracking joint angle and its sensing robustness across various users and activities.
@article{
liu2019reconstructing,
title={Reconstructing Human Joint Motion with Computational Fabrics},
author={Liu, Ruibo and Shao, Qijia and Wang, Siqi and Ru, Christina and Balkcom, Devin and Zhou, Xia},
journal={Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies},
volume={3},
number={1},
pages={19},
year={2019},
publisher={ACM}
}

Patents

P1

Computational fabrics for monitoring human joint motion Patent

Ruibo Liu, Qijia Shao, Siqi Wang, Christina Ru, Devin Balkcom, Xia Zhou.
US Patent App. 16/911,877

In an embodiment, the present disclosure pertains to a method of determining an angular motion in a subject. The method generally includes one or more of the following steps of:(1) applying a wearable system to a body region of the subject;(2) utilizing the wearable system to sense one or more parameters; and (3) correlating the one or more parameters to the angular motion in the subject. In an additional embodiment, the present disclosure pertains to a wearable system for determining angular motion in a subject. Generally, the wearable sensor includes one or more fabrics for sensing one or more parameters of a body region of a subject.
@misc{liu2020computational,
title={Computational fabrics for monitoring human joint motion},
author={Liu, Ruibo and Shao, Qijia and Wang, Siqi and Ru, Christina and Balkcom, Devin and Zhou, Xia},
year={2020},
month=dec # "~31",
publisher={Google Patents},
note={US Patent App. 16/911,877}
}

Research

Bézier Spline Simplification Using Locally Integrated Error
New York University & Adobe Research, advised by Alec Jacobson, Daniele Panozzo and Denis Zorin

Inspired by surface mesh simplification methods, we present a technique for reducing the number of Bézier curves in a vector graphics while maintaining high fidelity. We propose a curve-to-curve distance metric to repeatedly conduct local segment removal operations. By construction, we identify all possible lossless removal operations ensuring the smallest possible zero-error representation of a given design. Subsequent lossy operations are computed via local Gauss-Newton optimization and processed in a priority queue. We tested our method on the OpenClipArts dataset of 20,000 real-world vector graphics images and show significant improvements over representative previous methods. The generality of our method allows us to show results for curves with varying thickness and for vector graphics animations.

Appearance-Preserving Tactile Optimization
New York University, advised by Denis Zorin

Textures are encountered often on various common objects and surfaces. Many textures combine visual and tactile aspects, each serving important purposes; most obviously, a texture alters the object's appearance or tactile feeling as well as serving for visual or tactile identification and improving usability. The tactile feel and visual appearance of objects are often linked, but they may interact in unpredictable ways. Advances in high-resolution 3D printing enable highly flexible control of geometry to permit manipulation of both visual appearance and tactile properties. In this paper, we propose an optimization method to independently control the tactile properties and visual appearance of a texture. Our optimization is enabled by neural network-based models, and allows the creation of textures with a desired tactile feeling while preserving a desired visual appearance at a relatively low computational cost, for use in a variety of applications.

An Adaptive Staggered-Tilted Grid for Incompressible Flow Simulation
Dartmouth College & SJTU, advised by Bo Zhu and Xubo Yang

Enabling adaptivity on a uniform Cartesian grid is challenging due to its highly structured grid cells and axis-aligned grid lines. In this paper, we propose a new grid structure -- the adaptive staggered-tilted (AST) grid -- to conduct adaptive fluid simulations on a regular discretization. The key mechanics underpinning our new grid structure is to allow the emergence of a new set of tilted grid cells from the nodal positions on a background uniform grid. The original axis-aligned cells, in conjunction with the populated axis-tilted cells, jointly function as the geometric primitives to enable adaptivity on a regular spatial discretization. By controlling the states of the tilted cells both temporally and spatially, we can dynamically evolve the adaptive discretizations on an Eulerian domain. Our grid structure preserves almost all the computational merits of a uniform Cartesian grid, including the cache-coherent data layout, the easiness for parallelization, and the existence of high-performance numerical solvers. Further, our grid structure can be integrated into other adaptive grid structures, such as an Octree or a sparsely populated grid, to accommodate the T-junction-free hierarchy. We demonstrate the efficacy of our AST grid by showing examples of large-scale incompressible flow simulation in domains with irregular boundaries.

Reconstructing Human Joint Motion with Computational Fabrics
Dartmouth College, advised by Xia Zhou

This work studies the use of everyday fabrics as a flexible and soft sensing medium to monitor joint angular motion accurately and reliably. Specifically we focus on the primary use of conductive stretchable fabrics to sense the skin deformation during joint motion and infer the joint rotational angle. We tackle challenges of fabric sensing originated by the inherent properties of elastic materials by leveraging two types of sensing fabric and characterizing their properties based on models in material science. We apply models from bio-mechanics to infer joint angles and propose the use of dual strain sensing to enhance sensing robustness against user diversity and fabric position offsets. We fabricate prototypes using off-the-shelf fabrics and micro-controller. Experiments with ten participants show 9.69° mean angular error in tracking joint angle and its sensing robustness across users and activities.


Work Experience

05/2022-12/2022
05/2024-08/2024

Research Scientist Intern at Adobe Research
Research Intern at Roblox Engine Group (Geometry)


Teach

Spring 2021
Spring 2022


Awards

06/2022
09/2021
08/2019
05/2019
12/2018
04/2018
2016-18
10/2017

12/2016
10/2016
09/2014

WiGRAPH (Women in Computer Graphics Research) Rising Star 2022
DeepMind Scholarship
MacCracken Fellowship (New York University)
Outstanding Graduates Honor of Shanghai
Hongyi Scholarship (for excellent overseas researchers)
First-class Scholarship of Lee Fushou Fund
Academic Excellence Scholarship, SJTU
Scholarship of the Temasek Foundation International Leadership Enrichment and Regional Networking Programme (TFI LEaRN)
First Prize in the Undergraduate Mathematical Contest in Modeling of China
Award for Outstanding Student Cadres, SJTU
First-Prize in High School Students Mathematics Contest in China (provincial level)


Misc

I am a fan of classical music and play the piano in my leisure time. I'm also well-versed in Cucurbit Flute, a Chinese musical instrument. I learned Chinese folk dance for many years but it's been quite a long time since I last danced.

My first name is pronouced as "Si--Chi" and the last Chinese character is the one with same meaning as "Chess".

It's been 1470 days since I started Ph.D.!
You are the No. HTML Hit Counters th vistor of my homepage.