title: The Maker-Breaker percolation game on the square lattice

abstract: We study the $(m,b)$ Maker-Breaker percolation game on $\mathbb{Z}^2$, introduced by Day and Falgas-Ravry. As our first result, we show that Breaker has a winning strategy for the $(m,b)$-game whenever $b \geq (2-\frac{1}{14} + o(1))m$, breaking the ratio $2$ barrier proved by Day and Falgas-Ravry. Addressing further questions of Day and Falgas-Ravry, we show that Breaker can win the $(m,2m)$-game even if he allows Maker to claim $c$ edges before the game starts, for any integer $c$, and that he can moreover win rather fast (as a function of $c$). Finally, we consider the game played on $\mathbb{Z}^2$ after the usual bond percolation process with parameter $p$ was performed. We show that when $p$ is not too much larger than $1/2$, Breaker almost surely has a winning strategy for the $(1,1)$-game, even if Maker is allowed to choose the origin after the board is determined.


title: A Concise Guide to Elicitation Methodology

abstract: One of the open questions in the field of interaction design is "what inputs or interaction techniques should be used with augmented reality devices?" The transition from a touchpad and a keyboard to a multi-touch device was relatively small. The transition from a multi-touch device to an HMD with no controllers or clear surface to interact with is more complicated. This book is a guide for how to figure out what interaction techniques and modalities people prefer when interacting with those devices. The name of the technique covered here is Elicitation. Elicitation is a form of participatory design, meaning design with direct end-user involvement. By running an elicitation study researchers can observe unconstrained human interactions with emerging technologies to help guide input design.


title: Augmented KRnet for density estimation and approximation

abstract: In this work, we have proposed augmented KRnets including both discrete and continuous models. One difficulty in flow-based generative modeling is to maintain the invertibility of the transport map, which is often a trade-off between effectiveness and robustness. The exact invertibility has been achieved in the real NVP using a specific pattern to exchange information between two separated groups of dimensions. KRnet has been developed to enhance the information exchange among data dimensions by incorporating the Knothe-Rosenblatt rearrangement into the structure of the transport map. Due to the maintenance of exact invertibility, a full nonlinear update of all data dimensions needs three iterations in KRnet. To alleviate this issue, we will add augmented dimensions that act as a channel for communications among the data dimensions. In the augmented KRnet, a fully nonlinear update is achieved in two iterations. We also show that the augmented KRnet can be reformulated as the discretization of a neural ODE, where the exact invertibility is kept such that the adjoint method can be formulated with respect to the discretized ODE to obtain the exact gradient. Numerical experiments have been implemented to demonstrate the effectiveness of our models.


title: Application of DFTB and machine learning to evaluate the stability of biomass intermediates on the Rh(111) surface

abstract: Biomass compounds adsorbed on surfaces are challenging to study due to the large number of possible species and adsorption geometries. In this work, possible intermediates of erythrose, glyceraldehyde, glycerol and propionic acid are studied on the Rh(111) surface. The intermediates and elementary reactions are generated from first 2 recursions of a recursive bond-breaking algorithm. These structures are used as the input of an unsupervised Mol2Vec algorithm to generate vector descriptors. A data-driven scheme to classify the reactions is developed and adsorption energies are predicted. The lowest mean absolute error (MAE) of our prediction on adsorption energies is 0.39 eV, and the relative ordering of different surface adsorption geometries is relatively accurate. We show that combining geometries from density functional tight-binding (DFTB) calculations with energies from machine-learning predictions provides a novel workflow for rapidly assessing the stability of various molecular geometries on the Rh(111) surface.


title: Slim patch lattices as absolute retracts and maximal lattices

abstract: Patch lattices, introduced by G. Cz\'edli and E.T. Schmidt in 2013, are the building stones for slim (and so necessarily finite and planar) semimodular lattices with respect to gluing. Slim semimodular lattices were introduced by G. Gr\"atzer and E. Knapp in 2007, and they have been intensively studied since then. Outside lattice theory, these lattices played the main role in adding a uniqueness part to the classical Jordan--H\"older theorem for groups by G. Cz\'edli and E.T. Schmidt in 2011, and they also led to results in combinatorial geometry. In this paper, we prove that slim patch lattices are exactly the absolute retracts with more than two elements for the category of slim semimodular lattices with length-preserving lattice embeddings as morphisms. Also, slim patch lattices are the same as the maximal objects $L$ in this category such that $|L|>2$. Furthermore, slim patch lattices are characterized as the algebraically closed lattices $L$ in this category such that $|L|>2$. Finally, we prove that if we consider $\{0,1\}$-preserving lattice homomorphisms rather than length-preserving ones, then the absolute retracts for the class of slim semimodular lattices are the at most 4-element boolean lattices.


title: Phase Field Method for Inhomogeneous Modulus Systems

abstract: One of the advantages of the phase-field method (PFM) is its ability to incorporate elastic interactions that dominate solid-state processes including phase transformations and plastic deformation. As mechanical equilibrium is attained much faster than chemical equilibrium, the former should be used as a constraint explicitly in deriving the governing equations of time-evolution of PFM order parameters. Current models for elastically anisotropic and inhomogeneous media in the literature do not impose such a constraint in their governing equations. In particular, they ignore the dependence of the total strain on the order parameters while evaluating the variational derivative of the elastic energy (VDEE). There is no mathematical proof to support this treatment and the fundamental thermodynamic consistency of such a models could be challenged. In this work, we present a rigorous and physically transparent formulation of PFM governing equations for elastically anisotropic and inhomogeneous media in which the mechanical equilibrium is explicitly used as a constraint. From our formulation, we show that VDEE computed in the Leo-Lowengrub-Jou (1998) (LLJ) model is thermodynamically consistent. We also show that the Wang-Jin-Khachaturyan (2003) (WJK) model has significant error in VDEE calculation. We proposed a first-order correction term to the WJK model which nullifies the error in VDEE and makes the model thermodynamically consistent. Also, we computed the VDEE by a numerical method with-out using any assumptions and compared the numerical VDEE with the LLJ, WJK and modified WJK models.


title: $K$-averaging agent-based model: propagation of chaos and convergence to equilibrium

abstract: The paper treats an agent-based model with averaging dynamics to which we refer as the K-averaging model. Broadly speaking, our model can be added to the growing list of dynamics exhibiting self-organization such as the well-known Vicsek-type models [1, 2, 29]. In the $K$-averaging model, each of the $N$ particles updates their position by averaging over $K$ randomly selected particles with additional noise. To make the $K$-averaging dynamics more tractable, we first establish a propagation of chaos type result in the limit of infinite particle number (i.e. $N \to \infty$) using a martingale technique. Then, we prove the convergence of the limit equation toward a suitable Gaussian distribution in the sense of Wasserstein distance as well as relative entropy. We provide additional numerical simulations to illustrate both results.


title: Random Access Based on Maximum Average Distance Code for Massive MTC in Cellular IoT Networks

abstract: Code-expanded Random Access (CeRA) is a promising technique for supporting mMTC in cellular IoT networks. However, its potentiality is limited by code ambiguity, which results from the inference of a larger number of codewords than those actually transmitted. In this letter, we propose a random access scheme to alleviate this problem by allowing devices to select the preambles to be transmitted considering a q-ary code with maximum average distance. Moreover, a CeRA decoding approach based on hypergraphs is proposed and an analytical model is derived. Numerical results show that the proposed scheme significantly increases the probability of successful channel access as well as resource utilization.


title: Benchmarking Scientific Image Forgery Detectors

abstract: The scientific image integrity area presents a challenging research bottleneck, the lack of available datasets to design and evaluate forensic techniques. Its data sensitivity creates a legal hurdle that prevents one to rely on real tampered cases to build any sort of accessible forensic benchmark. To mitigate this bottleneck, we present an extendable open-source library that reproduces the most common image forgery operations reported by the research integrity community: duplication, retouching, and cleaning. Using this library and realistic scientific images, we create a large scientific forgery image benchmark (39,423 images) with an enriched ground-truth. In addition, concerned about the high number of retracted papers due to image duplication, this work evaluates the state-of-the-art copy-move detection methods in the proposed dataset, using a new metric that asserts consistent match detection between the source and the copied region. The dataset and source-code will be freely available upon acceptance of the paper.


title: Harder, better, faster, stronger: large-scale QM and QM/MM for predictive modeling in enzymes and proteins

abstract: Computational prediction of enzyme mechanism and protein function requires accurate physics-based models and suitable sampling. We discuss recent advances in large-scale quantum mechanical (QM) modeling of biochemical systems that have reduced the cost of high-accuracy models. Trade-offs between sampling and accuracy have motivated modeling with molecular mechanics (MM) in a multi-scale QM/MM or iterative approach. Limitations to both conventional density functional theory (DFT) and classical MM force fields remain for describing non-covalent interactions in comparison to experiment or wavefunction theory. Because predictions of enzyme action (i.e., electrostatics), free energy barriers, and mechanisms are sensitive to the protocol and embedding method in QM/MM, convergence tests and systematic methods for quantifying QM-level interactions are a needed, active area of development.


title: Assessment of a non-conservative four-equation multiphase system with phase transition

abstract: This work focuses on the formulation of a four-equation model for simulating unsteady two-phase mixtures with phase transition and strong discontinuities. The main assumption consists in a homogeneous temperature, pressure and velocity fields between the two phases. Specifically, we present the extension of a residual distribution scheme to solve a four-equation two-phase system with phase transition written in a non-conservative form, i.e. in terms of internal energy instead of the classical total energy approach. This non-conservative formulation allows avoiding the classical oscillations obtained by many approaches, that might appear for the pressure profile across contact discontinuities. The proposed method relies on a Finite Element based Residual Distribution scheme which is designed for an explicit second-order time stepping. We test the non-conservative Residual Distribution scheme on several benchmark problems and assess the results via a cross-validation with the approximated solution obtained via a conservative approach, based on a HLLC scheme. Furthermore, we check both methods for mesh convergence and show the effective robustness on very severe test cases, that involve both problems with and without phase transition.

categories: physics.comp-ph cs.NA math.NA physics.flu-dyn


title: Schur--Weyl duality for twin groups

abstract: The twin group $TW_n$ on $n$ strands is the group generated by $t_1, \dots, t_{n-1}$ with defining relations $t_i^2=1$, $t_it_j = t_jt_i$ if $|i-j|>1$. We find a new instance of semisimple Schur--Weyl duality for tensor powers of a natural $n$-dimensional reflection representation of $TW_n$, depending on a parameter $q$. At $q=1$ the representation coincides with the natural permutation representation of the symmetric group, so the new Schur--Weyl duality may be regarded as a $q$-analogue of the one motivating the definition of the partition algebra.


title: A Hybrid Recommender System for Recommending Smartphones to Prospective Customers

abstract: Recommender Systems are a subclass of machine learning systems that employ sophisticated information filtering strategies to reduce the search time and suggest the most relevant items to any particular user. Hybrid recommender systems combine multiple recommendation strategies in different ways to benefit from their complementary advantages. Some hybrid recommender systems have combined collaborative filtering and content-based approaches to build systems that are more robust. In this paper, we propose a hybrid recommender system, which combines Alternating Least Squares (ALS) based collaborative filtering with deep learning to enhance recommendation performance as well as overcome the limitations associated with the collaborative filtering approach, especially concerning its cold start problem. In essence, we use the outputs from ALS (collaborative filtering) to influence the recommendations from a Deep Neural Network (DNN), which combines characteristic, contextual, structural and sequential information, in a big data processing framework. We have conducted several experiments in testing the efficacy of the proposed hybrid architecture in recommending smartphones to prospective customers and compared its performance with other open-source recommenders. The results have shown that the proposed system has outperformed several existing hybrid recommender systems.


title: Qudit circuits with SU(d) symmetry: Locality imposes additional conservation laws

abstract: Local symmetric quantum circuits provide a simple framework to study the dynamics and phases of complex quantum systems with conserved charges. However, some of their basic properties have not yet been understood. Recently, it has been shown that such quantum circuits only generate a restricted subset of symmetric unitary transformations [I. Marvian, Nature Physics, 2022]. In this paper, we consider circuits with 2-local SU(d)-invariant unitaries acting on qudits, i.e., d-dimensional quantum systems. Our results reveal a significant distinction between the cases of d = 2 and d>2. For qubits with SU(2) symmetry, arbitrary global rotationally-invariant unitaries can be generated with 2-local ones, up to relative phases between the subspaces corresponding to inequivalent irreducible representations (irreps) of the symmetry, i.e., sectors with different angular momenta. On the other hand, for d>2, in addition to similar constraints on the relative phases between the irreps, locality also restricts the generated unitaries inside these conserved subspaces. These constraints impose conservation laws that hold for dynamics under 2-local SU(d)-invariant unitaries, but are violated under general SU(d)-invariant unitaries. Based on this result, we show that the distribution of unitaries generated by random 2-local SU(d)-invariant unitaries does not converge to the Haar measure over the group of all SU(d)-invariant unitaries, and in fact, for d>2, is not even a 2-design for the Haar distribution.

categories: quant-ph cond-mat.str-el hep-th math-ph math.MP nucl-th


title: Corruption Determinants, Geography, and Model Uncertainty

abstract: This paper aims to identify the robust determinants of corruption after integrating out the effects of spatial spillovers in corruption levels between countries. In other words, we want to specify which variables play the most critical role in determining the corruption levels after accounting for the effects that neighbouring countries have on each other. We collected the annual data of 115 countries over the 1985-2015 period and used the averaged values to conduct our empirical analysis. Among 39 predictors of corruption, our spatial BMA models identify Rule of Law as the most persistent determinant of corruption.


title: Braiding dynamics in semiflexible filament bundles under oscillatory forcing

abstract: We examine the nonequilibrium production of topological defects -- braids -- in semiflexible filament bundles under cycles of compression and tension. During these cycles, the period of compression facilitates the thermally activated pair production of braid/anti-braid pairs, which then may separate when the bundle is under tension. As result, appropriately tuned alternating periods of compression and extension should lead to the proliferation of braid defects in a bundle so that linear density of these pairs far exceeds that expected in thermal equilibrium. Secondly, we examine the slow extension of braided bundles under tension, showing that their end-to-end length creeps nonmonotonically under a fixed force due to braid deformation and the motion of the braid pair along the bundle. We conclude with a few speculations regarding experiments on semiflexible filament bundles and their networks.


title: The Petascale DTN Project: High Performance Data Transfer for HPC Facilities

abstract: The movement of large-scale (tens of Terabytes and larger) data sets between high performance computing (HPC) facilities is an important and increasingly critical capability. A growing number of scientific collaborations rely on HPC facilities for tasks which either require large-scale data sets as input or produce large-scale data sets as output. In order to enable the transfer of these data sets as needed by the scientific community, HPC facilities must design and deploy the appropriate data transfer capabilities to allow users to do data placement at scale. This paper describes the Petascale DTN Project, an effort undertaken by four HPC facilities, which succeeded in achieving routine data transfer rates of over 1PB/week between the facilities. We describe the design and configuration of the Data Transfer Node (DTN) clusters used for large-scale data transfers at these facilities, the software tools used, and the performance tuning that enabled this capability.


title: Boltzmann sampling of irreducible context-free structures in linear time

abstract: We continue our program of improving the complexity of so-called Boltzmann sampling algorithms, for the exact sampling of combinatorial structures, and reach average linear-time complexity, i.e. optimality up to a multiplicative constant. Here we solve this problem for irreducible context-free structures, a broad family of structures to which the celebrated Drmota--Lalley--Woods Theorem applies. Our algorithm is a rejection algorithm. The main idea is to single out some degrees of freedom, i.e. write $p(x)=p_1(y) p_2(x|y)$, which allows to introduce a rejection factor at the level of the $y$ object, that is almost surely of order $1$.


title: MAVFI: An End-to-End Fault Analysis Framework with Anomaly Detection and Recovery for Micro Aerial Vehicles

abstract: Safety and resilience are critical for autonomous unmanned aerial vehicles (UAVs). We introduce MAVFI, the micro aerial vehicles (MAVs) resilience analysis methodology to assess the effect of silent data corruption (SDC) on UAVs' mission metrics, such as flight time and success rate, for accurately measuring system resilience. To enhance the safety and resilience of robot systems bound by size, weight, and power (SWaP), we offer two low-overhead anomaly-based SDC detection and recovery algorithms based on Gaussian statistical models and autoencoder neural networks. Our anomaly error protection techniques are validated in numerous simulated environments. We demonstrate that the autoencoder-based technique can recover up to all failure cases in our studied scenarios with a computational overhead of no more than 0.0062%. Our application-aware resilience analysis framework, MAVFI, can be utilized to comprehensively test the resilience of other Robot Operating System (ROS)-based applications and is publicly available at https://github.com/harvard-edge/MAVBench/tree/mavfi.


title: i3dLoc: Image-to-range Cross-domain Localization Robust to Inconsistent Environmental Conditions

abstract: We present a method for localizing a single camera with respect to a point cloud map in indoor and outdoor scenes. The problem is challenging because correspondences of local invariant features are inconsistent across the domains between image and 3D. The problem is even more challenging as the method must handle various environmental conditions such as illumination, weather, and seasonal changes. Our method can match equirectangular images to the 3D range projections by extracting cross-domain symmetric place descriptors. Our key insight is to retain condition-invariant 3D geometry features from limited data samples while eliminating the condition-related features by a designed Generative Adversarial Network. Based on such features, we further design a spherical convolution network to learn viewpoint-invariant symmetric place descriptors. We evaluate our method on extensive self-collected datasets, which involve \textit{Long-term} (variant appearance conditions), \textit{Large-scale} (up to $2km$ structure/unstructured environment), and \textit{Multistory} (four-floor confined space). Our method surpasses other current state-of-the-arts by achieving around $3$ times higher place retrievals to inconsistent environments, and above $3$ times accuracy on online localization. To highlight our method's generalization capabilities, we also evaluate the recognition across different datasets. With a single trained model, i3dLoc can demonstrate reliable visual localization in random conditions.


title: Understanding the angular momentum evolution of T Tauri and Herbig Ae/Be stars

abstract: We investigate a sample of 6 Herbig Ae/Be stars belonging to the Orion OB1 association, as well as 73 low mass objects, members of the $\sigma$ Orionis cluster, in order to explore the angular momentum evolution at early stages of evolution, and its possible connection with main-sequence Ap/Bp magnetic stars. Using FIES and HECTOCHELLE spectra, we obtain projected rotational velocities through two independent methods. Individual masses, radii, and ages were computed using evolutionary models, distance, and cluster extinction. Under the assumption that similar physical processes operate in both, T Tauri and Herbig Ae/Be stars, we construct snapshots of the protostar's rotation against mass during the first 10 Myr with the aid of a rotational model that includes a variable disc lifetime, changes in the stellar moment of inertia, a dipolar magnetic field with variable strength, and angular momentum loss through stellar winds powered by accretion. We use these snapshots, as well as the rotational data, to infer a plausible scenario for the angular momentum evolution. We find that magnetic field strengths of a few k$G$ at 3 Myr are required to match the rotational velocities of both groups of stars. Models with masses between 2-3 $M_{\odot}$ display larger angular momentum by a factor of $\sim 3$, in comparison to stars of similar spectral types on the main-sequence. Even though some quantitative estimates on this dramatic decrease with age, for Ap/Bp magnetic main-sequence stars are presented, the results obtained for the angular momentum evolution do not explain their low rotation.


title: 3D Segmentation Learning from Sparse Annotations and Hierarchical Descriptors

abstract: One of the main obstacles to 3D semantic segmentation is the significant amount of endeavor required to generate expensive point-wise annotations for fully supervised training. To alleviate manual efforts, we propose GIDSeg, a novel approach that can simultaneously learn segmentation from sparse annotations via reasoning global-regional structures and individual-vicinal properties. GIDSeg depicts global- and individual- relation via a dynamic edge convolution network coupled with a kernelized identity descriptor. The ensemble effects are obtained by endowing a fine-grained receptive field to a low-resolution voxelized map. In our GIDSeg, an adversarial learning module is also designed to further enhance the conditional constraint of identity descriptors within the joint feature distribution. Despite the apparent simplicity, our proposed approach achieves superior performance over state-of-the-art for inferencing 3D dense segmentation with only sparse annotations. Particularly, with $5\%$ annotations of raw data, GIDSeg outperforms other 3D segmentation methods.


title: Almost strict domination and anti-de Sitter 3-manifolds

abstract: We define a condition called almost strict domination for pairs of representations $\rho_1:\pi_1(S_{g,n})\to \textrm{PSL}(2,\mathbb{R})$, $\rho_2:\pi_1(S_{g,n})\to G$, where $G$ is the isometry group of a Hadamard manifold $(X,\nu)$, and prove it holds if and only if one can find a $(\rho_1,\rho_2)$-equivariant spacelike maximal surface in a certain pseudo-Riemannian manifold, unique up to fixing some parameters. The proof amounts to setting up and solving an interesting variational problem that involves infinite energy harmonic maps. Adapting a construction of Tholozan, we construct all such representations and parametrize the deformation space. When $(X,\nu)=(\mathbb{H},\sigma)$, an almost strictly dominating pair is equivalent to the data of an anti-de Sitter 3-manifold with specific properties. The results on maximal surfaces provide a parametrization of the deformation space of such $3$-manifolds as a union of components in a $\textrm{PSL}(2,\mathbb{R})\times \textrm{PSL}(2,\mathbb{R})$ relative representation variety.


title: Multi-turn Dialog System on Single-turn Data in Medical Domain

abstract: Recently there has been a huge interest in dialog systems. This interest has also been developed in the field of the medical domain where researchers are focusing on building a dialog system in the medical domain. This research is focused on the multi-turn dialog system trained on the multi-turn dialog data. It is difficult to gather a huge amount of multi-turn conversational data in the medical domain that is verified by professionals and can be trusted. However, there are several frequently asked questions (FAQs) or single-turn QA pairs that have information that is verified by the experts and can be used to build a multi-turn dialog system.


title: A new MWA limit on the 21 cm Power Spectrum at Redshifts $\sim$ 13 $-$ 17

abstract: Observations in the lowest MWA band between $75-100$ MHz have the potential to constrain the distribution of neutral hydrogen in the intergalactic medium at redshift $\sim 13-17$. Using 15 hours of MWA data, we analyse systematics in this band such as radio-frequency interference (RFI), ionospheric and wide field effects. By updating the position of point sources, we mitigate the direction independent calibration error due to ionospheric offsets. Our calibration strategy is optimized for the lowest frequency bands by reducing the number of direction dependent calibrators and taking into account radio sources within a wider field of view. We remove data polluted by systematics based on the RFI occupancy and ionospheric conditions, finally selecting 5.5 hours of the cleanest data. Using these data, we obtain two sigma upper limits on the 21 cm power spectrum in the range of $0.1\lessapprox k \lessapprox 1 ~\rm ~h~Mpc^{-1}$ and at $z$=14.2, 15.2 and 16.5, with the lowest limit being $6.3\times 10^6 ~\rm mK^2$ at $\rm k=0.14 \rm ~h~Mpc^{-1}$ and at $z=15.2$ with a possibility of a few \% of signal loss due to direction independent calibration.


title: MIG Median Detectors with Manifold Filter

abstract: In this paper, we propose a class of median-based matrix information geometry (MIG) detectors with a manifold filter and apply them to signal detection in nonhomogeneous environments. As customary, the sample data is assumed to be modeled as Hermitian positive-definite (HPD) matrices, and the geometric median of a set of HPD matrices is interpreted as an estimate of the clutter covariance matrix (CCM). Then, the problem of signal detection can be reformulated as discriminating two points on the manifold of HPD matrices, one of which is the HPD matrix in the cell under test while the other represents the CCM. By manifold filter, we map a set of HPD matrices to another set of HPD matrices by weighting them, that consequently improves the discriminative power by reducing the intra-class distances while increasing the inter-class distances. Three MIG median detectors are designed by resorting to three geometric measures on the matrix manifold, and the corresponding geometric medians are shown to be robust to outliers. Numerical simulations show the advantage of the proposed MIG median detectors in comparison with their state-of-the-art counterparts as well as the conventional detectors in nonhomogeneous environments.


title: Multipole classification in 122 magnetic point groups for unified understanding of multiferroic responses and transport phenomena

abstract: Mutual interplay between the electronic degrees of freedom in solids, such as charge, spin, orbital, sublattice, and bond degrees of freedom, is a source of cross-correlated phenomena with unconventional electronic ordered states. Such degrees of freedom can be described by four types of multipoles (electric, magnetic, magnetic toroidal, and electric toroidal) in a unified way, which enable us to tightly connect the microscopic degrees of freedom with macroscopic physical responses in a transparent manner. We complete a classification of the multipoles in all 122 magnetic point groups based on the group theory. The classification is useful to identify potentially active multipoles not only in ordinary ferromagnetic and antiferromagnetic orderings but also in exotic orderings breaking time-reversal symmetry, e.g., a loop-current state. Moreover, the classification gives an insight into the microscopic origin of the cross-correlated responses and quantum transports. By analyzing response functions up to the second order, we summarize the indispensable multipole moments for various responses, such as the linear magnetoelectric, piezoelectric, and elastic responses, and the nonlinear conductivity and Nernst coefficient. Our results highly promote a further discovery of functional multiferroic materials, guided by the bottom-up material design based on the symmetry-adapted multipoles.


title: Identification and Estimation of Partial Effects in Nonlinear Semiparametric Panel Models

abstract: Average partial effects (APEs) are often not point identified in panel models with unrestricted unobserved individual heterogeneity, such as a binary response panel model with fixed effects and logistic errors as a special case. This lack of point identification occurs despite the identification of these models' common coefficients. We provide a unified framework to establish the point identification of various partial effects in a wide class of nonlinear semiparametric models under an index sufficiency assumption on the unobserved heterogeneity, even when the error distribution is unspecified and non-stationary. This assumption does not impose parametric restrictions on the unobserved heterogeneity and idiosyncratic errors. We also present partial identification results when the support condition fails. We then propose three-step semiparametric estimators for APEs, average structural functions, and average marginal effects, and show their consistency and asymptotic normality. Finally, we illustrate our approach in a study of determinants of married women's labor supply.


title: The Critical Role of Charge Balance on the Memory Characteristics of Ferroelectric Field-Effect Transistors

abstract: Ferroelectric field-effect transistors (Fe-FETs) with ferroelectric hafnium oxide (FE HfO2) as gate insulator are being extensively explored as a promising device candidate for three-dimensional (3D) NAND memory application. FE HfO2 exhibits long retention over 10 years, high endurance over 1012 cycles, high speed with sub-ns polarization switching, and high remnant polarization of 10-30 {\mu}C/cm2. However, the performance of Fe-FETs is known to be much worse than FE HfO2 capacitors, which is not completely understood. In this work, we developed a comprehensive Fe-FET model based on a charge balance framework. The role of charge balance and the impact of leakage-assist-switching mechanism on the memory characteristics of Fe-FETs with M/FE/DE/S (Metal/Ferroelectric/Dielectric/Semiconductor) gate stack is studied. It is found that the FE/DE interface and DE layer instead of FE layer is critical to determine the memory characteristics of Fe-FETs, and experimental Fe-FETs can be well explained by this model, where the discrepancy between FE capacitors and Fe-FETs are successfully understood.


title: Calibrating Over-Parametrized Simulation Models: A Framework via Eligibility Set

abstract: Stochastic simulation aims to compute output performance for complex models that lack analytical tractability. To ensure accurate prediction, the model needs to be calibrated and validated against real data. Conventional methods approach these tasks by assessing the model-data match via simple hypothesis tests or distance minimization in an ad hoc fashion, but they can encounter challenges arising from non-identifiability and high dimensionality. In this paper, we investigate a framework to develop calibration schemes that satisfy rigorous frequentist statistical guarantees, via a basic notion that we call eligibility set designed to bypass non-identifiability via a set-based estimation. We investigate a feature extraction-then-aggregation approach to construct these sets that target at multivariate outputs. We demonstrate our methodology on several numerical examples, including an application to calibration of a limit order book market simulator (ABIDES).


title: MAGI-X: Manifold-Constrained Gaussian Process Inference for Unknown System Dynamics

abstract: Ordinary differential equations (ODEs), commonly used to characterize the dynamic systems, are difficult to propose in closed-form for many complicated scientific applications, even with the help of domain expert. We propose a fast and accurate data-driven method, MAGI-X, to learn the unknown dynamic from the observation data in a non-parametric fashion, without the need of any domain knowledge. Unlike the existing methods that mainly rely on the costly numerical integration, MAGI-X utilizes the powerful functional approximator of neural network to learn the unknown nonlinear dynamic within the MAnifold-constrained Gaussian process Inference (MAGI) framework that completely circumvents the numerical integration. Comparing against the state-of-the-art methods on three realistic examples, MAGI-X achieves competitive accuracy in both fitting and forecasting while only taking a fraction of computational time. Moreover, MAGI-X provides practical solution for the inference of partial observed systems, which no previous method is able to handle.


title: Hunting super-heavy dark matter with ultra-high energy photons

abstract: At any epoch, particle physics must be open to completely unexpected discoveries, and that is reason enough to extend the reach of searches for ultra-high energy (UHE) photons. The observation of a population of photons with energies $E \gtrsim 100$ EeV would for example imply the existence of either a completely new physical phenomena, or particle acceleration mechanisms heretofore never seen or imagined. But as we outline in this Letter of Interest, there are also good arguments for super-heavy dark matter (SHDM) in a parameter range such that it could be discovered via its decays to, in particular, UHE photons. Only ultra-high energy cosmic ray observatories have capabilities to detect UHE photons. We first investigate how current and future observations can probe and constrain SHDM models in important directions, and then outline some of the scenarios that motivate such searches. We also discuss connections between constraints on SHDM and on the parameter values of cosmological models.


title: Bend losses in flexible polyurethane antiresonant terahertz waveguides

abstract: The quest for practical waveguides operating in the terahertz range faces two major hurdles: large losses and high rigidity. While recent years have been marked by remarkable progress in lowering the impact of material losses using hollow-core guidance, such waveguides are typically not flexible. Here we experimentally and numerically investigate antiresonant dielectric waveguides made of polyurethane, a commonly used dielectric with a low Young's modulus. The hollow-core nature of antiresonant fibers leads to low transmission losses using simple structures, whereas the low Young's modulus of polyurethane makes them extremely flexible. The structures presented enable millimeter-wave manipulation in centimeter-thick waveguides in the same spirit as conventional (visible- and near-IR-) optical fibers, i.e. conveniently and reconfigurably. We investigate two canonical antiresonant geometries formed by one- and six-tubes, experimentally comparing their transmission, bend losses and mode profiles. The waveguides under investigation have loss below 1 dB/cm in their sub-THz transmission bands, increasing by 1 dB/cm for a bend radius of about 10 cm, which is analogous to bending standard $125 \mu{\rm m}$ diameter fiber to a 1.2 mm radius.


title: Computable topological abelian groups

abstract: We study the algorithmic content of Pontryagin - van Kampen duality. We prove that the dualization is computable in the important cases of compact and locally compact totally disconnected Polish abelian groups. The applications of our main results include solutions to questions of Kihara and Ng about presentations of connected Polish spaces, and an unexpected arithmetical characterisation of direct products of solenoid groups among all Polish groups.


title: Stochastic Intervention for Causal Effect Estimation

abstract: Causal inference methods are widely applied in various decision-making domains such as precision medicine, optimal policy and economics. Central to these applications is the treatment effect estimation of intervention strategies. Current estimation methods are mostly restricted to the deterministic treatment, which however, is unable to address the stochastic space treatment policies. Moreover, previous methods can only make binary yes-or-no decisions based on the treatment effect, lacking the capability of providing fine-grained effect estimation degree to explain the process of decision making. In our study, we therefore advance the causal inference research to estimate stochastic intervention effect by devising a new stochastic propensity score and stochastic intervention effect estimator (SIE). Meanwhile, we design a customized genetic algorithm specific to stochastic intervention effect (Ge-SIO) with the aim of providing causal evidence for decision making. We provide the theoretical analysis and conduct an empirical study to justify that our proposed measures and algorithms can achieve a significant performance lift in comparison with state-of-the-art baselines.


title: Learning to Optimize Industry-Scale Dynamic Pickup and Delivery Problems

abstract: The Dynamic Pickup and Delivery Problem (DPDP) is aimed at dynamically scheduling vehicles among multiple sites in order to minimize the cost when delivery orders are not known a priori. Although DPDP plays an important role in modern logistics and supply chain management, state-of-the-art DPDP algorithms are still limited on their solution quality and efficiency. In practice, they fail to provide a scalable solution as the numbers of vehicles and sites become large. In this paper, we propose a data-driven approach, Spatial-Temporal Aided Double Deep Graph Network (ST-DDGN), to solve industry-scale DPDP. In our method, the delivery demands are first forecast using spatial-temporal prediction method, which guides the neural network to perceive spatial-temporal distribution of delivery demand when dispatching vehicles. Besides, the relationships of individuals such as vehicles are modelled by establishing a graph-based value function. ST-DDGN incorporates attention-based graph embedding with Double DQN (DDQN). As such, it can make the inference across vehicles more efficiently compared with traditional methods. Our method is entirely data driven and thus adaptive, i.e., the relational representation of adjacent vehicles can be learned and corrected by ST-DDGN from data periodically. We have conducted extensive experiments over real-world data to evaluate our solution. The results show that ST-DDGN reduces 11.27% number of the used vehicles and decreases 13.12% total transportation cost on average over the strong baselines, including the heuristic algorithm deployed in our UAT (User Acceptance Test) environment and a variety of vanilla DRL methods. We are due to fully deploy our solution into our online logistics system and it is estimated that millions of USD logistics cost can be saved per year.


title: How Does Distilled Data Complexity Impact the Quality and Confidence of Non-Autoregressive Machine Translation?

abstract: While non-autoregressive (NAR) models are showing great promise for machine translation, their use is limited by their dependence on knowledge distillation from autoregressive models. To address this issue, we seek to understand why distillation is so effective. Prior work suggests that distilled training data is less complex than manual translations. Based on experiments with the Levenshtein Transformer and the Mask-Predict NAR models on the WMT14 German-English task, this paper shows that different types of complexity have different impacts: while reducing lexical diversity and decreasing reordering complexity both help NAR learn better alignment between source and target, and thus improve translation quality, lexical diversity is the main reason why distillation increases model confidence, which affects the calibration of different NAR models differently.


title: Bayesian Inference for Population Attributable Measures from Under-identified Models

abstract: Population attributable risk (PAR) is used in epidemiology to predict the impact of removing a risk factor from the population. Until recently, no standard approach for calculating confidence intervals or the variance for PAR was available in the literature. Pirikahu et al. (2016) outlined a fully Bayesian approach to provide credible intervals for the PAR from a cross-sectional study, where the data was presented in the form of a 2 x 2 table. However, extensions to cater for other frequently used study designs were not provided. In this paper we provide methodology to calculate credible intervals for the PAR for case-control and cohort studies. Additionally, we extend the cross-sectional example to allow for the incorporation of uncertainty that arises when an imperfect diagnostic test is used. In all these situations the model becomes over-parameterised, or non-identifiable, which can result in standard "off-the-shelf" Markov chain Monte Carlo updaters taking a long time to converge or even failing altogether. We adapt an importance sampling methodology to overcome this problem, and propose some novel MCMC samplers that take into consideration the shape of the posterior ridge to aid in the convergence of the Markov chain.


title: The Aligned Orbit of the Eccentric Warm Jupiter K2-232b

abstract: Measuring the obliquity distribution of stars hosting warm Jupiters may help us to understand the formation of close-orbiting gas giants. Few such measurements have been performed due to practical difficulties in scheduling observations of the relatively infrequent and long-duration transits of warm Jupiters. Here, we report a measurement of the Rossiter-McLaughlin effect for K2-232b, a warm Jupiter (M_P=0.39 M_Jup) on an 11.17-day orbit with an eccentricity of 0.26. The data were obtained with the Automated Planet Finder during two separate transits. The planet's orbit appears to be well-aligned with the spin axis of the host star, with a projected spin-orbit angle of lambda = -11.1+/-6.6 deg. Combined with the other available data, we find that high obliquities are almost exclusively associated with planets that either have an orbital separation greater than 10 stellar radii or orbit stars with effective temperatures hotter than 6,000K. This pattern suggests that the obliquities of the closest-orbiting giant planets around cooler stars have been damped by tidal effects.


title: Neural Enhanced Belief Propagation for Cooperative Localization

abstract: Location-aware networks will introduce innovative services and applications for modern convenience, applied ocean sciences, and public safety. In this paper, we establish a hybrid method for model-based and data-driven inference. We consider a cooperative localization (CL) scenario where the mobile agents in a wireless network aim to localize themselves by performing pairwise observations with other agents and by exchanging location information. A traditional method for distributed CL in large agent networks is belief propagation (BP) which is completely model-based and is known to suffer from providing inconsistent (overconfident) estimates. The proposed approach addresses these limitations by complementing BP with learned information provided by a graph neural network (GNN). We demonstrate numerically that our method can improve estimation accuracy and avoid overconfident beliefs, while its computational complexity remains comparable to BP. Notably, more consistent beliefs are obtained by not explicitly addressing overconfidence in the loss function used for training of the GNN.


title: Synthesis and Tailored Properties Towards Designer Covalent Organic Framework Thin Films and Heterostructures

abstract: Porous polymeric covalent organic frameworks (COFs) have been under intense synthetic investigation with over 100 unique structural motifs known. In order to realize the true potential of these materials, converting the powders into thin films with strict control of thickness and morphology is necessary and accomplished through techniques including interfacial synthesis, chemical exfoliation and mechanical delamination. Recent progress in the construction and tailored properties of thin film COFs are highlighted in this review, addressing mechanical properties as well as application-focused properties in filtration, electronics, sensors, electrochemical, magnetics, optoelectronics and beyond. Additionally, heterogeneous integration of these thin films with other inorganic and organic materials is discussed, revealing exciting opportunities to integrate COF thin films with other state of the art material and device systems.


title: Composing Behaviors of Networks

abstract: This thesis aims to develop a compositional theory for the operational semantics of networks. The networks considered are described by either internal or enriched graphs. In the internal case we focus on $\mathsf{Q}$-nets, a generalization of Petri nets based on a Lawvere theory $\mathsf{Q}$. $\mathsf{Q}$-nets include many known variants of Petri nets including pre-nets, integer nets, elementary net systems, and bounded nets. In the enriched case we focus on graphs enriched in a quantale $R$ regarded as matrices with entries in $R$. These $R$-matrices represent distance networks, Markov processes, capacity networks, non-deterministic finite automata, simple graphs, and more. The operational semantics of $\mathsf{Q}$-nets is constructed as an adjunction between $\mathsf{Q}$-nets and categories internal to the category of models of $\mathsf{Q}$. Similarly, the operational semantics of $R$-matrices is constructed as an adjunction between $R$-matrices and categories enriched in $R$. The left adjoint of this adjunction sends an $R$-matrix $M$ to the $R$-category $F_R(M)$ whose hom-objects are solutions of the algebraic path problem: a generalization of the shortest path problem to graphs weighted in $R$. For both $\mathsf{Q}$-nets and $R$-matrices we use the theory of structured cospans to study the compositionality of the above operational semantics. For each type of network we construct a double category whose morphisms are "open networks", i.e. networks with certain vertices designated as input or output. We introduce the black-boxing of an open network, a profunctor describing the externally observable behavior of an open network. We introduce a class of open networks called "functional open networks" for which black-boxing preserves composition.


title: Quantum Thermometry with a Dissipative Quantum Rabi System

abstract: Dissipative quantum Rabi System, a finite-component system composed of a single two-level atom interacting with an optical cavity field mode, exhibits a quantum phase transition, which can be exploited to greatly enhance the estimation precision of unitary parameters (frequency and coupling strength). Here, using the quantum Langevin equation, standard mean field theory and adiabatic elimination, we investigate the quantum thermometry of a thermal bath surrounding the atom with quantum optical probes. With the increase of coupling strength between the atom and the cavity field, two kinds of singularities can be observed. One type of singularity is the exceptional point (EP) in the anti-parity-time (anti-$\mathcal{PT}$) symmetrical cavity field. The other type of singularity is the critical point (CP) of phase transition from the normal to superradiant phase. We show that the optimal measurement precision occurs at the CP, instead of the EP. And the direct photon detection represents an excellent proxy for the optimal measurement near the CP. In the case where the thermal bath to be tested is independent of the extra thermal bath interacting with the cavity field, the estimation precision of the temperature always increases with the coupling strength. Oppositely, if the thermal bath to be tested is in equilibrium with the extra bath interacting with the cavity field, noises that suppress the information of the temperature will be introduced when increasing the coupling strength unless it is close to the CP.


title: Directed Acyclic Graph Network for Conversational Emotion Recognition

abstract: The modeling of conversational context plays a vital role in emotion recognition from conversation (ERC). In this paper, we put forward a novel idea of encoding the utterances with a directed acyclic graph (DAG) to better model the intrinsic structure within a conversation, and design a directed acyclic neural network, namely DAG-ERC, to implement this idea. In an attempt to combine the strengths of conventional graph-based neural models and recurrence-based neural models, DAG-ERC provides a more intuitive way to model the information flow between long-distance conversation background and nearby context. Extensive experiments are conducted on four ERC benchmarks with state-of-the-art models employed as baselines for comparison. The empirical results demonstrate the superiority of this new model and confirm the motivation of the directed acyclic graph architecture for ERC.


title: Propositional Encodings of Acyclicity and Reachability by using Vertex Elimination

abstract: We introduce novel methods for encoding acyclicity and s-t-reachability constraints for propositional formulas with underlying directed graphs. They are based on vertex elimination graphs, which makes them suitable for cases where the underlying graph is sparse. In contrast to solvers with ad hoc constraint propagators for acyclicity and reachability constraints such as GraphSAT, our methods encode these constraints as standard propositional clauses, making them directly applicable with any SAT solver. An empirical study demonstrates that our methods together with an efficient SAT solver can outperform both earlier encodings of these constraints as well as GraphSAT, particularly when underlying graphs are sparse.


title: Deconditional Downscaling with Gaussian Processes

abstract: Refining low-resolution (LR) spatial fields with high-resolution (HR) information, often known as statistical downscaling, is challenging as the diversity of spatial datasets often prevents direct matching of observations. Yet, when LR samples are modeled as aggregate conditional means of HR samples with respect to a mediating variable that is globally observed, the recovery of the underlying fine-grained field can be framed as taking an "inverse" of the conditional expectation, namely a deconditioning problem. In this work, we propose a Bayesian formulation of deconditioning which naturally recovers the initial reproducing kernel Hilbert space formulation from Hsu and Ramos (2019). We extend deconditioning to a downscaling setup and devise efficient conditional mean embedding estimator for multiresolution data. By treating conditional expectations as inter-domain features of the underlying field, a posterior for the latent field can be established as a solution to the deconditioning problem. Furthermore, we show that this solution can be viewed as a two-staged vector-valued kernel ridge regressor and show that it has a minimax optimal convergence rate under mild assumptions. Lastly, we demonstrate its proficiency in a synthetic and a real-world atmospheric field downscaling problem, showing substantial improvements over existing methods.


title: Solutions with snaking singularities for the fast diffusion equation

abstract: We construct solutions of the fast diffusion equation, which exist for all $t\in\mathbb{R}$ and are singular on the set $\Gamma(t):= \{ \xi(s) ; -\infty <s \leq ct \}$, $c>0$, where $\xi\in C^3(\mathbb{R};\mathbb{R}^n)$, $n\geq 2$. We also give a precise description of the behavior of the solutions near $\Gamma(t)$.


title: Compositional Thinking in Cyberphysical Systems Theory

abstract: Engineering safe and secure cyber-physical systems requires system engineers to develop and maintain a number of model views, both dynamic and static, which can be seen as algebras. We posit that verifying the composition of requirement, behavioral, and architectural models using category theory gives rise to a strictly compositional interpretation of cyber-physical systems theory, which can assist in the modeling and analysis of safety-critical cyber-physical systems.


title: Optimizing Error-Bounded Lossy Compression for Scientific Data on GPUs

abstract: Error-bounded lossy compression is a critical technique for significantly reducing scientific data volumes. With ever-emerging heterogeneous high-performance computing (HPC) architecture, GPU-accelerated error-bounded compressors (such as cuSZ+ and cuZFP) have been developed. However, they suffer from either low performance or low compression ratios. To this end, we propose cuSZ+ to target both high compression ratios and throughputs. We identify that data sparsity and data smoothness are key factors for high compression throughputs. Our key contributions in this work are fourfold: (1) We propose an efficient compression workflow to adaptively perform run-length encoding and/or variable-length encoding. (2) We derive Lorenzo reconstruction in decompression as multidimensional partial-sum computation and propose a fine-grained Lorenzo reconstruction algorithm for GPU architectures. (3) We carefully optimize each of cuSZ+ kernels by leveraging state-of-the-art CUDA parallel primitives. (4) We evaluate cuSZ+ using seven real-world HPC application datasets on V100 and A100 GPUs. Experiments show cuSZ+ improves the compression throughputs and ratios by up to 18.4X and 5.3X, respectively, over cuSZ on the tested datasets.


title: Correlation effects on non-Hermitian point-gap topology in zero dimension: reduction of topological classification

abstract: We analyze a zero-dimensional correlated system with special emphasis on the non-Hermitian point-gap topology protected by chiral symmetry. Our analysis elucidates that correlations destroy an exceptional point on a topological transition point which separates two topological phases in the non-interacting case; one of them is characterized by the zero-th Chern number $N_{0\mathrm{Ch}}=0$, and the other is characterized by $N_{0\mathrm{Ch}}=2$. This fact implies that correlations allow to continuously connect the two distinct topological phases in the non-interacting case without closing the point-gap, which is analogous to the reduction of topological classifications by correlations in Hermitian systems. Furthermore, we also discover a Mott exceptional point, an exceptional point where only spin degrees of freedom are involved.

categories: cond-mat.str-el cond-mat.mes-hall cond-mat.stat-mech quant-ph


title: Random Simplicial Complexes: Models and Phenomena

abstract: We review a collection of models of random simplicial complexes together with some of the most exciting phenomena related to them. We do not attempt to cover all existing models, but try to focus on those for which many important results have been recently established rigorously in mathematics, especially in the context of algebraic topology. In application to real-world systems, the reviewed models are typically used as null models, so that we take a statistical stance, emphasizing, where applicable, the entropic properties of the reviewed models. We also review a collection of phenomena and features observed in these models, and split the presented results into two classes: phase transitions and distributional limits. We conclude with an outline of interesting future research directions.

categories: math.PR cond-mat.dis-nn cs.SI math.AT physics.soc-ph


title: Ordered Reference Dependent Choice

abstract: This paper studies how violations of structural assumptions like expected utility and exponential discounting can be connected to basic rationality violations, even though these assumptions are typically regarded as independent building blocks in decision theory. A reference-dependent generalization of behavioral postulates captures preference shifts in various choice domains. When reference points are fixed, canonical models hold; otherwise, reference-dependent preference parameters (e.g., CARA coefficients, discount factors) give rise to "non-standard" behavior. The framework allows us to study risk, time, and social preferences collectively, where seemingly independent anomalies are interconnected through the lens of reference-dependent choice.


title: Robust learning from corrupted EEG with dynamic spatial filtering

abstract: Building machine learning models using EEG recorded outside of the laboratory setting requires methods robust to noisy data and randomly missing channels. This need is particularly great when working with sparse EEG montages (1-6 channels), often encountered in consumer-grade or mobile EEG devices. Neither classical machine learning models nor deep neural networks trained end-to-end on EEG are typically designed or tested for robustness to corruption, and especially to randomly missing channels. While some studies have proposed strategies for using data with missing channels, these approaches are not practical when sparse montages are used and computing power is limited (e.g., wearables, cell phones). To tackle this problem, we propose dynamic spatial filtering (DSF), a multi-head attention module that can be plugged in before the first layer of a neural network to handle missing EEG channels by learning to focus on good channels and to ignore bad ones. We tested DSF on public EEG data encompassing ~4,000 recordings with simulated channel corruption and on a private dataset of ~100 at-home recordings of mobile EEG with natural corruption. Our proposed approach achieves the same performance as baseline models when no noise is applied, but outperforms baselines by as much as 29.4% accuracy when significant channel corruption is present. Moreover, DSF outputs are interpretable, making it possible to monitor channel importance in real-time. This approach has the potential to enable the analysis of EEG in challenging settings where channel corruption hampers the reading of brain signals.


title: BSNN: Towards Faster and Better Conversion of Artificial Neural Networks to Spiking Neural Networks with Bistable Neurons

abstract: The spiking neural network (SNN) computes and communicates information through discrete binary events. It is considered more biologically plausible and more energy-efficient than artificial neural networks (ANN) in emerging neuromorphic hardware. However, due to the discontinuous and non-differentiable characteristics, training SNN is a relatively challenging task. Recent work has achieved essential progress on an excellent performance by converting ANN to SNN. Due to the difference in information processing, the converted deep SNN usually suffers serious performance loss and large time delay. In this paper, we analyze the reasons for the performance loss and propose a novel bistable spiking neural network (BSNN) that addresses the problem of spikes of inactivated neurons (SIN) caused by the phase lead and phase lag. Also, when ResNet structure-based ANNs are converted, the information of output neurons is incomplete due to the rapid transmission of the shortcut path. We design synchronous neurons (SN) to help efficiently improve performance. Experimental results show that the proposed method only needs 1/4-1/10 of the time steps compared to previous work to achieve nearly lossless conversion. We demonstrate state-of-the-art ANN-SNN conversion for VGG16, ResNet20, and ResNet34 on challenging datasets including CIFAR-10 (95.16% top-1), CIFAR-100 (78.12% top-1), and ImageNet (72.64% top-1).


title: Estimating Fund-Raising Performance for Start-up Projects from a Market Graph Perspective

abstract: In the online innovation market, the fund-raising performance of the start-up project is a concerning issue for creators, investors and platforms. Unfortunately, existing studies always focus on modeling the fund-raising process after the publishment of a project but the predicting of a project attraction in the market before setting up is largely unexploited. Usually, this prediction is always with great challenges to making a comprehensive understanding of both the start-up project and market environment. To that end, in this paper, we present a focused study on this important problem from a market graph perspective. Specifically, we propose a Graph-based Market Environment (GME) model for predicting the fund-raising performance of the unpublished project by exploiting the market environment. In addition, we discriminatively model the project competitiveness and market preferences by designing two graph-based neural network architectures and incorporating them into a joint optimization stage. Furthermore, to explore the information propagation problem with dynamic environment in a large-scale market graph, we extend the GME model with parallelizing competitiveness quantification and hierarchical propagation algorithm. Finally, we conduct extensive experiments on real-world data. The experimental results clearly demonstrate the effectiveness of our proposed model.


title: On the mean-field limit for the consensus-based optimization

abstract: This paper is concerned with the large particle limit for the consensus-based optimization (CBO), which was postulated in the pioneering works [6,28]. In order to solve this open problem, we adapt a compactness argument by first proving the tightness of the empirical measures $\{\mu^N\}_{N\geq 2}$ associated to the particle system and then verifying that the limit measure $\mu$ is the unique weak solution to the mean-field CBO equation. Such results are extended to the model of particle swarm optimization (PSO).


title: Search Spaces for Neural Model Training

abstract: While larger neural models are pushing the boundaries of what deep learning can do, often more weights are needed to train models rather than to run inference for tasks. This paper seeks to understand this behavior using search spaces -- adding weights creates extra degrees of freedom that form new paths for optimization (or wider search spaces) rendering neural model training more effective. We then show how we can augment search spaces to train sparse models attaining competitive scores across dozens of deep learning workloads. They are also are tolerant of structures targeting current hardware, opening avenues for training and inference acceleration. Our work encourages research to explore beyond massive neural models being used today.


title: Score test for missing at random or not

abstract: Missing data are frequently encountered in various disciplines and can be divided into three categories: missing completely at random (MCAR), missing at random (MAR) and missing not at random (MNAR). Valid statistical approaches to missing data depend crucially on correct identification of the underlying missingness mechanism. Although the problem of testing whether this mechanism is MCAR or MAR has been extensively studied, there has been very little research on testing MAR versus MNAR.A critical challenge that is faced when dealing with this problem is the issue of model identification under MNAR. In this paper, under a logistic model for the missing probability, we develop two score tests for the problem of whether the missingness mechanism is MAR or MNAR under a parametric model and a semiparametric location model on the regression function. The score tests require only parameter estimation under the null MAR assumption, which completely circumvents the identification issue. Our simulations and analysis of human immunodeficiency virus data show that the score tests have well-controlled type I errors and desirable powers.


title: MR elasticity reconstruction using statistical physical modeling and explicit data-driven denoising regularizer

abstract: Elasticity image, visualizing the quantitative map of tissue stiffness, can be reconstructed by solving an inverse problem. Classical methods for magnetic resonance elastography (MRE) try to solve a regularized optimization problem comprising a deterministic physical model and a prior constraint as data-fidelity term and regularization term, respectively. For improving the elasticity reconstructions, appropriate prior about the underlying elasticity distribution is required which is not unique. This article proposes an infused approach for MRE reconstruction by integrating the statistical representation of the physical laws of harmonic motions and learning-based prior. For data-fidelity term, we use a statistical linear-algebraic model of equilibrium equations and for the regularizer, data-driven regularization by denoising (RED) is utilized. In the proposed optimization paradigm, the regularizer gradient is simply replaced by the residual of learned denoiser leading to time-efficient computation and convex explicit objective function. Simulation results of elasticity reconstruction verify the effectiveness of the proposed approach.


title: Robust Navigation for Racing Drones based on Imitation Learning and Modularization

abstract: This paper presents a vision-based modularized drone racing navigation system that uses a customized convolutional neural network (CNN) for the perception module to produce high-level navigation commands and then leverages a state-of-the-art planner and controller to generate low-level control commands, thus exploiting the advantages of both data-based and model-based approaches. Unlike the state-of-the-art method which only takes the current camera image as the CNN input, we further add the latest three drone states as part of the inputs. Our method outperforms the state-of-the-art method in various track layouts and offers two switchable navigation behaviors with a single trained network. The CNN-based perception module is trained to imitate an expert policy that automatically generates ground truth navigation commands based on the pre-computed global trajectories. Owing to the extensive randomization and our modified dataset aggregation (DAgger) policy during data collection, our navigation system, which is purely trained in simulation with synthetic textures, successfully operates in environments with randomly-chosen photorealistic textures without further fine-tuning.


title: Self-Ensembling Contrastive Learning for Semi-Supervised Medical Image Segmentation

abstract: Deep learning has demonstrated significant improvements in medical image segmentation using a sufficiently large amount of training data with manual labels. Acquiring well-representative labels requires expert knowledge and exhaustive labors. In this paper, we aim to boost the performance of semi-supervised learning for medical image segmentation with limited labels using a self-ensembling contrastive learning technique. To this end, we propose to train an encoder-decoder network at image-level with small amounts of labeled images, and more importantly, we learn latent representations directly at feature-level by imposing contrastive loss on unlabeled images. This method strengthens intra-class compactness and inter-class separability, so as to get a better pixel classifier. Moreover, we devise a student encoder for online learning and an exponential moving average version of it, called teacher encoder, to improve the performance iteratively in a self-ensembling manner. To construct contrastive samples with unlabeled images, two sampling strategies that exploit structure similarity across medical images and utilize pseudo-labels for construction, termed region-aware and anatomical-aware contrastive sampling, are investigated. We conduct extensive experiments on an MRI and a CT segmentation dataset and demonstrate that in a limited label setting, the proposed method achieves state-of-the-art performance. Moreover, the anatomical-aware strategy that prepares contrastive samples on-the-fly using pseudo-labels realizes better contrastive regularization on feature representations.


title: Normal Cayley digraphs of dihedral groups with CI-property

abstract: A Cayley (di)graph $Cay(G,S)$ of a group $G$ with respect to $S$ is said to be normal if the right regular representation of $G$ is normal in the automorphism group of $Cay(G,S)$, and is called a CI-(di)graph if there is $\alpha\in Aut(G)$ such that $S^\alpha=T$, whenever $Cay(G,S)\cong Cay(G,T)$ for a Cayley (di)graph $Cay(G,T)$. A finite group $G$ is called a DCI-group or a NDCI-group if all Cayley digraphs or normal Cayley digraphs of $G$ are CI-digraphs, and is called a CI-group or a NCI-group if all Cayley graphs or normal Cayley graphs of $G$ are CI-graphs, respectively. Motivated by a conjecture proposed by \'Ad\'am in 1967, CI-groups and DCI-groups have been actively studied during the last fifty years by many researchers in algebraic graph theory. It takes about thirty years to obtain the classification of cyclic CI-groups and DCI-groups, and recently, the first two authors, among others, classified cyclic NCI-groups and NDCI-groups. Even though there are many partial results on dihedral CI-groups and DCI-groups, their classification is still elusive. In this paper, we prove that a dihedral group of order $2n$ is a NCI-group or a NDCI-group if and only if $n=2,4$ or $n$ is odd. As a direct consequence, we have that if a dihedral group $D_{2n}$ of order $2n$ is a DCI-group then $n=2$ or $n$ is odd-square-free, and that if $D_{2n}$ is a CI-group then $n=2,9$ or $n$ is odd-square-free, throwing some new light on classification of dihedral CI-groups and DCI-groups.


title: Image-Based Plant Wilting Estimation

abstract: Many plants become limp or droop through heat, loss of water, or disease. This is also known as wilting. In this paper, we examine plant wilting caused by bacterial infection. In particular, we want to design a metric for wilting based on images acquired of the plant. A quantifiable wilting metric will be useful in studying bacterial wilt and identifying resistance genes. Since there is no standard way to estimate wilting, it is common to use ad hoc visual scores. This is very subjective and requires expert knowledge of the plants and the disease mechanism. Our solution consists of using various wilting metrics acquired from RGB images of the plants. We also designed several experiments to demonstrate that our metrics are effective at estimating wilting in plants.


title: Photometric analysis of two extreme low mass ratio contact binary systems

abstract: Multi band photometry and light curve analysis for two newly recognized contact binary systems, TYC 6995-813-1 and NSVS 13602901 are presented. Both were found to be of extreme low mass ratios 0.11 and 0.17, respectively. The secondary components of both systems show evidence of considerable evolution with elevated densities as well as both luminosity and radii well above their main sequence counterparts. Even in the absence of significant spot activity at least one of the systems, TYC 6995-813-1, shows features of magnetic and chromospheric activity. TYC 6995-813-1 is also determined to be a potential merger candidate with its current separation near the theoretical instability separation.


title: Legibility of Videos with ASL signers

abstract: The viewing size of a signer correlates with legibility, i.e., the ease with which a viewer can recognize individual signs. The WCAG 2.0 guidelines (G54) mention in the notes that there should be a mechanism to adjust the size to ensure the signer is discernible but does not state minimum discernibility guidelines. The fluent range (the range over which sign viewers can follow the signers at maximum speed) extends from about 7{\deg} to 20{\deg}, which is far greater than 2{\deg} for print. Assuming a standard viewing distance of 16 inches from a 5-inch smartphone display, the corresponding sizes are from 2 to 5 inches, i.e., from 1/3rd to full-screen. This is consistent with vision science findings about human visual processing properties, and how they play a dominant role in constraining the distribution of signer sizes.


title: Characterizing Impacts of Storage Faults on HPC Applications: A Methodology and Insights

abstract: In recent years, the increasing complexity in scientific simulations and emerging demands for training heavy artificial intelligence models require massive and fast data accesses, which urges high-performance computing (HPC) platforms to equip with more advanced storage infrastructures such as solid-state disks (SSDs). While SSDs offer high-performance I/O, the reliability challenges faced by the HPC applications under the SSD-related failures remains unclear, in particular for failures resulting in data corruptions. The goal of this paper is to understand the impact of SSD-related faults on the behaviors of complex HPC applications. To this end, we propose FFIS, a FUSE-based fault injection framework that systematically introduces storage faults into the application layer to model the errors originated from SSDs. FFIS is able to plant different I/O related faults into the data returned from underlying file systems, which enables the investigation on the error resilience characteristics of the scientific file format. We demonstrate the use of FFIS with three representative real HPC applications, showing how each application reacts to the data corruptions, and provide insights on the error resilience of the widely adopted HDF5 file format for the HPC applications.


title: Asymptotics of commuting probabilities in reductive algebraic groups

abstract: Let $G$ be an algebraic group. For $d\geq 1$, we define the commuting probabilities $cp_d(G) = \frac{dim(\mathfrak C_d(G))}{dim(G^d)}$, where $\mathfrak C_d(G)$ is the variety of commuting $d$-tuples in $G$. We prove that for a reductive group $G$ when $d$ is large, $cp_d(G)\sim \frac{\alpha}{n}$ where $n=\dim(G)$, and $\alpha$ is the maximal dimension of an Abelian subgroup of $G$. For a finite reductive group $G$ defined over the field $\mathbb F_q$, we show that $cp_{d+1}(G(\mathbb F_q))\sim q^{(\alpha-n)d}$, and give several examples.


title: YOLO5Face: Why Reinventing a Face Detector

abstract: Tremendous progress has been made on face detection in recent years using convolutional neural networks. While many face detectors use designs designated for detecting faces, we treat face detection as a generic object detection task. We implement a face detector based on the YOLOv5 object detector and call it YOLO5Face. We make a few key modifications to the YOLOv5 and optimize it for face detection. These modifications include adding a five-point landmark regression head, using a stem block at the input of the backbone, using smaller-size kernels in the SPP, and adding a P6 output in the PAN block. We design detectors of different model sizes, from an extra-large model to achieve the best performance to a super small model for real-time detection on an embedded or mobile device. Experiment results on the WiderFace dataset show that on VGA images, our face detectors can achieve state-of-the-art performance in almost all the Easy, Medium, and Hard subsets, exceeding the more complex designated face detectors. The code is available at \url{https://github.com/deepcam-cn/yolov5-face}


title: Contrastive Fine-tuning Improves Robustness for Neural Rankers

abstract: The performance of state-of-the-art neural rankers can deteriorate substantially when exposed to noisy inputs or applied to a new domain. In this paper, we present a novel method for fine-tuning neural rankers that can significantly improve their robustness to out-of-domain data and query perturbations. Specifically, a contrastive loss that compares data points in the representation space is combined with the standard ranking loss during fine-tuning. We use relevance labels to denote similar/dissimilar pairs, which allows the model to learn the underlying matching semantics across different query-document pairs and leads to improved robustness. In experiments with four passage ranking datasets, the proposed contrastive fine-tuning method obtains improvements on robustness to query reformulations, noise perturbations, and zero-shot transfer for both BERT and BART based rankers. Additionally, our experiments show that contrastive fine-tuning outperforms data augmentation for robustifying neural rankers.


title: Exploring the Redshift-Space Peculiar Velocity Field and its Power Spectrum

abstract: Redshift-space distortions (RSD) generically affect any spatially-dependent observable that is mapped using redshift information. The effect on the observed clustering of galaxies is the primary example of this. This paper is devoted to another example: the effect of RSD on the apparent peculiar motions of tracers as inferred from their positions in redshift space (i.e. the observed distance). Our theoretical study is motivated by practical considerations, mainly, the direct estimation of the velocity power spectrum, which is preferably carried out using the tracer's redshift-space position (so as to avoid uncertainties in distance measurements). We formulate the redshift-space velocity field and show that RSD enters as a higher-order effect. Physically, this effect may be interpreted as a dissipative correction to the usual perfect-fluid description of dark matter. We show that the effect on the power spectrum is a damping on relatively large, quasilinear scales ($k>0.01\,h\,{\rm Mpc}^{-1}$), as was observed, though unexplained, in $N$-body simulations elsewhere. This paper presents two power spectrum models for the peculiar velocity field in redshift space, both of which can be considered velocity analogues of existing clustering models. In particular, we show that the "Finger-of-God" effect, while also present in the velocity field, cannot be entirely blamed for the observed damping in simulations. Our work provides some of the missing modelling ingredients required for a density--velocity multi-tracer analysis, which has been proposed for upcoming redshift surveys.


title: Global topologies of Reeb spaces of stable fold maps with non-trivial top homology groups

abstract: The Reeb space of a continuous map is the space of all (elements representing) connected components of preimages endowed with the quotient topology induced from the natural equivalence relation on the domain. These objects are strong tools in (differential) topological theory of Morse functions, fold maps, which are their higher dimensional variants, and so on: they are in general polyhedra whose dimensions are same as those of the targets. In suitable cases Reeb spaces inherit topological information such as homology groups, cohomology rings, and so on, of the manifolds. This presents the following problem: what are global topologies of Reeb spaces of these smooth maps of suitable classes like? The present paper presents families of stable fold maps having Reeb spaces with non-trivial top homology groups with their (co)homology groups (and rings). Related studies on the global topologies from the viewpoints of the singularity theory of differentiable maps and differential topology have been presented by various researchers including the author. The author previously constructed families of fold maps with Reeb spaces with non-trivial top homology groups and with good topological properties. This paper presents new families, especially, generalized situations of some known situations.


title: SDN-based Runtime Security Enforcement Approach for Privacy Preservation of Dynamic Web Service Composition

abstract: Aiming at the privacy preservation of dynamic Web service composition, this paper proposes a SDN-based runtime security enforcement approach for privacy preservation of dynamic Web service composition. The main idea of this approach is that the owner of service composition leverages the security policy model (SPM) to define the access control relationships that service composition must comply with in the application plane, then SPM model is transformed into the low-level security policy model (RSPM) containing the information of SDN data plane, and RSPM model is uploaded into the SDN controller. After uploading, the virtual machine access control algorithm integrated in the SDN controller monitors all of access requests towards service composition at runtime. Only the access requests that meet the definition of RSPM model can be forwarded to the target terminal. Any access requests that do not meet the definition of RSPM model will be automatically blocked by Openflow switches or deleted by SDN controller, Thus, this approach can effectively solve the problems of network-layer illegal accesses, identity theft attacks and service leakages when Web service composition is running. In order to verify the feasibility of this approach, this paper implements an experimental system by using POX controller and Mininet virtual network simulator, and evaluates the effectiveness and performance of this approach by using this system. The final experimental results show that the method is completely effective, and the method can always get the correct calculation results in an acceptable time when the scale of RSPM model is gradually increasing.


title: Corpus-Level Evaluation for Event QA: The IndiaPoliceEvents Corpus Covering the 2002 Gujarat Violence

abstract: Automated event extraction in social science applications often requires corpus-level evaluations: for example, aggregating text predictions across metadata and unbiased estimates of recall. We combine corpus-level evaluation requirements with a real-world, social science setting and introduce the IndiaPoliceEvents corpus--all 21,391 sentences from 1,257 English-language Times of India articles about events in the state of Gujarat during March 2002. Our trained annotators read and label every document for mentions of police activity events, allowing for unbiased recall evaluations. In contrast to other datasets with structured event representations, we gather annotations by posing natural questions, and evaluate off-the-shelf models for three different tasks: sentence classification, document ranking, and temporal aggregation of target events. We present baseline results from zero-shot BERT-based models fine-tuned on natural language inference and passage retrieval tasks. Our novel corpus-level evaluations and annotation approach can guide creation of similar social-science-oriented resources in the future.


title: Towards a Better Understanding of Linear Models for Recommendation

abstract: Recently, linear regression models, such as EASE and SLIM, have shown to often produce rather competitive results against more sophisticated deep learning models. On the other side, the (weighted) matrix factorization approaches have been popular choices for recommendation in the past and widely adopted in the industry. In this work, we aim to theoretically understand the relationship between these two approaches, which are the cornerstones of model-based recommendations. Through the derivation and analysis of the closed-form solutions for two basic regression and matrix factorization approaches, we found these two approaches are indeed inherently related but also diverge in how they "scale-down" the singular values of the original user-item interaction matrix. This analysis also helps resolve the questions related to the regularization parameter range and model complexities. We further introduce a new learning algorithm in searching (hyper)parameters for the closed-form solution and utilize it to discover the nearby models of the existing solutions. The experimental results demonstrate that the basic models and their closed-form solutions are indeed quite competitive against the state-of-the-art models, thus, confirming the validity of studying the basic models. The effectiveness of exploring the nearby models are also experimentally validated.


title: Interactive Explanations: Diagnosis and Repair of Reinforcement Learning Based Agent Behaviors

abstract: Reinforcement learning techniques successfully generate convincing agent behaviors, but it is still difficult to tailor the behavior to align with a user's specific preferences. What is missing is a communication method for the system to explain the behavior and for the user to repair it. In this paper, we present a novel interaction method that uses interactive explanations using templates of natural language as a communication method. The main advantage of this interaction method is that it enables a two-way communication channel between users and the agent; the bot can explain its thinking procedure to the users, and the users can communicate their behavior preferences to the bot using the same interactive explanations. In this manner, the thinking procedure of the bot is transparent, and users can provide corrections to the bot that include a suggested action to take, a goal to achieve, and the reasons behind these decisions. We tested our proposed method in a clone of the video game named \textit{Super Mario Bros.}, and the results demonstrate that our interactive explanation approach is effective at diagnosing and repairing bot behaviors.


title: Unsupervised Adaptive Semantic Segmentation with Local Lipschitz Constraint

abstract: Recent advances in unsupervised domain adaptation have seen considerable progress in semantic segmentation. Existing methods either align different domains with adversarial training or involve the self-learning that utilizes pseudo labels to conduct supervised training. The former always suffers from the unstable training caused by adversarial training and only focuses on the inter-domain gap that ignores intra-domain knowledge. The latter tends to put overconfident label prediction on wrong categories, which propagates errors to more samples. To solve these problems, we propose a two-stage adaptive semantic segmentation method based on the local Lipschitz constraint that satisfies both domain alignment and domain-specific exploration under a unified principle. In the first stage, we propose the local Lipschitzness regularization as the objective function to align different domains by exploiting intra-domain knowledge, which explores a promising direction for non-adversarial adaptive semantic segmentation. In the second stage, we use the local Lipschitzness regularization to estimate the probability of satisfying Lipschitzness for each pixel, and then dynamically sets the threshold of pseudo labels to conduct self-learning. Such dynamical self-learning effectively avoids the error propagation caused by noisy labels. Optimization in both stages is based on the same principle, i.e., the local Lipschitz constraint, so that the knowledge learned in the first stage can be maintained in the second stage. Further, due to the model-agnostic property, our method can easily adapt to any CNN-based semantic segmentation networks. Experimental results demonstrate the excellent performance of our method on standard benchmarks.


title: Close-coupled model of Feshbach resonances in ultracold $^3$He* and $^4$He* atomic Collisions

abstract: Helium atoms in the metastable $2^3{S_{1}}$ state (He$^*$) have unique advantages for ultracold atomic experiments. However, there is no known accessible Feshbach resonance in He$^*$, which could be used to manipulate the scattering length and hence unlock several new experimental possiblities. Previous experimental and theoretical studies for He$^*$ have produced contradictory results. We aimed to resolve this discrepancy with a theoretical search for Feshbach resonances, using a new close-coupled model of He$^*$ collisions in the presence of an external magnetic field. Several resonances were detected and the existing literature discrepancy was resolved. Although none of the resonances identified are readily experimentally useable, an interesting non-Feshbach scattering length variation with magnetic field was observed in heteronuclear collisions, at field strengths that are experimentally accessible.


title: CrystalCandle: A User-Facing Model Explainer for Narrative Explanations

abstract: Predictive machine learning models often lack interpretability, resulting in low trust from model end users despite having high predictive performance. While many model interpretation approaches return top important features to help interpret model predictions, these top features may not be well-organized or intuitive to end users, which limits model adoption rates. In this paper, we propose CrystalCandle, a user-facing model explainer that creates user-digestible interpretations and insights reflecting the rationale behind model predictions. CrystalCandle builds an end-to-end pipeline from machine learning platforms to end user platforms, and provides users with an interface for implementing model interpretation approaches and for customizing narrative insights. CrystalCandle is a platform consisting of four components: Model Importer, Model Interpreter, Narrative Generator, and Narrative Exporter. We describe these components, and then demonstrate the effectiveness of CrystalCandle through use cases at LinkedIn. Quantitative performance analyses indicate that CrystalCandle's narrative insights lead to lifts in adoption rates of predictive model recommendations, as well as to increases in downstream key metrics such as revenue when compared to previous approaches, while qualitative analyses indicate positive feedback from end users.


title: Precision wavelength calibration for Radial Velocity measurements using Uranium lines between 3800-6900 \AA

abstract: We present here the precise wavelength calibration of a high-resolution spectrum using Uranium (U) lines in the wavelength range of 3809 - 6833 \AA\ for precision radial velocity measurements for exoplanet detection or related astrophysical sciences. We identify 1540 well-resolved U lines from a high-resolution (R=67,000) spectrum of the uranium-argon hollow cathode lamp (UAr HCL) using PARAS spectrograph in the aforesaid wavelength range. We calculate the neutral and first allowed transitions (Ritz wavelength) of U from its known energy levels and compare them with our observed central wavelengths. We measure an offset of -0.15 m\AA\space in our final U line list. The line list has an average measurement uncertainty of 15 m s$^{-1}$ (0.013 pixels or 0.28 m\AA). We included these lines to the PARAS data analysis framework to perform the wavelength calibration and then calculate the multi-order Radial Velocity (RV) of PARAS spectra. The typical dispersion of residuals around the wavelength solution of a UAr spectrum, using U lines, is found to be 0.8 m\AA\space($\sim$45 m s$^{-1}$). With the use of this line list, we present our results for the precision RV of an on-sky source (A RV standard star), and an off-sky source (A HCL) observed with PARAS along with UAr HCL. We measure the dispersion in absolute drift difference between two fibers (inter-fiber drift) for a span of 6.5 hours to be 88 cm s$^{-1}$, and the RV dispersion (${\sigma_{RV}}$) for a RV standard star, HD55575 over the course of $\sim$450 days to be 3.2 m s$^{-1}$. These results are in good agreement with the previous ones measured using the ThAr HCL. It proves that the ThAr HCL with $\sim$ 99\% pure-Th are replaceable with the UAr HCL for the wavelength calibration of the high-resolution spectrographs such as PARAS (R $\leq$ 67,000) to achieve a RV precision of 1-3 m s$^{-1}$ in the visible region.


title: Phase Transition of Two-Dimensional Ferroelectric and Paraelectric Ga2O3 Monolayer: A Density Functional Theory and Machine-Learning Study

abstract: Ga2O3 is a wide-band-gap semiconductor of great interest for applications in electronics and optoelectronics. Two-dimensional (2D) Ga2O3 synthesized from top-down or bottom-up processes can reveal brand new heterogeneous structures and promising applications. In this paper, we study phase transitions among three low-energy stable Ga2O3 monolayer configurations using density functional theory and a newly developed machine-learning Gaussian approximation potential, together with solid-state nudged elastic band calculations. Kinetic minimum energy paths involving direct atomic jump as well as concerted layer motion are investigated. The low phase transition barriers indicate feasible tunability of the phase transition and orientation via strain engineering and external electric fields. Large-scale calculations using the newly trained machine-learning potential on the thermally activated single-atom jumps reveal the clear nucleation and growth processes of different domains. The results provide useful insights to future experimental synthesis and characterization of 2D Ga2O3 monolayers.


title: MarioMix: Creating Aligned Playstyles for Bots with Interactive Reinforcement Learning

abstract: In this paper, we propose a generic framework that enables game developers without knowledge of machine learning to create bot behaviors with playstyles that align with their preferences. Our framework is based on interactive reinforcement learning (RL), and we used it to create a behavior authoring tool called MarioMix. This tool enables non-experts to create bots with varied playstyles for the game titled Super Mario Bros. The main interaction procedure of MarioMix consists of presenting short clips of gameplay displaying precomputed bots with different playstyles to end-users. Then, end-users can select the bot with the playstyle that behaves as intended. We evaluated MarioMix by incorporating input from game designers working in the industry.


title: VeniBot: Towards Autonomous Venipuncture with Semi-supervised Vein Segmentation from Ultrasound Images

abstract: In the modern medical care, venipuncture is an indispensable procedure for both diagnosis and treatment. In this paper, unlike existing solutions that fully or partially rely on professional assistance, we propose VeniBot -- a compact robotic system solution integrating both novel hardware and software developments. For the hardware, we design a set of units to facilitate the supporting, positioning, puncturing and imaging functionalities. For the software, to move towards a full automation, we propose a novel deep learning framework -- semi-ResNeXt-Unet for semi-supervised vein segmentation from ultrasound images. From which, the depth information of vein is calculated and used to enable automated navigation for the puncturing unit. VeniBot is validated on 40 volunteers, where ultrasound images can be collected successfully. For the vein segmentation validation, the proposed semi-ResNeXt-Unet improves the dice similarity coefficient (DSC) by 5.36%, decreases the centroid error by 1.38 pixels and decreases the failure rate by 5.60%, compared to fully-supervised ResNeXt-Unet.


title: Uncertainty-Aware Self-Supervised Target-Mass Grasping of Granular Foods

abstract: Food packing industry workers typically pick a target amount of food by hand from a food tray and place them in containers. Since menus are diverse and change frequently, robots must adapt and learn to handle new foods in a short time-span. Learning to grasp a specific amount of granular food requires a large training dataset, which is challenging to collect reasonably quickly. In this study, we propose ways to reduce the necessary amount of training data by augmenting a deep neural network with models that estimate its uncertainty through self-supervised learning. To further reduce human effort, we devise a data collection system that automatically generates labels. We build on the idea that we can grasp sufficiently well if there is at least one low-uncertainty (high-confidence) grasp point among the various grasp point candidates. We evaluate the methods we propose in this work on a variety of granular foods -- coffee beans, rice, oatmeal and peanuts -- each of which has a different size, shape and material properties such as volumetric mass density or friction. For these foods, we show significantly improved grasp accuracy of user-specified target masses using smaller datasets by incorporating uncertainty.