title: On Comparing Fair Classifiers under Data Bias

abstract: In this paper, we consider a theoretical model for injecting data bias, namely, under-representation and label bias (Blum & Stangl, 2019). We empirically study the effect of varying data biases on the accuracy and fairness of fair classifiers. Through extensive experiments on both synthetic and real-world datasets (e.g., Adult, German Credit, Bank Marketing, COMPAS), we empirically audit pre-, in-, and post-processing fair classifiers from standard fairness toolkits for their fairness and accuracy by injecting varying amounts of under-representation and label bias in their training data (but not the test data). Our main observations are: 1. The fairness and accuracy of many standard fair classifiers degrade severely as the bias injected in their training data increases, 2. A simple logistic regression model trained on the right data can often outperform, in both accuracy and fairness, most fair classifiers trained on biased training data, and 3. A few, simple fairness techniques (e.g., reweighing, exponentiated gradients) seem to offer stable accuracy and fairness guarantees even when their training data is injected with under-representation and label bias. Our experiments also show how to integrate a measure of data bias risk in the existing fairness dashboards for real-world deployments.


title: LipLearner: Customizable Silent Speech Interactions on Mobile Devices

abstract: Silent speech interface is a promising technology that enables private communications in natural language. However, previous approaches only support a small and inflexible vocabulary, which leads to limited expressiveness. We leverage contrastive learning to learn efficient lipreading representations, enabling few-shot command customization with minimal user effort. Our model exhibits high robustness to different lighting, posture, and gesture conditions on an in-the-wild dataset. For 25-command classification, an F1-score of 0.8947 is achievable only using one shot, and its performance can be further boosted by adaptively learning from more data. This generalizability allowed us to develop a mobile silent speech interface empowered with on-device fine-tuning and visual keyword spotting. A user study demonstrated that with LipLearner, users could define their own commands with high reliability guaranteed by an online incremental learning scheme. Subjective feedback indicated that our system provides essential functionalities for customizable silent speech interactions with high usability and learnability.


title: Oscillations of Majorana neutrinos in supernova and CP violation

abstract: Leptonic CP violation is one of the most important topics in neutrino physics. CP violation in the neutrino sector is strongly related to the nature of neutrinos: whether they are Dirac or Majorana particles. In \cite{Popov:2021icg} we have shown that for Majorana neutrinos arance of nonzero Majorana CP-violating phases combined with strong magnetic field during supernova core-collaple can induce new resonances in neutrino oscillations, for example in $\nu_e \to \bar{\nu}_\tau$ channel. In this contribution we further study new resonances in Majorana neutrino oscillations, in particular energy dependence of amplitudes of these resonances. Our findings suggest a potential astrophysical setup for studying the nature of neutrino masses and leptonic CP violation and may be important for future neutrino experiments, such as JUNO, Hyper-Kamiokande and DUNE.


title: Classification of involutive commutative two-valued groups

abstract: A complete classification of finitely generated involutive commutative two-valued groups is obtained. Three series of such two-valued groups are constructed: principal, unipotent and special, and it is shown that any finitely generated involutive commutative two-valued group is isomorphic to a two-valued group belonging to one of these series. A number of classification results are obtained for topological involutive commutative two-valued groups in the Hausdorff and locally compact cases. The classification of algebraic involutive two-valued groups in the one-dimensional case is also discussed.


title: MANSA: Learning Fast and Slow in Multi-Agent Systems

abstract: In multi-agent reinforcement learning (MARL), independent learning (IL) often shows remarkable performance and easily scales with the number of agents. Yet, using IL can be inefficient and runs the risk of failing to successfully train, particularly in scenarios that require agents to coordinate their actions. Using centralised learning (CL) enables MARL agents to quickly learn how to coordinate their behaviour but employing CL everywhere is often prohibitively expensive in real-world applications. Besides, using CL in value-based methods often needs strong representational constraints (e.g. individual-global-max condition) that can lead to poor performance if violated. In this paper, we introduce a novel plug & play IL framework named Multi-Agent Network Selection Algorithm (MANSA) which selectively employs CL only at states that require coordination. At its core, MANSA has an additional agent that uses switching controls to quickly learn the best states to activate CL during training, using CL only where necessary and vastly reducing the computational burden of CL. Our theory proves MANSA preserves cooperative MARL convergence properties, boosts IL performance and can optimally make use of a fixed budget on the number CL calls. We show empirically in Level-based Foraging (LBF) and StarCraft Multi-agent Challenge (SMAC) that MANSA achieves fast, superior and more reliable performance while making 40% fewer CL calls in SMAC and using CL at only 1% CL calls in LBF.


title: Benchmark Studies on the Isomerization Enthalpies for Interstellar Molecular Species

abstract: With the well-established correlation between the relative stabilities of isomers and their interstellar abundances coupled with the prevalence of isomeric species among the interstellar molecular species, isomerization remains a plausible formation route for isomers in the interstellar medium. The present work reports an extensive investigation of the isomerization energies of 246 molecular species from 65 isomeric groups using the Gaussian-4 theory composite method with atoms ranging from 3 to 12. From the results, the high abundances of the most stable isomers coupled with the energy sources in interstellar medium drive the isomerization process even for barriers as high as 67.4 kcal/mol. Specifically, the cyanides and their corresponding isocyanides pairs appear to be effectively synthesized via this process. The following potential interstellar molecules; CNC, NCCN, c-C5H, methylene ketene, methyl Ketene, CH3SCH3, C5O, 1,1-ethanediol, propanoic acid, propan-2-ol, and propanol are identified and discussed. The study further reaffirms the importance of thermodynamics in interstellar formation processes on a larger scale and accounts for the known isomeric species. In all the isomeric groups, isomerization appears to be an effective route for the formation of the less stable isomers (which are probably less abundant) from the most stable ones that are perhaps more abundant.


title: Calculations of Excited Electronic States by Converging on Saddle Points Using Generalized Mode Following

abstract: Variational calculations of excited electronic states are carried out by finding saddle points on the surface that describes how the energy of the system varies as a function of the electronic degrees of freedom. This approach has several advantages over commonly used methods especially in the context of density functional calculations, as collapse to the ground state is avoided and yet, the orbitals are variationally optimized for the excited state. This optimization makes it possible to describe excitations with large charge transfer where calculations based on ground state orbitals are problematic, as in linear response time-dependent density functional theory. A generalized mode following method is presented where an $n^{\text{th}}$-order saddle point is found by inverting the components of the gradient in the direction of the eigenvectors of the $n$ lowest eigenvalues of the electronic Hessian matrix. This approach has the distinct advantage of following a chosen excited state through atomic configurations where the symmetry of the single determinant wave function is broken, as demonstrated in calculations of potential energy curves for nuclear motion in the ethylene and dihydrogen molecules. The method is implemented using a generalized Davidson algorithm and an exponential transformation for updating the orbitals within a generalized gradient approximation of the energy functional. Convergence is found to be more robust than for a direct optimization approach previously shown to outperform standard self-consistent field approaches, as illustrated here for charge transfer excitations in nitrobenzene and N-phenylpyrrole, involving calculations of $4^{\text{th}}$- and $6^{\text{th}}$-order saddle points, respectively. Finally, calculations of a diplatinum and silver complex are presented, illustrating the applicability of the method to excited state energy curves of large molecules.


title: An Extended Sequence Tagging Vocabulary for Grammatical Error Correction

abstract: We extend a current sequence-tagging approach to Grammatical Error Correction (GEC) by introducing specialised tags for spelling correction and morphological inflection using the SymSpell and LemmInflect algorithms. Our approach improves generalisation: the proposed new tagset allows a smaller number of tags to correct a larger range of errors. Our results show a performance improvement both overall and in the targeted error categories. We further show that ensembles trained with our new tagset outperform those trained with the baseline tagset on the public BEA benchmark.


title: Variational Voxel Pseudo Image Tracking

abstract: Uncertainty estimation is an important task for critical problems, such as robotics and autonomous driving, because it allows creating statistically better perception models and signaling the model's certainty in its predictions to the decision method or a human supervisor. In this paper, we propose a Variational Neural Network-based version of a Voxel Pseudo Image Tracking (VPIT) method for 3D Single Object Tracking. The Variational Feature Generation Network of the proposed Variational VPIT computes features for target and search regions and the corresponding uncertainties, which are later combined using an uncertainty-aware cross-correlation module in one of two ways: by computing similarity between the corresponding uncertainties and adding it to the regular cross-correlation values, or by penalizing the uncertain feature channels to increase influence of the certain features. In experiments, we show that both methods improve tracking performance, while penalization of uncertain features provides the best uncertainty quality.


title: Will Admins Cope? Decentralized Moderation in the Fediverse

abstract: As an alternative to Twitter and other centralized social networks, the Fediverse is growing in popularity. The recent, and polemical, takeover of Twitter by Elon Musk has exacerbated this trend. The Fediverse includes a growing number of decentralized social networks, such as Pleroma or Mastodon, that share the same subscription protocol (ActivityPub). Each of these decentralized social networks is composed of independent instances that are run by different administrators. Users, however, can interact with other users across the Fediverse regardless of the instance they are signed up to. The growing user base of the Fediverse creates key challenges for the administrators, who may experience a growing burden. In this paper, we explore how large that overhead is, and whether there are solutions to alleviate the burden. We study the overhead of moderation on the administrators. We observe a diversity of administrator strategies, with evidence that administrators on larger instances struggle to find sufficient resources. We then propose a tool, WatchGen, to semi-automate the process.


title: Video Waterdrop Removal via Spatio-Temporal Fusion in Driving Scenes

abstract: The waterdrops on windshields during driving can cause severe visual obstructions, which may lead to car accidents. Meanwhile, the waterdrops can also degrade the performance of a computer vision system in autonomous driving. To address these issues, we propose an attention-based framework that fuses the spatio-temporal representations from multiple frames to restore visual information occluded by waterdrops. Due to the lack of training data for video waterdrop removal, we propose a large-scale synthetic dataset with simulated waterdrops in complex driving scenes on rainy days. To improve the generality of our proposed method, we adopt a cross-modality training strategy that combines synthetic videos and real-world images. Extensive experiments show that our proposed method can generalize well and achieve the best waterdrop removal performance in complex real-world driving scenes.


title: Vector Quantized Wasserstein Auto-Encoder

abstract: Learning deep discrete latent presentations offers a promise of better symbolic and summarized abstractions that are more useful to subsequent downstream tasks. Inspired by the seminal Vector Quantized Variational Auto-Encoder (VQ-VAE), most of work in learning deep discrete representations has mainly focused on improving the original VQ-VAE form and none of them has studied learning deep discrete representations from the generative viewpoint. In this work, we study learning deep discrete representations from the generative viewpoint. Specifically, we endow discrete distributions over sequences of codewords and learn a deterministic decoder that transports the distribution over the sequences of codewords to the data distribution via minimizing a WS distance between them. We develop further theories to connect it with the clustering viewpoint of WS distance, allowing us to have a better and more controllable clustering solution. Finally, we empirically evaluate our method on several well-known benchmarks, where it achieves better qualitative and quantitative performances than the other VQ-VAE variants in terms of the codebook utilization and image reconstruction/generation.


title: Efficient Fraud Detection Using Deep Boosting Decision Trees

abstract: Fraud detection is to identify, monitor, and prevent potentially fraudulent activities from complex data. The recent development and success in AI, especially machine learning, provides a new data-driven way to deal with fraud. From a methodological point of view, machine learning based fraud detection can be divided into two categories, i.e., conventional methods (decision tree, boosting...) and deep learning, both of which have significant limitations in terms of the lack of representation learning ability for the former and interpretability for the latter. Furthermore, due to the rarity of detected fraud cases, the associated data is usually imbalanced, which seriously degrades the performance of classification algorithms. In this paper, we propose deep boosting decision trees (DBDT), a novel approach for fraud detection based on gradient boosting and neural networks. In order to combine the advantages of both conventional methods and deep learning, we first construct soft decision tree (SDT), a decision tree structured model with neural networks as its nodes, and then ensemble SDTs using the idea of gradient boosting. In this way we embed neural networks into gradient boosting to improve its representation learning capability and meanwhile maintain the interpretability. Furthermore, aiming at the rarity of detected fraud cases, in the model training phase we propose a compositional AUC maximization approach to deal with data imbalances at algorithm level. Extensive experiments on several real-life fraud detection datasets show that DBDT can significantly improve the performance and meanwhile maintain good interpretability. Our code is available at https://github.com/freshmanXB/DBDT.


title: Neural Node Matching for Multi-Target Cross Domain Recommendation

abstract: Multi-Target Cross Domain Recommendation(CDR) has attracted a surge of interest recently, which intends to improve the recommendation performance in multiple domains (or systems) simultaneously. Most existing multi-target CDR frameworks primarily rely on the existence of the majority of overlapped users across domains. However, general practical CDR scenarios cannot meet the strictly overlapping requirements and only share a small margin of common users across domains}. Additionally, the majority of users have quite a few historical behaviors in such small-overlapping CDR scenarios}. To tackle the aforementioned issues, we propose a simple-yet-effective neural node matching based framework for more general CDR settings, i.e., only (few) partially overlapped users exist across domains and most overlapped as well as non-overlapped users do have sparse interactions. The present framework} mainly contains two modules: (i) intra-to-inter node matching module, and (ii) intra node complementing module. Concretely, the first module conducts intra-knowledge fusion within each domain and subsequent inter-knowledge fusion across domains by fully connected user-user homogeneous graph information aggregating.


title: Three-stage Collapse of the Long Gamma-Ray Burst from GRB 160625B Prompt Multiwavelength Observations

abstract: This article presents the early results of synchronous multiwavelength observations of one of the brightest gamma-ray bursts (GRBs) GRB 160625B with the detailed continuous fast optical photometry of its optical counterpart obtained by MASTER and with hard X-ray and gamma-ray emission, obtained by the Lomonosov and Konus-Wind spacecraft. The detailed photometry led us to detect the quasi-periodical emission components in the intrinsic optical emission. As a result of our analysis of synchronous multiwavelength observations, we propose a three-stage collapse scenario for this long and bright GRB. We suggest that quasiperiodic fluctuations may be associated with forced precession of a self-gravitating rapidly rotating superdense body (spinar), whose evolution is determined by a powerful magnetic field. The spinar's mass allows it to collapse into a black hole at the end of evolution.


title: About the loss of a primordial atmosphere of super-Earths by planetesimal impacts

abstract: We consider planets composed of water ice and rock, located far from a central star. In an earlier study, computing the growth of planets by continuous accretion, we found that a large fraction of the ice evaporates upon accretion, creating a water vapor atmosphere. Here we consider accretion as a discrete series of planetesimal impacts (of order $10^8$), at the same time-dependent accretion rate, and investigate the fate of the vapor, as a result of its interaction with the accreting planetesimals. We find that a large fraction of the vapor escapes. The remaining fraction may form an outer layer of ice after the termination of accretion and cooling of the surface. The escaped water mass may significantly alter the ice-to-rock ratio of the planet. We investigate the effect of different choices of parameters such as the ice-to-rock ratio, the planetesimal size distribution, and the impact velocities. We find that the planetesimal size distribution has a negligible effect and explain why. By contrast, the ice-to-rock ratio and impact velocities affect the fraction of retained water masses considerably.


title: Loop Quantum Gravity and Quantum Information

abstract: We summarize recent developments at the interface of quantum gravity and quantum information, and discuss applications to the quantum geometry of space in loop quantum gravity. In particular, we describe the notions of link entanglement, intertwiner entanglement, and boundary spin entanglement in a spin-network state. We discuss how these notions encode the gluing of quanta of space and their relevance for the reconstruction of a quantum geometry from a network of entanglement structures. We then focus on the geometric entanglement entropy of spin-network states at fixed spins, treated as a many-body system of quantum polyhedra, and discuss the hierarchy of volume-law, area-law and zero-law states. Using information theoretic bounds on the uncertainty of geometric observables and on their correlations, we identify area-law states as the corner of the Hilbert space that encodes a semiclassical geometry, and the geometric entanglement entropy as a probe of semiclassicality.


title: Uncertainty-Aware AB3DMOT by Variational 3D Object Detection

abstract: Autonomous driving needs to rely on high-quality 3D object detection to ensure safe navigation in the world. Uncertainty estimation is an effective tool to provide statistically accurate predictions, while the associated detection uncertainty can be used to implement a more safe navigation protocol or include the user in the loop. In this paper, we propose a Variational Neural Network-based TANet 3D object detector to generate 3D object detections with uncertainty and introduce these detections to an uncertainty-aware AB3DMOT tracker. This is done by applying a linear transformation to the estimated uncertainty matrix, which is subsequently used as a measurement noise for the adopted Kalman filter. We implement two ways to estimate output uncertainty, i.e., internally, by computing the variance of the CNN outputs and then propagating the uncertainty through the post-processing, and externally, by associating the final predictions of different samples and computing the covariance of each predicted box. In experiments, we show that the external uncertainty estimation leads to better results, outperforming both internal uncertainty estimation and classical tracking approaches. Furthermore, we propose a method to initialize the Variational 3D object detector with a pretrained TANet model, which leads to the best performing models.


title: Orphan optical flare as SOSS emission afterglow, localization in time

abstract: We report on MASTER optical observations of an afterglow-like optical and X-ray transient AT2021lfa/ZTF21aayokph. We detected the initial steady brightening of the transient at 7{\sigma} confidence level. This allowed us to use smooth optical self-similar emission of GRBs model to constrain the explosion time to better than 14 min as well as to estimate its initial Lorentz factor {\Gamma}0 = 20 +/- 10. Taking into consideration the low {\Gamma}0 and non-detection in gamma-rays, we classify this transient as the first failed GRB afterglow.


title: Physics informed WNO

abstract: Deep neural operators are recognized as an effective tool for learning solution operators of complex partial differential equations (PDEs). As compared to laborious analytical and computational tools, a single neural operator can predict solutions of PDEs for varying initial or boundary conditions and different inputs. A recently proposed Wavelet Neural Operator (WNO) is one such operator that harnesses the advantage of time-frequency localization of wavelets to capture the manifolds in the spatial domain effectively. While WNO has proven to be a promising method for operator learning, the data-hungry nature of the framework is a major shortcoming. In this work, we propose a physics-informed WNO for learning the solution operators of families of parametric PDEs without labeled training data. The efficacy of the framework is validated and illustrated with four nonlinear spatiotemporal systems relevant to various fields of engineering and science.


title: Regge trajectory relation for the universal description of the heavy-heavy systems: diquarks, mesons, baryons and tetraquarks

abstract: By employing the nonlinear Regge trajectory relation $M=m_R+\beta_x(x+c_{0x})^{2/3}\,\,(x=l,\,n_r)$, we investigate the heavy-heavy systems, such as the doubly heavy diquarks, the doubly heavy mesons, the heavy-heavy baryons, and the heavy-heavy tetraquarks. The fitted Regge trajectories illustrate that these heavy-heavy systems satisfy the above formula and show the existence of a universal description of the heavy-heavy systems. The universality embodies not only the universal behavior $M{\sim}x^{2/3}$ but also the universal parameters. The values of $c_{fn_r}$ and $c_{fl}$ vary with different heavy-heavy systems, but they are close to one. There is an inequality $\beta_{n_r}>\beta_{l}$, and it holds for all the heavy-heavy systems. Moreover, the expression of $\beta_x$ [Eq. (11)] explains its variation with the change of the constituents' masses.


title: Transfer Learning for Bayesian Optimization: A Survey

abstract: A wide spectrum of design and decision problems, including parameter tuning, A/B testing and drug design, intrinsically are instances of black-box optimization. Bayesian optimization (BO) is a powerful tool that models and optimizes such expensive "black-box" functions. However, at the beginning of optimization, vanilla Bayesian optimization methods often suffer from slow convergence issue due to inaccurate modeling based on few trials. To address this issue, researchers in the BO community propose to incorporate the spirit of transfer learning to accelerate optimization process, which could borrow strength from the past tasks (source tasks) to accelerate the current optimization problem (target task). This survey paper first summarizes transfer learning methods for Bayesian optimization from four perspectives: initial points design, search space design, surrogate model, and acquisition function. Then it highlights its methodological aspects and technical details for each approach. Finally, it showcases a wide range of applications and proposes promising future directions.


title: Numerical methods and arbitrary-precision computation of the Lerch transcendent

abstract: We examine the use of the Euler-Maclaurin formula and new derived uniform asymptotic expansions for the numerical evaluation of the Lerch transcendent $\Phi(z, s, a)$ for $z, s, a \in \mathbb{C}$ to arbitrary precision. A detailed analysis of these expansions is accompanied by rigorous error bounds. A complete scheme of computation for large and small values of the parameters and argument is described along with algorithmic details to achieve high performance. The described algorithm has been extensively tested in different regimes of the parameters and compared with current state-of-the-art codes. An open-source implementation of $\Phi(z, s, a)$ based on the algorithms described in this paper is available.


title: SCLIFD:Supervised Contrastive Knowledge Distillation for Incremental Fault Diagnosis under Limited Fault Data

abstract: Intelligent fault diagnosis has made extraordinary advancements currently. Nonetheless, few works tackle class-incremental learning for fault diagnosis under limited fault data, i.e., imbalanced and long-tailed fault diagnosis, which brings about various notable challenges. Initially, it is difficult to extract discriminative features from limited fault data. Moreover, a well-trained model must be retrained from scratch to classify the samples from new classes, thus causing a high computational burden and time consumption. Furthermore, the model may suffer from catastrophic forgetting when trained incrementally. Finally, the model decision is biased toward the new classes due to the class imbalance. The problems can consequently lead to performance degradation of fault diagnosis models. Accordingly, we introduce a supervised contrastive knowledge distillation for incremental fault diagnosis under limited fault data (SCLIFD) framework to address these issues, which extends the classical incremental classifier and representation learning (iCaRL) framework from three perspectives. Primarily, we adopt supervised contrastive knowledge distillation (KD) to enhance its representation learning capability under limited fault data. Moreover, we propose a novel prioritized exemplar selection method adaptive herding (AdaHerding) to restrict the increase of the computational burden, which is also combined with KD to alleviate catastrophic forgetting. Additionally, we adopt the cosine classifier to mitigate the adverse impact of class imbalance. We conduct extensive experiments on simulated and real-world industrial processes under different imbalance ratios. Experimental results show that our SCLIFD outperforms the existing methods by a large margin.


title: Globally Solving Concave Quadratic Program via Doubly Nonnegative Relaxation

abstract: We consider the problem of maximizing a convex quadratic function over a bounded polyhedral set. We design a new framework based on SDP relaxation and cutting plane method for solving the associated reference value problem. The major novelty is a new way to generate valid cut through the doubly nonnegative (DNN) relaxation. We establish various theoretical properties of the DNN relaxation. This includes its equivalence with the Shor relaxation of the equivalent quadratically constrained problem, the strong duality and generation of valid cut from an approximate solution of the DNN relaxation returned by an arbitrary SDP solver. Computational results on both real and synthetic data demonstrate the efficiency of the proposed new method and its ability to solve high dimensional problems with dense data. In particular, our new algorithm successfully solved in 3 days the reference value problem arising from computational biology for a dataset containing more than 300,000 instances of dimension 100. In contrast, CPLEX or Gurobi is estimated to need years of computational time for the same dataset on the same computing platform.


title: On Schwarz-Pick type inequality and Lipschitz continuity for solutions to nonhomogeneous biharmonic equations

abstract: The purpose of this paper is to study the Schwarz-Pick type inequality and the Lipschitz continuity for the solutions to the nonhomogeneous biharmonic equation: $\Delta(\Delta f)=g$, where $g:$ $\overline{\ID}\rightarrow\mathbb{C}$ is a continuous function and $\overline{\ID}$ denotes the closure of the unit disk $\ID$ in the complex plane $\mathbb{C}$. In fact, we establish the following properties for these solutions: Firstly, we show that the solutions $f$ do not always satisfy the Schwarz-Pick type inequality $$\frac{1-|z|^2}{1-|f(z)|^2}\leq C, $$ where $C$ is a constant. Secondly, we establish a general Schwarz-Pick type inequality of $f$ under certain conditions. Thirdly, we discuss the Lipschitz continuity of $f$, and as applications, we get the Lipschitz continuity with respect to the distance ratio metric and the Lipschitz continuity with respect to the hyperbolic metric.


title: Stabilized In-Context Learning with Pre-trained Language Models for Few Shot Dialogue State Tracking

abstract: Prompt-based methods with large pre-trained language models (PLMs) have shown impressive unaided performance across many NLP tasks. These models improve even further with the addition of a few labeled in-context exemplars to guide output generation. However, for more complex tasks such as dialogue state tracking (DST), designing prompts that reliably convey the desired intent is nontrivial, leading to unstable results. Furthermore, building in-context exemplars for dialogue tasks is difficult because conversational contexts are long while model input lengths are relatively short. To overcome these issues we first adapt a meta-learning scheme to the dialogue domain which stabilizes the ability of the model to perform well under various prompts. We additionally design a novel training method to improve upon vanilla retrieval mechanisms to find ideal in-context examples. Finally, we introduce a saliency model to limit dialogue text length, allowing us to include more exemplars per query. In effect, we are able to achieve highly competitive results for few-shot DST on MultiWOZ.


title: Generalization Ability of Wide Neural Networks on $\mathbb{R}$

abstract: We perform a study on the generalization ability of the wide two-layer ReLU neural network on $\mathbb{R}$. We first establish some spectral properties of the neural tangent kernel (NTK): $a)$ $K_{d}$, the NTK defined on $\mathbb{R}^{d}$, is positive definite; $b)$ $\lambda_{i}(K_{1})$, the $i$-th largest eigenvalue of $K_{1}$, is proportional to $i^{-2}$. We then show that: $i)$ when the width $m\rightarrow\infty$, the neural network kernel (NNK) uniformly converges to the NTK; $ii)$ the minimax rate of regression over the RKHS associated to $K_{1}$ is $n^{-2/3}$; $iii)$ if one adopts the early stopping strategy in training a wide neural network, the resulting neural network achieves the minimax rate; $iv)$ if one trains the neural network till it overfits the data, the resulting neural network can not generalize well. Finally, we provide an explanation to reconcile our theory and the widely observed ``benign overfitting phenomenon''.


title: Quantum chaos and level dynamics

abstract: We review application of level dynamics to spectra of quantally chaotic systems. We show that statistical mechanics approach gives us predictions about level statistics intermediate between integrable and chaotic dynamics. Then we discuss in detail different statistical measures involving level dynamics such as level avoided-crossing distributions, slope and curvature of level distributions showing both the postulate of unversality and its limitations. We mention shortly the experimental confirmations of these theories. We concentrate in some detail on measures imported from quantum information approach such as the fidelity susceptibility and more generally geometric tensor matrix elements. The possible open problems are suggested.


title: A Quasi-Newton Subspace Trust Region Algorithm for nonmonotone variational inequalities in adversarial learning over box constraints

abstract: The first-order optimality condition of convexly constrained nonconvex nonconcave min-max optimization problems with box constraints formulates a nonmonotone variational inequality (VI), which is equivalent to a system of nonsmooth equations. In this paper, we propose a quasi-Newton subspace trust region (QNSTR) algorithm for the least squares problems defined by the smoothing approximation of nonsmooth equations. Based on the structure of the nonmonotone VI, we use an adaptive quasi-Newton formula to approximate the Hessian matrix and solve a low-dimensional strongly convex quadratic program with ellipse constraints in a subspace at each step of the QNSTR algorithm efficiently. We prove the global convergence of the QNSTR algorithm to an $\epsilon$-first-order stationary point of the min-max optimization problem. Moreover, we present numerical results based on the QNSTR algorithm with different subspaces for a mixed generative adversarial networks in eye image segmentation using real data to show the efficiency and effectiveness of the QNSTR algorithm for solving large-scale min-max optimization problems.


title: Generalized Few-Shot Continual Learning with Contrastive Mixture of Adapters

abstract: The goal of Few-Shot Continual Learning (FSCL) is to incrementally learn novel tasks with limited labeled samples and preserve previous capabilities simultaneously, while current FSCL methods are all for the class-incremental purpose. Moreover, the evaluation of FSCL solutions is only the cumulative performance of all encountered tasks, but there is no work on exploring the domain generalization ability. Domain generalization is a challenging yet practical task that aims to generalize beyond training domains. In this paper, we set up a Generalized FSCL (GFSCL) protocol involving both class- and domain-incremental situations together with the domain generalization assessment. Firstly, two benchmark datasets and protocols are newly arranged, and detailed baselines are provided for this unexplored configuration. We find that common continual learning methods have poor generalization ability on unseen domains and cannot better cope with the catastrophic forgetting issue in cross-incremental tasks. In this way, we further propose a rehearsal-free framework based on Vision Transformer (ViT) named Contrastive Mixture of Adapters (CMoA). Due to different optimization targets of class increment and domain increment, the CMoA contains two parts: (1) For the class-incremental issue, the Mixture of Adapters (MoA) module is incorporated into ViT, then cosine similarity regularization and the dynamic weighting are designed to make each adapter learn specific knowledge and concentrate on particular classes. (2) For the domain-related issues and domain-invariant representation learning, we alleviate the inner-class variation by prototype-calibrated contrastive learning. The codes and protocols are available at https://github.com/yawencui/CMoA.


title: The Two-Squirrel Problem and Its Relatives

abstract: In this paper, we start with a variation of the star cover problem called the Two-Squirrel problem. Given a set $P$ of $2n$ points in the plane, and two sites $c_1$ and $c_2$, compute two $n$-stars $S_1$ and $S_2$ centered at $c_1$ and $c_2$ respectively such that the maximum weight of $S_1$ and $S_2$ is minimized. This problem is strongly NP-hard by a reduction from Equal-size Set-Partition with Rationals. Then we consider two variations of the Two-Squirrel problem, namely the Two-MST and Two-TSP problem, which are both NP-hard. The NP-hardness for the latter is obvious while the former needs a non-trivial reduction from Equal-size Set-Partition with Rationals. In terms of approximation algorithms, for Two-MST and Two-TSP we give factor 3.6402 and $4+\varepsilon$ approximations respectively. Finally, we also show some interesting polynomial-time solvable cases for Two-MST.


title: Mean Field Optimization Problem Regularized by Fisher Information

abstract: Recently there is a rising interest in the research of mean field optimization, in particular because of its role in analyzing the training of neural networks. In this paper by adding the Fisher Information as the regularizer, we relate the regularized mean field optimization problem to a so-called mean field Schrodinger dynamics. We develop an energy-dissipation method to show that the marginal distributions of the mean field Schrodinger dynamics converge exponentially quickly towards the unique minimizer of the regularized optimization problem. Remarkably, the mean field Schrodinger dynamics is proved to be a gradient flow on the probability measure space with respect to the relative entropy. Finally we propose a Monte Carlo method to sample the marginal distributions of the mean field Schrodinger dynamics.


title: The Identity Problem in $\mathbb{Z} \wr \mathbb{Z}$ is decidable

abstract: We consider semigroup algorithmic problems in the wreath product $\mathbb{Z} \wr \mathbb{Z}$. Our paper focuses on two decision problems introduced by Choffrut and Karhum\"{a}ki (2005): the Identity Problem (does a semigroup contain the neutral element?) and the Group Problem (is a semigroup a group?) for finitely generated sub-semigroups of $\mathbb{Z} \wr \mathbb{Z}$. We show that both problems are decidable. Our result complements the undecidability of the Semigroup Membership Problem (does a semigroup contain a given element?) in $\mathbb{Z} \wr \mathbb{Z}$ shown by Lohrey, Steinberg and Zetzsche (ICALP 2013), and contributes an important step towards solving semigroup algorithmic problems in general metabelian groups.


title: SemanticAC: Semantics-Assisted Framework for Audio Classification

abstract: In this paper, we propose SemanticAC, a semantics-assisted framework for Audio Classification to better leverage the semantic information. Unlike conventional audio classification methods that treat class labels as discrete vectors, we employ a language model to extract abundant semantics from labels and optimize the semantic consistency between audio signals and their labels. We verify that simple textual information from labels and advanced pretraining models enable more abundant semantic supervision for better performance. Specifically, we design a text encoder to capture the semantic information from the text extension of labels. Then we map the audio signals to align with the semantics of corresponding class labels via an audio encoder and a similarity calculation module so as to enforce the semantic consistency. Extensive experiments on two audio datasets, ESC-50 and US8K demonstrate that our proposed method consistently outperforms the compared audio classification methods.


title: Rapid Development of Compositional AI

abstract: Compositional AI systems, which combine multiple artificial intelligence components together with other application components to solve a larger problem, have no known pattern of development and are often approached in a bespoke and ad hoc style. This makes development slower and harder to reuse for future applications. To support the full rapid development cycle of compositional AI applications, we have developed a novel framework called (Bee)* (written as a regular expression and pronounced as "beestar"). We illustrate how (Bee)* supports building integrated, scalable, and interactive compositional AI applications with a simplified developer experience.


title: SpReME: Sparse Regression for Multi-Environment Dynamic Systems

abstract: Learning dynamical systems is a promising avenue for scientific discoveries. However, capturing the governing dynamics in multiple environments still remains a challenge: model-based approaches rely on the fidelity of assumptions made for a single environment, whereas data-driven approaches based on neural networks are often fragile on extrapolating into the future. In this work, we develop a method of sparse regression dubbed SpReME to discover the major dynamics that underlie multiple environments. Specifically, SpReME shares a sparse structure of ordinary differential equation (ODE) across different environments in common while allowing each environment to keep the coefficients of ODE terms independently. We demonstrate that the proposed model captures the correct dynamics from multiple environments over four different dynamic systems with improved prediction performance.


title: The Minimal Flavor Structure of Quarks and Leptons

abstract: A flavor structure with minimal parameters is proposed to address the fermion mass hierarchy and flavor mixing for quarks and leptons. Yukawa interaction is reconstructed in a new basis to show a homological flat structure for up-type quarks, down-type quarks, charged leptons and Dirac neutrinos. A $SO(2)_{LR}^f$ flavor symmetry is found from the hierarchy masses of quarks and leptons, which dominated CKM mixing for quarks and PMNS for leptons. Since the minimal flavor structure successfully addresses CKM and PMNS even in the mass hierarchy limit, mass hierarchy and flavor mixing are two independent questions. As a prediction, a sum rule on the mixing angles and CP violation phase is suggested, which explains the smallness of $s_{13}$ as a natural result of the mass hierarchy. Generalizing the flat structure to quarks and leptons, a unified Yukawa interaction is achieved for all fermions with only a single coupling.


title: Probing Vibronic Coherence in Charge Migration of Molecules Using Strong Field Sequential Double Ionization

abstract: We propose a novel scheme for probing vibronic coherence in charge migration in molecules utilizing strong field sequential double ionization. To demonstrate the feasibility of this approach, we perform full simulations of a pump-probe scheme employing few-cycle intense infrared pulses for N$_2$ and O$_2$. We predict that the vibronic coherence between the pumped states will be directly imprinted in experimental observables such as kinetic energy release spectra and branching ratios of the dissociative dications. Our simulations are based on the recently developed DM-SDI model, which is capable of efficiently accounting for molecular orientations and enabling direct comparison with experimental results. Our findings strongly encourage the use of this probing scheme in future charge migration experiments.


title: Establishing Coherent Momentum-Space Electronic States in Locally Ordered Materials

abstract: In our understanding of solids, the formation of highly spatially coherent electronic states, fundamental to command the quantum behavior of materials, relies on the existence of discrete translational symmetry of the crystalline lattice. In contrast, in the absence of long-range order, as in the case of non-crystalline materials, the electronic states are localized and electronic coherence does not develop. This brings forward the fundamental question whether long range order is necessary condition to establish coherence and structured momentum-dependent electronic state, and how to characterize it in the presence of short-range order. Here we study Bi$_2$Se$_3$, a material that exists in its crystalline form with long range order, in amorphous form, with short and medium range order, and in its nanocrystalline form, with reduced short range order. By using angle resolved photoemission spectroscopy to directly access the electronic states in a momentum resolved manner, we reveal that, even in the absence of long-range order, a well-defined real-space length scale is sufficient to produce dispersive band structures. Moreover, we observe for the first time a repeated Fermi surface structure of duplicated annuli, reminiscent of Brillouin zone-like repetitions. These results, together with our simulations using amorphous Hamiltonians, reveal that the typical momentum scale where coherence occurs is the inverse average nearest-neighbor distance, the direct fingerprint of the local order of the underlying atomic structure. These results, not only lead the way to a new understanding of electronic coherence in solids, but also open the way to the realization of novel momentum-dependent quantum phenomena such as momentum pairing and spin-orbit coupling, in a much broader class of materials than the currently studied ones, lacking long range crystalline translational symmetry.


title: On the minimum modulus problem in number fields

abstract: The minimum modulus problem on covering systems was posed by Erd\H{o}s in 1950, who asked whether the minimum modulus of a covering system with distinct moduli is bounded. In 2007, Filaseta, Ford, Konyagin, Pomerance and Yu affirmed it if the reciprocal sum of the moduli of a covering system is bounded. Later in 2015, Hough resolved this problem by showing that the minimum modulus is at most $10^{16}$. In 2022, Balister, Bollob\'as, Morris, Sahasrabudhe and Tiba reduced this bound to $616,000$ by developing a versatile method called the distortion method. Recently, Klein, Koukoulopoulos and Lemieux generalized Hough's result by using this method. In this paper, we develop the distortion method by introducing the theory of probability measures associated to an inverse system. Following Klein et al.'s work, we derive an analogue of their theorem in the setting of number fields, which provides a solution to Erd\H{o}s' minimum modulus problem in number fields.


title: Sort logic and foundations of mathematics

abstract: I have argued elsewhere that second order logic provides a foundation for mathematics much in the same way as set theory does, despite the fact that the former is second order and the latter first order, but second order logic is marred by reliance on ad hoc {\em large domain assumptions}. In this paper I argue that sort logic, a powerful extension of second order logic, provides a foundation for mathematics without any ad hoc large domain assumptions. The large domain assumptions are replaced by ZFC-like axioms. Despite this resemblance to set theory sort logic retains the structuralist approach to mathematics characteristic of second order logic. As a model-theoretic logic sort logic is the strongest logic. In fact, every model class definable in set theory is the class of models of a sentence of sort logic. Because of its strength sort logic can be used to formulate particularly strong reflection principles in set theory.


title: Efficient Fog Node Placement using Nature-Inspired Metaheuristic for IoT Applications

abstract: Managing the explosion of data from the edge to the cloud requires intelligent supervision such as fog node deployments, which is an essential task to assess network operability. To ensure network operability, the deployment process must be carried out effectively in terms of two main factors: connectivity and coverage. The network connectivity is based on fog node deployment which determines the physical topology of the network while the coverage determines the network accessibility. Both have a significant impact on network performance and guarantee the network QoS. Determining an optimum fog node deployment method that minimizes cost, reduces computation and communication overhead, and provides a high degree of network connection coverage is extremely hard. Therefore, maximizing coverage as well as preserving network connectivity is a non-trivial problem. In this paper, we proposed a fog deployment algorithm that can effectively connect the fog nodes and cover all edge devices. Firstly, we formulate fog deployment as an instance of multi-objective optimization problems with a large search space. Then, we leverage Marine Predator Algorithm (MPA) to tackle the deployment problem and prove that MPA is well-suited for fog node deployment due to its rapid convergence and low computational complexity compared to other population-based algorithms. Finally, we evaluate the proposed algorithm on a different benchmark of generated instances with various fog scenario configurations. The experimental results demonstrate that our proposed algorithm is capable of providing very promising results when compared to state-of-the-art methods for determining an optimal deployment of fog nodes.


title: Machine Learning Assisted Bad Data Detection for High-throughput Substation Communication

abstract: Electrical substations are becoming more prone to cyber-attacks due to increasing digitalization. Prevailing defense measures based on cyber rules are often inadequate to detect attacks that use legitimate-looking measurements. In this work, we design and implement a bad data detection solution for electrical substations called ResiGate, that effectively combines a physics-based approach and a machine-learning-based approach to provide substantial speed-up in high-throughput substation communication scenarios, while still maintaining high detection accuracy and confidence. While many existing physics-based schemes are designed for deployment in control centers (due to their high computational requirement), ResiGate is designed as a security appliance that can be deployed on low-cost industrial computers at the edge of the smart grid so that it can detect local substation-level attacks in a timely manner. A key challenge for this is to continuously run the computationally demanding physics-based analysis to monitor the measurement data frequently transmitted in a typical substation. To provide high throughput without sacrificing accuracy, ResiGate uses machine learning to effectively filter out most of the non-suspicious (normal) data and thereby reducing the overall computational load, allowing efficient performance even with a high volume of network traffic. We implement ResiGate on a low-cost industrial computer and our experiments confirm that ResiGate can detect attacks with zero error while sustaining a high throughput.


title: Autoselection of the Ensemble of Convolutional Neural Networks with Second-Order Cone Programming

abstract: Ensemble techniques are frequently encountered in machine learning and engineering problems since the method combines different models and produces an optimal predictive solution. The ensemble concept can be adapted to deep learning models to provide robustness and reliability. Due to the growth of the models in deep learning, using ensemble pruning is highly important to deal with computational complexity. Hence, this study proposes a mathematical model which prunes the ensemble of Convolutional Neural Networks (CNN) consisting of different depths and layers that maximizes accuracy and diversity simultaneously with a sparse second order conic optimization model. The proposed model is tested on CIFAR-10, CIFAR-100 and MNIST data sets which gives promising results while reducing the complexity of models, significantly.


title: Fully Dynamic Exact Edge Connectivity in Sublinear Time

abstract: Given a simple $n$-vertex, $m$-edge graph $G$ undergoing edge insertions and deletions, we give two new fully dynamic algorithms for exactly maintaining the edge connectivity of $G$ in $\tilde{O}(n)$ worst-case update time and $\tilde{O}(m^{1-1/31})$ amortized update time, respectively. Prior to our work, all dynamic edge connectivity algorithms either assumed bounded edge connectivity, guaranteed approximate solutions, or were restricted to edge insertions only. Our results provide an affirmative answer to an open question posed by Thorup [Combinatorica'07].


title: Simulations of multivariant Si I to Si II phase transformation in polycrystalline silicon with finite-strain scale-free phase-field approach

abstract: Scale-free phase-field approach (PFA) at large strains and corresponding finite element method (FEM) simulations for multivariant martensitic phase transformation (PT) from cubic Si I to tetragonal Si II in a polycrystalline aggregate are presented. Important features of the model are large and very anisotropic transformation strain tensor $\varepsilon_{t}=\{0.1753;0.1753; -0.447\}$ and stress-tensor dependent athermal dissipative threshold for PT, which produce essential challenges for computations. 3D polycrystals with 55 and 910 stochastically oriented grains are subjected to uniaxial strain- and stress-controlled loadings under periodic boundary conditions and zero averaged lateral strains. Coupled evolution of discrete martensitic microstructure, volume fractions of martensitic variants and Si II, stress and transformation strain tensors, and texture are presented and analyzed. Macroscopic variables effectively representing multivariant transformational behavior are introduced. Macroscopic stress-strain and transformational behavior for 55 and 910 grains are close (less than 10% difference). This allows the determination of macroscopic constitutive equations by treating aggregate with a small number of grains. Large transformation strains and grain boundaries lead to huge internal stresses of tens GPa, which affect microstructure evolution and macroscopic behavior. In contrast to a single crystal, the local mechanical instabilities due to PT and negative local tangent modulus are stabilized at the macroscale by arresting/slowing the growth of Si II regions by the grain boundaries and generating the internal back stresses. This leads to increasing stress during PT. The developed methodology can be used for studying similar PTs with large transformation strains and for further development by including plastic strain and strain-induced PTs.


title: Droplet nanofluidic transport under vapor deposition: a review on seeded growth of low-dimensional nanomaterials

abstract: Thin film deposition technologies boost the development of modern semiconductor industries. Being a fancy variant, vapor phase deposition on metal nanoparticles (often in liquid phase) rather than on bare substrates opens novel avenues of fabricating low-dimensional nanomaterials, which renders the development of new device architectures and their applications in advanced electronics, optoelectronics and photonics, etc. Since the last twenty years, nanomaterials with various geometries (i.e. dots, wires, trees, tubes, flakes, ribbons, etc.) have been synthesized via different bottom-up methods (i.e. vapor-liquid-solid, vapor-solid-solid, in plane solid-liquid-solid, etc.) by different deposition techniques (CVD, PECVD, MOCVD, MBE, etc.). In contrast with liquid phase epitaxy where metal liquid severs as stationary reservoir that accommodates gaseous precursors, metal droplets have to be kicked off in-plane on/out-of-plane from the substrates so as to steer the growth of low-dimensional nanomaterials. In this review, we shall regard the growth process in a viewpoint of dynamic droplet evolution under vapor phase deposition. We shall summarize several key factors that affect the droplet spreading behaviors and their consequent nanofluidic transport, which involves deposition parameters, solid-liquid interfaces, crystal phases, substrate nanofacets and so on, which deterministically results in various morphologies and growth directions of the nanomaterials. Reversely, the aspects like doping profile and phase transition that are strongly dependent on the droplet transport will also be discussed.


title: SCL(FOL) Revisited

abstract: This paper presents an up-to-date and refined version of the SCL calculus for first-order logic without equality. The refinement mainly consists of the following two parts: First, we incorporate a stronger notion of regularity into SCL(FOL). Our regularity definition is adapted from the SCL(T) calculus. This adapted definition guarantees non-redundant clause learning during a run of SCL. However, in contrast to the original presentation, it does not require exhaustive propagation. Second, we introduce trail and model bounding to achieve termination guarantees. In previous versions, no termination guarantees about SCL were achieved. Last, we give rigorous proofs for soundness, completeness and clause learning guarantees of SCL(FOL) and put SCL(FOL) into context of existing first-order calculi.


title: Recursive Estimation of Conditional Kernel Mean Embeddings

abstract: Kernel mean embeddings, a widely used technique in machine learning, map probability distributions to elements of a reproducing kernel Hilbert space (RKHS). For supervised learning problems, where input-output pairs are observed, the conditional distribution of outputs given the inputs is a key object. The input dependent conditional distribution of an output can be encoded with an RKHS valued function, the conditional kernel mean map. In this paper we present a new recursive algorithm to estimate the conditional kernel mean map in a Hilbert space valued $L_2$ space, that is in a Bochner space. We prove the weak and strong $L_2$ consistency of our recursive estimator under mild conditions. The idea is to generalize Stone's theorem for Hilbert space valued regression in a locally compact Polish space. We present new insights about conditional kernel mean embeddings and give strong asymptotic bounds regarding the convergence of the proposed recursive method. Finally, the results are demonstrated on three application domains: for inputs coming from Euclidean spaces, Riemannian manifolds and locally compact subsets of function spaces.


title: The log-Characteristic Polynomial of Generalized Wigner Matrices is Log-Correlated

abstract: We prove that in the limit of large dimension, the distribution of the logarithm of the characteristic polynomial of a generalized Wigner matrix converges to a log-correlated field. In particular, this shows that the limiting joint fluctuations of the eigenvalues are also log-correlated. Our argument mirrors that of \cite{BouMod2019}, which is in turn based on the three-step argument of \cite{ErdPecRmSchYau2010,ErdSchYau2011Uni}, but applies to a wider class of models, and at the edge of the spectrum. We rely on (i) the results in the Gaussian cases, special cases of the results in \cite{BouModPai2021}, (ii) the local laws of \cite{ErdYauYin2012}(iii) the observable \cite{Bou2020} introduced and its analysis of the stochastic advection equation this observable satisfies, and (iv) the argument for a central limit theorem on mesoscopic scales in \cite{LanLopSos2021}. For the proof, we also establish a Wegner estimate and local law down to the microscopic scale, both at the edge of the spectrum.


title: Weakly invariant norms: geometry of spheres in the space of skew-Hermitian matrices

abstract: Let $N$ be a weakly unitarily invariant norm (i.e. invariant for the coadjoint action of the unitary group) in the space of skew-Hermitian matrices $\mathfrak{u}_n(\mathbb C)$. In this paper we study the geometry of the unit sphere of such a norm, and we show how its geometric properties are encoded by the majorization properties of the eigenvalues of the matrices. We give a detailed characterization of norming functionals of elements for a given norm, and we then prove a sharp criterion for the commutator $[X,[X,V]]$ to be in the hyperplane that supports $V$ in the unit sphere. We show that the adjoint action $V\mapsto V+[X,V]$ of $\mathfrak{u}_n(\mathbb C)$ on itself pushes vectors away from the unit sphere. As an application of the previous results, for a strictly convex norm, we prove that the norm is preserved by this last action if and only if $X$ commutes with $V$. We give a more detailed description in the case of any weakly $Ad$-invariant norm.


title: Ginzburg-Landau approximation for the Hubbard model in the external magnetic field

abstract: The Hubbard model is studied in the external magnetic field. The analysis is carried out phenomenologically within the framework of the Ginzburg-Landau theory with the order parameter describing the opposite spin electrons. The study is performed for the nearly half-filled lower Hubbard band in the metallic state. The final equations are the Pauli-like ones for the opposite spins and nonlinear as a result of interaction between electrons with the opposite spins. The equations can analytically be solved for the spatially homogeneous distributions in a number of most interesting cases. In particular, the problem on the metal-insulator transition is analyzed for the nearly half-filled Hubbard sub-bands. The critical magnetic field at which the transition from the metallic state to the insulator one takes place is found under the paramagnetic spin effect.


title: "Nice to meet you!": Expressing Emotions with Movement Gestures and Textual Content in Automatic Handwriting Robots

abstract: Text-writing robots have been used in assistive writing and drawing applications. However, robots do not convey emotional tones in the writing process due to the lack of behaviors humans typically adopt. To examine how people interpret designed robotic expressions of emotion through both movements and textual output, we used a pen-plotting robot to generate texts by performing human-like behaviors like stop-and-go, speed, and pressure variation. We examined how people convey emotion in the writing process by observing how they wrote in different emotional contexts. We then mapped these human expressions during writing to the handwriting robot and measured how well other participants understood the robot's affective expression. We found that textual output was the strongest determinant of participants' ability to perceive the robot's emotions, whereas parameters of gestural movements of the robots like speed, fluency, pressure, size, and acceleration could be useful for understanding the context of the writing expression.


title: Computing Truncated Metric Dimension of Trees

abstract: Let $G=(V,E)$ be a simple, unweighted, connected graph. Let $d(u,v)$ denote the distance between vertices $u,v$. A resolving set of $G$ is a subset $S$ of $V$ such that knowing the distance from a vertex $v$ to every vertex in $S$ uniquely identifies $v$. The metric dimension of $G$ is defined as the size of the smallest resolving set of $G$. We define the $k$-truncated resolving set and $k$-truncated metric dimension of a graph similarly, but with the notion of distance replaced with $d_k(u,v) := \min(d(u,v),k+1)$. In this paper, we demonstrate that computing $k$-truncated dimension of trees is NP-Hard for general $k$. We then present a polynomial-time algorithm to compute $k$-truncated dimension of trees when $k$ is a fixed constant.


title: Finite temperature quantum noise correlations as a probe for topological helical edge modes

abstract: The distinction between chiral, trivial helical, and topological helical edge modes can be effectively made using quantum noise measurements at finite temperatures. Quantum noise measurements consist of mainly two components. The first is thermal noise, whose provenance is thermal fluctuations, and the second is shot noise, whose origin is the quantum nature of charge particles. Studying these edge modes at finite temperatures is important as it more accurately reflects the conditions in real-world experiments. Additionally, we have verified that our results for finite temperature quantum noise correlations are valid at finite frequencies too.

categories: cond-mat.mes-hall cond-mat.mtrl-sci physics.app-ph quant-ph


title: Removing splitting/modeling error in projection/penalty methods for Navier-Stokes simulations with continuous data assimilation

abstract: We study continuous data assimilation (CDA) applied to projection and penalty methods for the Navier-Stokes (NS) equations. Penalty and projection methods are more efficient than consistent NS discretizations, however are less accurate due to modeling error (penalty) and splitting error (projection). We show analytically and numerically that with measurement data and properly chosen parameters, CDA can effectively remove these splitting and modeling errors and provide long time optimally accurate solutions.


title: Analyzing the Effectiveness of the Underlying Reasoning Tasks in Multi-hop Question Answering

abstract: To explain the predicted answers and evaluate the reasoning abilities of models, several studies have utilized underlying reasoning (UR) tasks in multi-hop question answering (QA) datasets. However, it remains an open question as to how effective UR tasks are for the QA task when training models on both tasks in an end-to-end manner. In this study, we address this question by analyzing the effectiveness of UR tasks (including both sentence-level and entity-level tasks) in three aspects: (1) QA performance, (2) reasoning shortcuts, and (3) robustness. While the previous models have not been explicitly trained on an entity-level reasoning prediction task, we build a multi-task model that performs three tasks together: sentence-level supporting facts prediction, entity-level reasoning prediction, and answer prediction. Experimental results on 2WikiMultiHopQA and HotpotQA-small datasets reveal that (1) UR tasks can improve QA performance. Using four debiased datasets that are newly created, we demonstrate that (2) UR tasks are helpful in preventing reasoning shortcuts in the multi-hop QA task. However, we find that (3) UR tasks do not contribute to improving the robustness of the model on adversarial questions, such as sub-questions and inverted questions. We encourage future studies to investigate the effectiveness of entity-level reasoning in the form of natural language questions (e.g., sub-question forms).


title: Mathematics for Machine Learning and Data Science: Optimization with Mathematica Applications

abstract: The field of optimization has gotten a lot of interest in recent years owing to significant advances in computer technology. Numerous issues in machine learning, economics, finance, geophysics, molecular modeling, computational systems biology, operations research, and all areas of engineering are now being resolved owing to the rapid growth of optimization methods and algorithms. This monograph presents the main theorems in linear algebra, convex sets, convex functions, single variable optimization, multivariable optimization, and their corresponding algorithms. We also briefly touch upon the constrained nonlinear optimization. We have found the Wolfram language to be ideal for specifying algorithms in human readable form. To minimize nonlinear objective functions, we have created 27 Mathematica functions that follow the principles of 18 algorithms. The code examples were carefully designed to demonstrate the purpose of given algorithm. The code for each algorithm will run as is with no code from prior algorithms or third parties required beyond the installation of Mathematica.


title: RESDSQL: Decoupling Schema Linking and Skeleton Parsing for Text-to-SQL

abstract: One of the recent best attempts at Text-to-SQL is the pre-trained language model. Due to the structural property of the SQL queries, the seq2seq model takes the responsibility of parsing both the schema items (i.e., tables and columns) and the skeleton (i.e., SQL keywords). Such coupled targets increase the difficulty of parsing the correct SQL queries especially when they involve many schema items and logic operators. This paper proposes a ranking-enhanced encoding and skeleton-aware decoding framework to decouple the schema linking and the skeleton parsing. Specifically, for a seq2seq encoder-decode model, its encoder is injected by the most relevant schema items instead of the whole unordered ones, which could alleviate the schema linking effort during SQL parsing, and its decoder first generates the skeleton and then the actual SQL query, which could implicitly constrain the SQL parsing. We evaluate our proposed framework on Spider and its three robustness variants: Spider-DK, Spider-Syn, and Spider-Realistic. The experimental results show that our framework delivers promising performance and robustness. Our code is available at https://github.com/RUCKBReasoning/RESDSQL.


title: Infinite Lewis Weights in Spectral Graph Theory

abstract: We study the spectral implications of re-weighting a graph by the $\ell_\infty$-Lewis weights of its edges. Our main motivation is the ER-Minimization problem (Saberi et al., SIAM'08): Given an undirected graph $G$, the goal is to find positive normalized edge-weights $w\in \mathbb{R}_+^m$ which minimize the sum of pairwise \emph{effective-resistances} of $G_w$ (Kirchhoff's index). By contrast, $\ell_\infty$-Lewis weights minimize the \emph{maximum} effective-resistance of \emph{edges}, but are much cheaper to approximate, especially for Laplacians. With this algorithmic motivation, we study the ER-approximation ratio obtained by Lewis weights. Our first main result is that $\ell_\infty$-Lewis weights provide a constant ($\approx 3.12$) approximation for ER-minimization on \emph{trees}. The proof introduces a new technique, a local polarization process for effective-resistances ($\ell_2$-congestion) on trees, which is of independent interest in electrical network analysis. For general graphs, we prove an upper bound $\alpha(G)$ on the approximation ratio obtained by Lewis weights, which is always $\leq \min\{ \text{diam}(G), \kappa(L_{w_\infty})\}$, where $\kappa$ is the condition number of the weighted Laplacian. All our approximation algorithms run in \emph{input-sparsity} time $\tilde{O}(m)$, a major improvement over Saberi et al.'s $O(m^{3.5})$ SDP for exact ER-minimization. Finally, we demonstrate the favorable effects of $\ell_\infty$-LW reweighting on the \emph{spectral-gap} of graphs and on their \emph{spectral-thinness} (Anari and Gharan, 2015). En-route to our results, we prove a weighted analogue of Mohar's classical bound on $\lambda_2(G)$, and provide a new characterization of leverage-scores of a matrix, as the gradient (w.r.t weights) of the volume of the enclosing ellipsoid.


title: Quantum vortices of strongly interacting photons

abstract: Vortices are a hallmark of topologically nontrivial dynamics in nonlinear physics and arise in a huge variety of systems, from space and atmosphere to condensed matter and quantum gases. In optics, vortices manifest as phase twists of the electromagnetic field, commonly formed by the interaction of light and matter. Formation of vortices by effective interaction of light with itself requires strong optical nonlinearity and has therefore been confined, until now, to the classical regime. Here we report on the realization of quantum vortices resulting from a strong photon-photon interaction in a quantum nonlinear optical medium. The interaction causes faster phase accumulation for co-propagating photons. Similarly to a plate pushing water, the local phase accumulation produces a quantum vortex-antivortex pair within the two-photon wavefunction. For three photons, the formation of vortex lines and a central vortex ring attests to a genuine three-photon interaction. The wavefunction topology, governed by two- and three-photon bound states, imposes a conditional phase shift of $\pi$-per-photon, a potential resource for deterministic quantum logic operations.


title: Self-supervised pseudo-colorizing of masked cells

abstract: Self-supervised learning, which is strikingly referred to as the dark matter of intelligence, is gaining more attention in biomedical applications of deep learning. In this work, we introduce a novel self-supervision objective for the analysis of cells in biomedical microscopy images. We propose training deep learning models to pseudo-colorize masked cells. We use a physics-informed pseudo-spectral colormap that is well suited for colorizing cell topology. Our experiments reveal that approximating semantic segmentation by pseudo-colorization is beneficial for subsequent fine-tuning on cell detection. Inspired by the recent success of masked image modeling, we additionally mask out cell parts and train to reconstruct these parts to further enrich the learned representations. We compare our pre-training method with self-supervised frameworks including contrastive learning (SimCLR), masked autoencoders (MAEs), and edge-based self-supervision. We build upon our previous work and train hybrid models for cell detection, which contain both convolutional and vision transformer modules. Our pre-training method can outperform SimCLR, MAE-like masked image modeling, and edge-based self-supervision when pre-training on a diverse set of six fluorescence microscopy datasets. Code is available at: https://github.com/roydenwa/pseudo-colorize-masked-cells


title: Spatiotemporal Electron-Beam Focusing through Parallel Interactions with Shaped Optical Fields

abstract: The ability to modulate free electrons with light has emerged as a powerful tool to produce attosecond electron wavepackets. However, research has so far aimed at the manipulation of the longitudinal wave function component, while the transverse degrees of freedom have primarily been utilized for spatial rather than temporal shaping. Here, we show that the coherent superposition of parallel light-electron interactions in separate spatial zones allows for a simultaneous spatial and temporal compression of a convergent electron wave function, enabling the formation of sub-{\AA}ngstr\"om focal spots of attosecond duration. The proposed approach will facilitate the exploration of previously inaccessible ultrafast atomic-scale phenomena in particular enabling attosecond scanning transmission electron microscopy.


title: Reconstruction techniques for quantum trees

abstract: The inverse problem of recovery of a potential on a quantum tree graph from Weyl's matrix given at a number of points is considered. A method for its numerical solution is proposed. The overall approach is based on the leaf peeling method combined with Neumann series of Bessel functions (NSBF) representations for solutions of Sturm-Liouville equations. In each step, the solution of the arising inverse problems reduces to dealing with the NSBF coefficients. The leaf peeling method allows one to localize the general inverse problem to local problems on sheaves, while the approach based on the NSBF representations leads to splitting the local problems into two-spectra inverse problems on separate edges and reduce them to systems of linear algebraic equations for the NSBF coefficients. Moreover, the potential on each edge is recovered from the very first NSBF coefficient. The proposed method leads to an efficient numerical algorithm that is illustrated by numerical tests.

categories: math.CA cs.NA math-ph math.MP math.NA math.SP


title: Review of Extreme Multilabel Classification

abstract: Extreme multilabel classification or XML, is an active area of interest in machine learning. Compared to traditional multilabel classification, here the number of labels is extremely large, hence, the name extreme multilabel classification. Using classical one versus all classification wont scale in this case due to large number of labels, same is true for any other classifiers. Embedding of labels as well as features into smaller label space is an essential first step. Moreover, other issues include existence of head and tail labels, where tail labels are labels which exist in relatively smaller number of given samples. The existence of tail labels creates issues during embedding. This area has invited application of wide range of approaches ranging from bit compression motivated from compressed sensing, tree based embeddings, deep learning based latent space embedding including using attention weights, linear algebra based embeddings such as SVD, clustering, hashing, to name a few. The community has come up with a useful set of metrics to identify correctly the prediction for head or tail labels.


title: On the Existence of Anomalies

abstract: The Independence Postulate (IP) is a finitary Church-Turing Thesis, saying mathematical sequences are independent from physical ones. IP implies the existence of anomalies.


title: Global in Time Weak Solutions to Singular 3D Quasi-Geostrophic Systems

abstract: Geophysicists have studied 3D Quasi-Geostrophic systems extensively. These systems describe stratified flows in the atmosphere on a large time scale and are widely used for forecasting atmospheric circulation. They couple an inviscid transport equation in $\mathbb{R}_{+}\times\Omega$ with an equation on the boundary satisfied by the trace, where $\Omega$ is either $2D$ torus or a bounded convex domain in $\mathbb{R}^2$. In this paper, we show the existence of global in time weak solutions to a family of singular 3D quasi-geostrophic systems with Ekman pumping, where the background density profile degenerates at the boundary. The proof is based on the construction of approximated models which combine the Galerkin method at the boundary and regularization processes in the bulk of the domain. The main difficulty is handling the degeneration of the background density profile at the boundary.


title: Gaugino masses from misaligned supersymmetry breaking and R-symmetry breaking spurions

abstract: In gauge mediation models with multiple spurion fields breaking SUSY and the R-symmetry separately, we show that it is possible to generate gaugino masses at one loop if the R-charge arrangement satisfies a certain condition. The resulting gaugino masses are calculated and suppressed by some power of the messenger mass scale. We present two simple examples to demonstrate this possibility, and discuss possible phenomenology implications.


title: Path-integral quantization of tensionless (super) string

abstract: In this work, we study the tensionless (super)string in the formalism of path-integral quantization. We introduce BMS $bc$ and $\beta\gamma$ ghosts intrinsically by accounting for the Faddeev-Popov determinants appeared in fixing the gauges. We then do canonical quantization and obtain the critical dimensions for different tensionless strings. We find that among four kinds of tensionless superstrings, the $\mathcal{N}=2$ homogeneous and inhomogeneous doublet tensionless superstrings have the same critical dimension as the usual superstrings. Taking the BMS $bc$ and $\beta\gamma$ ghosts as new types of BMS free field theories, we find that their enhanced underlying symmetries are generated by BMS-Kac-Moody algebras, with the Kac-Moody subalgebras being built from a three-dimensional non-abelian and non-semi-simple Lie algebra.


title: Weak Mixing Matrix Structures in the Broken Mirror Symmetry Model

abstract: A model of symmetry violation is described for a system that can spontaneously choose the left-handed or right-handed character of weak currents. For the hierarchic structure of fermion mass spectra, such a mirror symmetry system allows reproduction of all qualitative properties of weak mixing matrices for both quarks (CKM matrix) and leptons (PMNS matrix),and at that, without additional numerical fitting of model parameters. The hierarchy of CKM matrix elements is directly stipulated by the hierarchical mass spectrum of quark generations. The qualitative properties of the PMNS matrix arise for the inverse character of the neutrino spectrum (m_3 is the smallest mass) and Dirac nature of SM neutrino. The comparatively small value of the neutrino mixing angle theta_13 is a consequence of the smallness of m_3 and the smallness of the charged lepton mass ratio m_e/m_mu.


title: Number of Repetitions in Re-randomization Tests

abstract: In covariate-adaptive or response-adaptive randomization, the treatment assignment and outcome can be correlated. Under this situation, re-randomization tests are a straightforward and attractive method to provide valid statistical inference. In this paper, we investigate the number of repetitions in the re-randomization tests. This is motivated by the group sequential design in clinical trials, where the nominal significance bound can be very small at an interim analysis. Accordingly, re-randomization tests lead to a very large number of required repetitions, which may be computationally intractable. To reduce the number of repetitions, we propose an adaptive procedure and compare it with multiple approaches under pre-defined criteria. Monte Carlo simulations are conducted to show the performance of different approaches in a limited sample size. We also suggest strategies to reduce total computation time and provide practical guidance in preparing, executing and reporting before and after data are unblinded at an interim analysis, so one can complete the computation within a reasonable time frame.


title: Bayesian Methods in Tensor Analysis

abstract: Tensors, also known as multidimensional arrays, are useful data structures in machine learning and statistics. In recent years, Bayesian methods have emerged as a popular direction for analyzing tensor-valued data since they provide a convenient way to introduce sparsity into the model and conduct uncertainty quantification. In this article, we provide an overview of frequentist and Bayesian methods for solving tensor completion and regression problems, with a focus on Bayesian methods. We review common Bayesian tensor approaches including model formulation, prior assignment, posterior computation, and theoretical properties. We also discuss potential future directions in this field.


title: Variational Integrators and Graph-Based Solvers for Multibody Dynamics in Maximal Coordinates

abstract: Multibody dynamics simulators are an important tool in many fields, including learning and control for robotics. However, many existing dynamics simulators suffer from inaccuracies when dealing with constrained mechanical systems due to unsuitable integrators with bad energy behavior and problematic constraint violations, for example for contact interactions. Variational integrators are numerical discretization methods that can reduce physical inaccuracies when simulating mechanical systems, and formulating the dynamics in maximal coordinates allows for easy and numerically robust incorporation of constraints such as kinematic loops or contacts. Therefore, this article derives a variational integrator for mechanical systems with equality and inequality constraints in maximal coordinates. Additionally, efficient graph-based sparsity-exploiting algorithms for solving the integrator are provided and implemented as an open-source simulator. The evaluation of the simulator shows improved physical accuracy due to the variational integrator and the advantages of the sparse solvers. Comparisons to minimal-coordinate algorithms show improved numerical robustness and application examples of a walking robot and an exoskeleton with explicit constraints demonstrate the necessity and capabilities of maximal coordinates.


title: Requirements Rationalization and Synthesis enabled by Model Synchronization

abstract: In the international standard for system and software engineering ISO/IEC/IEEE 15288: 2015, the output of the stakeholder needs and the business or mission analysis technical processes are transformed into a technical view of the system by the system requirements definition process. In model-based systems engineering, functional needs can be modeled by use case diagrams. Intended outcomes of system requirements definition include resolution of disagreement about requirements, explicit agreement between stakeholders, and traceability. However, stakeholder needs are often elicited in a siloed manner and may be inconsistent. The lack of mathematically based systematic approaches for requirements definition poses a challenge to model-based transformation of needs into a technical view of the system that achieves agreement between stakeholders. This paper specifies and demonstrates mathematical frameworks for rationalizing and synthesizing functional needs that have been captured through an elicitation process. Benefits of this approach include but are not limited to supporting rigorous identification and resolution of disagreements and facilitating systematic analysis of change impact to achieve stakeholder agreement all with minimal intervention by the system engineers.


title: MarioGPT: Open-Ended Text2Level Generation through Large Language Models

abstract: Procedural Content Generation (PCG) is a technique to generate complex and diverse environments in an automated way. However, while generating content with PCG methods is often straightforward, generating meaningful content that reflects specific intentions and constraints remains challenging. Furthermore, many PCG algorithms lack the ability to generate content in an open-ended manner. Recently, Large Language Models (LLMs) have shown to be incredibly effective in many diverse domains. These trained LLMs can be fine-tuned, re-using information and accelerating training for new tasks. Here, we introduce MarioGPT, a fine-tuned GPT2 model trained to generate tile-based game levels, in our case Super Mario Bros levels. MarioGPT can not only generate diverse levels, but can be text-prompted for controllable level generation, addressing one of the key challenges of current PCG techniques. As far as we know, MarioGPT is the first text-to-level model and combined with novelty search it enables the generation of diverse levels with varying play-style dynamics (i.e. player paths) and the open-ended discovery of an increasingly diverse range of content. Code available at https://github.com/shyamsn97/mario-gpt.


title: Plasmonic Photochemistry as a Tool to Prepare Metallic Nanopores with Controlled Diameter

abstract: We show that plasmonic solid-state nanopores with tunable hole diameter can be prepared via a photocatalytic effect resulting from the enhanced electromagnetic field inside a metallic ring prepared on top of a dielectric nanotube. Under white light illumination, the maximum field intensity in these nanorings induces a site selective metal nucleation and growth. We used this approach to prepare bare Au and bimetallic Au-Ag nanorings and demonstrate the reduction of the initial inner diameter of the nanopore down to 4 nanometers. This process can be applied over large arrays with good reproducibility and good control on the nanopore diameter. The tunability of the nanopore diameter can be used to enable optimized detection of single entities with different size, such as single nanoparticles or biomolecules. As proof-of-concept, we demonstrate the versatility of the platform to perform single object detection of dsDNA, and Au nanoparticles with a diameter of 15 nm and 30 nm. We support our experimental findings with numerical simulations that provide insights into the electromagnetic field intensity distribution, showing that a field intensity enhancement of up to 104 can be achieved inside the nanopores. This strong field confinement inside the final nanopore can be used to perform enhanced optical measurements, and to generate local heating, thereby modifying the ionic conductance of the nanopore


title: Hyperfine-interaction limits polarization entanglement of photons from semiconductor quantum dots

abstract: Excitons in quantum dots are excellent sources of polarization-entangled photon pairs, but a quantitative understanding of their interaction with the nuclear spin bath is still missing. Here we investigate the role of hyperfine energy shifts using experimentally accessible parameters and derive an upper limit to the achievable entanglement fidelity. Our results are consistent with all available literature, indicate that spin-noise is often the dominant process limiting the entanglement in InGaAs quantum dots, and suggest routes to alleviate its effect.


title: Quantum Neuron Selection: Finding High Performing Subnetworks With Quantum Algorithms

abstract: Gradient descent methods have long been the de facto standard for training deep neural networks. Millions of training samples are fed into models with billions of parameters, which are slowly updated over hundreds of epochs. Recently, it's been shown that large, randomly initialized neural networks contain subnetworks that perform as well as fully trained models. This insight offers a promising avenue for training future neural networks by simply pruning weights from large, random models. However, this problem is combinatorically hard and classical algorithms are not efficient at finding the best subnetwork. In this paper, we explore how quantum algorithms could be formulated and applied to this neuron selection problem. We introduce several methods for local quantum neuron selection that reduce the entanglement complexity that large scale neuron selection would require, making this problem more tractable for current quantum hardware.


title: About norms, semi-norms and variation of trigonometric splines

abstract: The work examines norms in of fundamental trigonometric splines of odd and even degrees, which in some cases coincide with polynomial ones. Fundamental trigonometric splines for the case where the con-vergence factors depend on the parameter are also considered. It is shown that an important characteristic of these splines of odd and even degrees is their complete variation. The semi-norms of trigonometric splines of odd degrees are also studied. The given material is illustrated by graphs; so, in particular, an illustration of the property of the least curvature of polynomial splines is given for the first time.


title: Noisy pursuit by a self-steering active particle in confinement

abstract: The properties of a cognitive, self-propelled, and self-steering particle in the presence of a stationary target are analyzed theoretically and by simulations. In particular, the effects of confinement in competition with activity and steering are addressed. The pursuer is described as an intelligent active Ornstein-Uhlenbeck particle (iAOUP), confined in a harmonic potential. For the free pursuer, we find universal scaling regimes for the pursuer-target distance in terms of the Peclet number and maneuverability. Steering results in a novel constant mean-distance regime, which broadens with increasing maneuverability. Confinement strongly affects the propulsion direction and leads to a scaling at large Peclet numbers similar to that in absence of confinement, yet with a pronounced dependence on confinement strength.


title: The size function for imaginary cyclic sextic fields

abstract: In this paper, we investigate the size function $h^0$ for number fields. This size function is analogous to the dimension of the Riemann-Roch spaces of divisors on an algebraic curve. Van der Geer and Schoof conjectured that $h^0$ attains its maximum at the trivial class of Arakelov divisors. This conjecture was proved for all number fields with unit group of rank 0 and 1, and also for cyclic cubic fields which have unit group of rank two. We prove the conjecture also holds for totally imaginary cyclic sextic fields, another class of number fields with unit group of rank two.


title: When data driven reduced order modeling meets full waveform inversion

abstract: Waveform inversion is concerned with estimating a heterogeneous medium, modeled by variable coefficients of wave equations, using sources that emit probing signals and receivers that record the generated waves. It is an old and intensively studied inverse problem with a wide range of applications, but the existing inversion methodologies are still far from satisfactory. The typical mathematical formulation is a nonlinear least squares data fit optimization and the difficulty stems from the non-convexity of the objective function that displays numerous local minima at which local optimization approaches stagnate. This pathological behavior has at least three unavoidable causes: (1) The mapping from the unknown coefficients to the wave field is nonlinear and complicated. (2) The sources and receivers typically lie on a single side of the medium, so only backscattered waves are measured. (3) The probing signals are band limited and with high frequency content. There is a lot of activity in the computational science and engineering communities that seeks to mitigate the difficulty of estimating the medium by data fitting. In this paper we present a different point of view, based on reduced order models (ROMs) of two operators that control the wave propagation. The ROMs are called data driven because they are computed directly from the measurements, without any knowledge of the wave field inside the inaccessible medium. This computation is non-iterative and uses standard numerical linear algebra methods. The resulting ROMs capture features of the physics of wave propagation in a complementary way and have surprisingly good approximation properties that facilitate waveform inversion.


title: Van der Waals device integration beyond the limits of van der Waals forces via adhesive matrix transfer

abstract: Pristine van der Waals (vdW) interfaces between two-dimensional (2D) and other materials are core to emerging optical and electronic devices. Their direct fabrication is, however, challenged as the vdW forces are weak and cannot be tuned to accommodate integration of arbitrary layers without solvents, sacrificial-layers or high-temperatures, steps that can introduce damage. To address these limitations, we introduce a single-step 2D material-to-device integration approach in which forces promoting transfer are decoupled from the vdW forces at the interface of interest. We use this adhesive matrix transfer to demonstrate conventionally-forbidden direct integration of diverse 2D materials (MoS2, WSe2, PtS2, GaS) with dielectrics (SiO2, Al2O3), and scalable, aligned heterostructure formation, both foundational to device development. We then demonstrate a single-step integration of monolayer-MoS2 into arrays of transistors. With no exposure to polymers or solvents, clean interfaces and pristine surfaces are preserved, which can be further engineered to demonstrate both n- and p-type behavior. Beyond serving as a platform to probe the intrinsic properties of sensitive nanomaterials without the influence of processing steps, our technique allows efficient formation of unconventional device form-factors, with an example of flexible transistors demonstrated.


title: Exploiting Graph Structured Cross-Domain Representation for Multi-Domain Recommendation

abstract: Multi-domain recommender systems benefit from cross-domain representation learning and positive knowledge transfer. Both can be achieved by introducing a specific modeling of input data (i.e. disjoint history) or trying dedicated training regimes. At the same time, treating domains as separate input sources becomes a limitation as it does not capture the interplay that naturally exists between domains. In this work, we efficiently learn multi-domain representation of sequential users' interactions using graph neural networks. We use temporal intra- and inter-domain interactions as contextual information for our method called MAGRec (short for Multi-domAin Graph-based Recommender). To better capture all relations in a multi-domain setting, we learn two graph-based sequential representations simultaneously: domain-guided for recent user interest, and general for long-term interest. This approach helps to mitigate the negative knowledge transfer problem from multiple domains and improve overall representation. We perform experiments on publicly available datasets in different scenarios where MAGRec consistently outperforms state-of-the-art methods. Furthermore, we provide an ablation study and discuss further extensions of our method.


title: Digital Twin Tracking Dataset (DTTD): A New RGB+Depth 3D Dataset for Longer-Range Object Tracking Applications

abstract: Digital twin is a problem of augmenting real objects with their digital counterparts. It can underpin a wide range of applications in augmented reality (AR), autonomy, and UI/UX. A critical component in a good digital-twin system is real-time, accurate 3D object tracking. Most existing works solve 3D object tracking through the lens of robotic grasping, employ older generations of depth sensors, and measure performance metrics that may not apply to other digital-twin applications such as in AR. In this work, we create a novel RGB-D dataset, called Digital Twin Tracking Dataset (DTTD), to enable further research of the problem and extend potential solutions towards longer ranges and mm localization accuracy. To reduce point cloud noise from the input source, we select the latest Microsoft Azure Kinect as the state-of-the-art time-of-flight (ToF) camera. In total, 103 scenes of 10 common off-the-shelf objects with rich textures are recorded, with each frame annotated with a per-pixel semantic segmentation and ground-truth object poses provided by a commercial motion capturing system. Through extensive experiments with model-level and dataset-level analysis, we demonstrate that DTTD can help researchers develop future object tracking methods and analyze new challenges. The dataset, data generation, annotation, and model evaluation pipeline are made publicly available as open source code at: https://github.com/augcog/DTTDv1.