title: Time-uniform confidence bands for the CDF under nonstationarity

abstract: Estimation of the complete distribution of a random variable is a useful primitive for both manual and automated decision making. This problem has received extensive attention in the i.i.d. setting, but the arbitrary data dependent setting remains largely unaddressed. Consistent with known impossibility results, we present computationally felicitous time-uniform and value-uniform bounds on the CDF of the running averaged conditional distribution of a real-valued random variable which are always valid and sometimes trivial, along with an instance-dependent convergence guarantee. The importance-weighted extension is appropriate for estimating complete counterfactual distributions of rewards given controlled experimentation data exhaust, e.g., from an A/B test or a contextual bandit.


title: Model-Free and Learning-Free Proprioceptive Humanoid Movement Control

abstract: This paper presents a novel model-free method for humanoid-robot quasi-static movement control. Traditional model-based methods often require precise robot model parameters. Additionally, existing learning-based frameworks often train the policy in simulation environments, thereby indirectly relying on a model. In contrast, we propose a proprioceptive framework based only on sensory outputs. It does not require prior knowledge of a robot's kinematic model or inertial parameters. Our method consists of three steps: 1. Planning different pairs of center of pressure (CoP) and foot position objectives within a single cycle. 2. Searching around the current configuration by slightly moving the robot's leg joints back and forth while recording the sensor measurements of its CoP and foot positions. 3. Updating the robot motion with an optimization algorithm until all objectives are achieved. We demonstrate our approach on a NAO humanoid robot platform. Experiment results show that it can successfully generate stable robot motions.


title: Foundation Model Drives Weakly Incremental Learning for Semantic Segmentation

abstract: Modern incremental learning for semantic segmentation methods usually learn new categories based on dense annotations. Although achieve promising results, pixel-by-pixel labeling is costly and time-consuming. Weakly incremental learning for semantic segmentation (WILSS) is a novel and attractive task, which aims at learning to segment new classes from cheap and widely available image-level labels. Despite the comparable results, the image-level labels can not provide details to locate each segment, which limits the performance of WILSS. This inspires us to think how to improve and effectively utilize the supervision of new classes given image-level labels while avoiding forgetting old ones. In this work, we propose a novel and data-efficient framework for WILSS, named FMWISS. Specifically, we propose pre-training based co-segmentation to distill the knowledge of complementary foundation models for generating dense pseudo labels. We further optimize the noisy pseudo masks with a teacher-student architecture, where a plug-in teacher is optimized with a proposed dense contrastive loss. Moreover, we introduce memory-based copy-paste augmentation to improve the catastrophic forgetting problem of old classes. Extensive experiments on Pascal VOC and COCO datasets demonstrate the superior performance of our framework, e.g., FMWISS achieves 70.7% and 73.3% in the 15-5 VOC setting, outperforming the state-of-the-art method by 3.4% and 6.1%, respectively.


title: LaplacianFusion: Detailed 3D Clothed-Human Body Reconstruction

abstract: We propose LaplacianFusion, a novel approach that reconstructs detailed and controllable 3D clothed-human body shapes from an input depth or 3D point cloud sequence. The key idea of our approach is to use Laplacian coordinates, well-known differential coordinates that have been used for mesh editing, for representing the local structures contained in the input scans, instead of implicit 3D functions or vertex displacements used previously. Our approach reconstructs a controllable base mesh using SMPL, and learns a surface function that predicts Laplacian coordinates representing surface details on the base mesh. For a given pose, we first build and subdivide a base mesh, which is a deformed SMPL template, and then estimate Laplacian coordinates for the mesh vertices using the surface function. The final reconstruction for the pose is obtained by integrating the estimated Laplacian coordinates as a whole. Experimental results show that our approach based on Laplacian coordinates successfully reconstructs more visually pleasing shape details than previous methods. The approach also enables various surface detail manipulations, such as detail transfer and enhancement.


title: Compressed Decentralized Proximal Stochastic Gradient Method for Nonconvex Composite Problems with Heterogeneous Data

abstract: We first propose a decentralized proximal stochastic gradient tracking method (DProxSGT) for nonconvex stochastic composite problems, with data heterogeneously distributed on multiple workers in a decentralized connected network. To save communication cost, we then extend DProxSGT to a compressed method by compressing the communicated information. Both methods need only $\mathcal{O}(1)$ samples per worker for each proximal update, which is important to achieve good generalization performance on training deep neural networks. With a smoothness condition on the expected loss function (but not on each sample function), the proposed methods can achieve an optimal sample complexity result to produce a near-stationary point. Numerical experiments on training neural networks demonstrate the significantly better generalization performance of our methods over large-batch training methods and momentum variance-reduction methods and also, the ability of handling heterogeneous data by the gradient tracking scheme.


title: Observation of Feshbach resonances in an ${}^{167}$Er-${}^6$Li Fermi-Fermi mixture

abstract: We present our experimental investigation of the interspecies Feshbach spectrum in a mixture of ${}^{167}$Er($F = 19/2, m_F = -19/2$)-${}^6$Li($F = 1/2, m_F = 1/2$) atoms in the microkelvin temperature regime. These temperatures are achieved by means of sympathetic cooling with ${}^{174}$Yb as a third species. Interspecies Feshbach resonances are then identified by investigation of the Er-Li inelastic collisional properties for magnetic fields up to 800 G. Numerous narrow resonances as well as six resonances with widths above 1 G could be identified. It is these broader resonances that hold much promise for interesting future investigations of, for exmample, novel superfluid states and Efimov states in large mass-imbalanced, all-fermionic two-component systems.


title: Measurements of charm lifetimes at Belle II

abstract: We report on absolute lifetime measurements of charmed hadrons using the data collected by the Belle II experiment between 2019 and 2021. The measured lifetimes of $D^0$, $D^+$, and $\Lambda_c^+$ are the most precise to date and consistent with previous measurements. Our result indicates that $\Omega_c^0$ is not the shortest-living singly charmed baryon.


title: Near-ideal predictors and causal filters for discrete time signals

abstract: The paper presents linear predictors and causal filters for discrete time signals featuring some different kinds of spectrum degeneracy. These predictors and filters are based on approximation of ideal non-causal transfer functions by causal transfer functions represented by polynomials of Z-transform of the unit step signal.


title: Remote Sensing Scene Classification with Masked Image Modeling (MIM)

abstract: Remote sensing scene classification has been extensively studied for its critical roles in geological survey, oil exploration, traffic management, earthquake prediction, wildfire monitoring, and intelligence monitoring. In the past, the Machine Learning (ML) methods for performing the task mainly used the backbones pretrained in the manner of supervised learning (SL). As Masked Image Modeling (MIM), a self-supervised learning (SSL) technique, has been shown as a better way for learning visual feature representation, it presents a new opportunity for improving ML performance on the scene classification task. This research aims to explore the potential of MIM pretrained backbones on four well-known classification datasets: Merced, AID, NWPU-RESISC45, and Optimal-31. Compared to the published benchmarks, we show that the MIM pretrained Vision Transformer (ViTs) backbones outperform other alternatives (up to 18% on top 1 accuracy) and that the MIM technique can learn better feature representation than the supervised learning counterparts (up to 5% on top 1 accuracy). Moreover, we show that the general-purpose MIM-pretrained ViTs can achieve competitive performance as the specially designed yet complicated Transformer for Remote Sensing (TRS) framework. Our experiment results also provide a performance baseline for future studies.


title: Beamforming Design for RIS-Aided AF Relay Networks

abstract: Since reconfigurable intelligent surface (RIS) is considered to be a passive reflector for rate performance enhancement, a RIS-aided amplify-and-forward (AF) relay network is presented. By jointly optimizing the beamforming matrix at AF relay and the phase shifts matrices at RIS, two schemes are put forward to address a maximizing signal-to-noise ratio (SNR) problem. Firstly, aiming at achieving a high rate, a high-performance alternating optimization (AO) method based on Charnes-Cooper transformation and semidefinite programming (CCT-SDP) is proposed, where the optimization problem is decomposed to three subproblems solved by CCT-SDP and rank-one solutions can be recovered by Gaussian randomization. While the optimization variables in CCT-SDP method are matrices, which leads to extremely high complexity. In order to reduce the complexity, a low-complexity AO scheme based on Dinkelbachs transformation and successive convex approximation (DT-SCA) is put forward, where matrices variables are transformed to vector variables and three decoupled subproblems are solved by DT-SCA. Simulation results verify that compared to two benchmarks (i.e. a RIS-assisted AF relay network with random phase and a AF relay network without RIS), the proposed CCT-SDP and DT-SCA schemes can harvest better rate performance. Furthermore, it is revealed that the rate of the low-complexity DT-SCA method is close to that of CCT-SDP method.


title: A distance comparison principle for curve shortening flow with free boundary

abstract: We introduce a reflected chord-arc profile for curves with orthogonal boundary condition and obtain a chord-arc estimate for embedded free boundary curve shortening flows in a convex planar domain. As a consequence, we are able to prove that any such flow either converges in infinite time to a (unique) ``critical chord'', or contracts in finite time to a ``round half-point'' on the boundary.


title: Complex Langevin Method on Rotating Matrix Quantum Mechanics at Thermal Equilibrium

abstract: Rotating systems in thermal equilibrium are ubiquitous in our world. In the context of high energy physics, rotations would affect the phase structure of QCD. However, the standard Monte-Carlo methods in rotating systems are problematic because the chemical potentials for the angular momenta (angular velocities) cause sign problems even for bosonic variables. In this article, we demonstrate that the complex Langevin method (CLM) may overcome this issue. We apply the CLM to the Yang-Mills (YM) type one-dimensional matrix model (matrix quantum mechanics) that is a large-$N$ reduction (or dimensional reduction) of the $(D+1)$-dimensional U$(N)$ pure YM theory (bosonic BFSS model). This model shows a large-$N$ phase transition at finite temperature, which is analogous to the confinement/deconfinement transition of the original YM theory, and our CLM predicts that the transition temperature decreases as the angular momentum chemical potential increases. In order to verify our results, we compute several quantities via the minimum sensitivity method and find good quantitative agreements. Hence, the CLM properly works in this rotating system. We also argue that our results are qualitatively consistent with a holography and the recent studies of the imaginary angular velocity in QCD. As a byproduct, we develop an analytic approximation to treat the so-called ``small black hole" phase in the matrix model.

categories: hep-th cond-mat.quant-gas hep-lat hep-ph


title: A Closer Look at the Intervention Procedure of Concept Bottleneck Models

abstract: Concept bottleneck models (CBMs) are a class of interpretable neural network models that predict the target response of a given input based on its high-level concepts. Unlike the standard end-to-end models, CBMs enable domain experts to intervene on the predicted concepts and rectify any mistakes at test time, so that more accurate task predictions can be made at the end. While such intervenability provides a powerful avenue of control, many aspects of the intervention procedure remain rather unexplored. In this work, we develop various ways of selecting intervening concepts to improve the intervention effectiveness and conduct an array of in-depth analyses as to how they evolve under different circumstances. Specifically, we find that an informed intervention strategy can reduce the task error more than ten times compared to the current baseline under the same amount of intervention counts in realistic settings, and yet, this can vary quite significantly when taking into account different intervention granularity. We verify our findings through comprehensive evaluations, not only on the standard real datasets, but also on synthetic datasets that we generate based on a set of different causal graphs. We further discover some major pitfalls of the current practices which, without a proper addressing, raise concerns on reliability and fairness of the intervention procedure.


title: Augmented Transformers with Adaptive n-grams Embedding for Multilingual Scene Text Recognition

abstract: While vision transformers have been highly successful in improving the performance in image-based tasks, not much work has been reported on applying transformers to multilingual scene text recognition due to the complexities in the visual appearance of multilingual texts. To fill the gap, this paper proposes an augmented transformer architecture with n-grams embedding and cross-language rectification (TANGER). TANGER consists of a primary transformer with single patch embeddings of visual images, and a supplementary transformer with adaptive n-grams embeddings that aims to flexibly explore the potential correlations between neighbouring visual patches, which is essential for feature extraction from multilingual scene texts. Cross-language rectification is achieved with a loss function that takes into account both language identification and contextual coherence scoring. Extensive comparative studies are conducted on four widely used benchmark datasets as well as a new multilingual scene text dataset containing Indonesian, English, and Chinese collected from tourism scenes in Indonesia. Our experimental results demonstrate that TANGER is considerably better compared to the state-of-the-art, especially in handling complex multilingual scene texts.


title: Towards the efficient calculation of quantity of interest from steady Euler equations I: a dual-consistent DWR-based h-adaptive Newton-GMG solver

abstract: The dual consistency is an important issue in developing stable DWR error estimation towards the goal-oriented mesh adaptivity. In this paper, such an issue is studied in depth based on a Newton-GMG framework for the steady Euler equations. Theoretically, the numerical framework is redescribed using the Petrov-Galerkin scheme, based on which the dual consistency is depicted. A boundary modification technique is discussed for preserving the dual consistency within the Newton-GMG framework. Numerically, a geometrical multigrid is proposed for solving the dual problem, and a regularization term is designed to guarantee the convergence of the iteration. The following features of our method can be observed from numerical experiments, i). a stable numerical convergence of the quantity of interest can be obtained smoothly for problems with different configurations, and ii). towards accurate calculation of quantity of interest, mesh grids can be saved significantly using the proposed dual-consistent DWR method, compared with the dual-inconsistent one.


title: Constant-Modulus Waveform Design for Dual-Function Radar-Communication Systems in the Presence of Clutter

abstract: We investigate the constant-modulus (CM) waveform design for dual-function radar communication systems in the presence of clutter.To minimize the interference power and enhance the target acquisition performance, we use the signal-to-interference-plus-noise-ratio as the design metric.In addition, to ensure the quality of the service for each communication user, we enforce a constraint on the synthesis error of every communication signals.An iterative algorithm, which is based on cyclic optimization, Dinkinbach's transform, and alternating direction of method of multipliers, is proposed to tackle the encountered non-convex optimization problem.Simulations illustrate that the CM waveforms synthesized by the proposed algorithm allow to suppress the clutter efficiently and control the synthesis error of communication signals to a low level.


title: RGB-D Grasp Detection via Depth Guided Learning with Cross-modal Attention

abstract: Planar grasp detection is one of the most fundamental tasks to robotic manipulation, and the recent progress of consumer-grade RGB-D sensors enables delivering more comprehensive features from both the texture and shape modalities. However, depth maps are generally of a relatively lower quality with much stronger noise compared to RGB images, making it challenging to acquire grasp depth and fuse multi-modal clues. To address the two issues, this paper proposes a novel learning based approach to RGB-D grasp detection, namely Depth Guided Cross-modal Attention Network (DGCAN). To better leverage the geometry information recorded in the depth channel, a complete 6-dimensional rectangle representation is adopted with the grasp depth dedicatedly considered in addition to those defined in the common 5-dimensional one. The prediction of the extra grasp depth substantially strengthens feature learning, thereby leading to more accurate results. Moreover, to reduce the negative impact caused by the discrepancy of data quality in two modalities, a Local Cross-modal Attention (LCA) module is designed, where the depth features are refined according to cross-modal relations and concatenated to the RGB ones for more sufficient fusion. Extensive simulation and physical evaluations are conducted and the experimental results highlight the superiority of the proposed approach.


title: Neural Operators for Bypassing Gain and Control Computations in PDE Backstepping

abstract: We introduce a framework for eliminating the computation of controller gain functions in PDE control. We learn the nonlinear operator from the plant parameters to the control gains with a (deep) neural network. We provide closed-loop stability guarantees (global exponential) under an NN-approximation of the feedback gains. While, in the existing PDE backstepping, finding the gain kernel requires (one offline) solution to an integral equation, the neural operator (NO) approach we propose learns the mapping from the functional coefficients of the plant PDE to the kernel function by employing a sufficiently high number of offline numerical solutions to the kernel integral equation, for a large enough number of the PDE model's different functional coefficients. We prove the existence of a DeepONet approximation, with arbitrarily high accuracy, of the exact nonlinear continuous operator mapping PDE coefficient functions into gain functions. Once proven to exist, learning of the NO is standard, completed "once and for all" (never online) and the kernel integral equation doesn't need to be solved ever again, for any new functional coefficient not exceeding the magnitude of the functional coefficients used for training. We also present an extension from approximating the gain kernel operator to approximating the full feedback law mapping, from plant parameter functions and state measurement functions to the control input, with semiglobal practical stability guarantees. Simulation illustrations are provided and code is available on github. This framework, eliminating real-time recomputation of gains, has the potential to be game changing for adaptive control of PDEs and gain scheduling control of nonlinear PDEs. The paper requires no prior background in machine learning or neural networks.


title: Precise measurements of $D$ meson lifetimes

abstract: We report the result of $D^0$ and $D^+$ lifetime measurement using $D^0\to K^-\pi^+$ and $D^+\to K^-\pi^+\pi^+$ decays reconstructed using $72~{\rm fb^{-1}}$ of data collected by the Belle II experiment at SuperKEKB asymmetric-energy $e^{+}e^{-}$ collider. The results, $\tau(D^0)=410.5\pm1.1({\rm stat})\pm0.8({\rm syst})~{\rm fs}$ and $\tau(D^+)=1030.4\pm4.7({\rm stat})\pm 3.1({\rm syst})~{\rm fs}$, are the most precise to date and are consistent with previous measurements.


title: Adversarial Attack with Raindrops

abstract: Deep neural networks (DNNs) are known to be vulnerable to adversarial examples, which are usually designed artificially to fool DNNs, but rarely exist in real-world scenarios. In this paper, we study the adversarial examples caused by raindrops, to demonstrate that there exist plenty of natural phenomena being able to work as adversarial attackers to DNNs. Moreover, we present a new approach to generate adversarial raindrops, denoted as AdvRD, using the generative adversarial network (GAN) technique to simulate natural raindrops. The images crafted by our AdvRD look very similar to the real-world raindrop images, statistically close to the distribution of true raindrop images, and more importantly, can perform strong adversarial attack to the state-of-the-art DNN models. On the other side, we show that the adversarial training using our AdvRD images can significantly improve the robustness of DNNs to the real-world raindrop attacks. Extensive experiments are carried out to demonstrate that the images crafted by AdvRD are visually and statistically close to the natural raindrop images, can work as strong attackers to DNN models, and also help improve the robustness of DNNs to raindrop attacks.


title: Self-Supervised Category-Level Articulated Object Pose Estimation with Part-Level SE(3) Equivariance

abstract: Category-level articulated object pose estimation aims to estimate a hierarchy of articulation-aware object poses of an unseen articulated object from a known category. To reduce the heavy annotations needed for supervised learning methods, we present a novel self-supervised strategy that solves this problem without any human labels. Our key idea is to factorize canonical shapes and articulated object poses from input articulated shapes through part-level equivariant shape analysis. Specifically, we first introduce the concept of part-level SE(3) equivariance and devise a network to learn features of such property. Then, through a carefully designed fine-grained pose-shape disentanglement strategy, we expect that canonical spaces to support pose estimation could be induced automatically. Thus, we could further predict articulated object poses as per-part rigid transformations describing how parts transform from their canonical part spaces to the camera space. Extensive experiments demonstrate the effectiveness of our method on both complete and partial point clouds from synthetic and real articulated object datasets.


title: Measuring arousal and stress physiology on Esports, a League of Legends case study

abstract: Esports gaming is an area in which videogame players need to cooperate and compete with each other, influencing their cognitive load, processing, stress, and social skills. Here it is unknown to which extent competitive videogame play using a desktop setting can affect the physiological responses of players' autonomic nervous system. For such, we propose a study where we have measured distinct electrodermal and cardiac activity metrics over competitive players during several League of Legends gameplay sessions in a Esports stadium. We mainly found that game performance (whether winning or losing the game) significantly affects both electrodermal and cardiac activity, where players who lost the game showed higher stress-related physiological responses, as compared to winning players. We also found that important specific in-game events such as "Killing", "Dying" or "Destroying Turret" significantly increased both electrodermal and cardiac activity over players more than other less-relevant events such as "Placing Wards" or "Destroying Turret Plates". Finally, by analyzing activity over player roles we found different trends of activity on these measurements, this could foster the exploration on human physiology with a higher set of participants in future Esports studies.


title: Comparing Toxicity Across Social Media Platforms for COVID-19 Discourse

abstract: The emergence of toxic information on social networking sites, such as Twitter, Parler, and Reddit, has become a growing concern. Consequently, this study aims to assess the level of toxicity in COVID-19 discussions on Twitter, Parler, and Reddit. Using data analysis from January 1 through December 31, 2020, we examine the development of toxicity over time and compare the findings across the three platforms. The results indicate that Parler had lower toxicity levels than both Twitter and Reddit in discussions related to COVID-19. In contrast, Reddit showed the highest levels of toxicity, largely due to various anti-vaccine forums that spread misinformation about COVID-19 vaccines. Notably, our analysis of COVID-19 vaccination conversations on Twitter also revealed a significant presence of conspiracy theories among individuals with highly toxic attitudes. Our computational approach provides decision-makers with useful information about reducing the spread of toxicity within online communities. The study's findings highlight the importance of taking action to encourage more uplifting and productive online discourse across all platforms.


title: Well-posedness of a gauge-covariant wave equation with space-time white noise forcing

abstract: We first introduce a new model for a two-dimensional gauge-covariant wave equation with space-time white noise. In our main theorem, we obtain the probabilistic global well-posedness of this model in the Lorenz gauge. Furthermore, we prove the failure of a probabilistic null-form estimate, which exposes a potential obstruction towards the probabilistic well-posedness of a stochastic Maxwell-Klein-Gordon equation.


title: Effect of carbon doping on the structure and superconductivity in AlB$_{2}$-type (Mo$_{0.96}$Ti$_{0.04}$)$_{0.8}$B$_{2}$

abstract: We report the effect of carbon doping in Ti-stabilized nonstoichiometric molybdenum diboride (Mo$_{0.96}$Ti$_{0.04}$)$_{0.8}$B$_{2}$, which exhibits bulk superconductivity below $T_{\rm c}$ = 7.0 K. It is found that (Mo$_{0.96}$Ti$_{0.04}$)$_{0.8}$(B$_{1-x}$C$_{x}$)$_{2}$ maintains the AlB$_{2}$-type phase with a uniform elemental distribution for $x$ = 0.12 and 0.16. The substitution of carbon for boron leads to a slight increase in $a$-axis, a remarkable reduction in $c$-axis, the formation of planar defects along the (100) crystallographic planes, and a shift of the B 1$s$ peaks towards higher binding energies. Contrary to (Mo$_{0.96}$Ti$_{0.04}$)$_{0.8}$B$_{2}$, however, no superconductivity is observed down to 1.8 K for the C-doped samples, which is ascribed to the electron filling of boron $\pi$ bands resulting from the carbon doping.


title: QP Chaser: Polynomial Trajectory Generation for Autonomous Aerial Tracking

abstract: Maintaining the visibility of the targets is one of the major objectives of aerial tracking applications. This paper proposes QP Chaser, a trajectory planning pipeline that can enhance the visibility of single- and dual-target in both static and dynamic environments. As the name suggests, the proposed planner generates a target-visible trajectory via quadratic programming problems. First, the predictor forecasts the reachable sets of moving objects with a sample-and-check strategy considering obstacles. Subsequently, the trajectory planner reinforces the visibility of targets with consideration of 1) path topology and 2) reachable sets of targets and obstacles. We define a target-visible region (TVR) with topology analysis of not only static obstacles but also dynamic obstacles, and it reflects reachable sets of moving targets and obstacles to maintain the whole body of the target within the camera image robustly and ceaselessly. The online performance of the proposed planner is validated in multiple scenarios, including high-fidelity simulations and real-world experiments.


title: Gate-tuned ambipolar superconductivity with strong pairing interaction in intrinsic gapped monolayer 1T'-MoTe2

abstract: Gate tunable two-dimensional (2D) superconductors offer significant advantages when studying superconducting phase transitions. Here, we address superconductivity in exfoliated 1T'-MoTe2 monolayers with an intrinsic band gap of ~7.3 meV using electrostatic doping. Despite large differences in the dispersion of the conduction and the valence bands, superconductivity can be achieved easily for both electrons and holes. The onset of superconductivity occurs near 7-8K for both charge carrier types. This temperature is much higher than in bulk samples. Also the in-plane upper critical field is strongly enhanced and exceeds the BCS Pauli limit in both cases. Gap information is extracted using point-contact spectroscopy. The gap ratio exceeds multiple times the value expected for BCS weak-coupling. All these observations suggest a strong enhancement of the pairing interaction.


title: Self-normalized score-based tests to detect parameter heterogeneity for mixed models

abstract: Score-based tests have been used to study parameter heterogeneity across many types of statistical models. This chapter describes a new self-normalization approach for score-based tests of mixed models, which addresses situations where there is dependence between scores. This differs from the traditional score-based tests, which require independence of scores. We first review traditional score-based tests and then propose a new, self-normalized statistic that is related to previous work by Shao and Zhang (2010) and Zhang, Shao, Hayhoe, and Wuebbles (2011). We then provide simulation studies that demonstrate how traditional score-based tests can fail when scores are dependent, and that also demonstrate the good performance of the self-normalized tests. Next, we illustrate how the statistics can be used with real data. Finally, we discuss the potential broad application of self-normalized, score-based tests in mixed models and other models with dependent observations.


title: On the Role of Emergent Communication for Social Learning in Multi-Agent Reinforcement Learning

abstract: Explicit communication among humans is key to coordinating and learning. Social learning, which uses cues from experts, can greatly benefit from the usage of explicit communication to align heterogeneous policies, reduce sample complexity, and solve partially observable tasks. Emergent communication, a type of explicit communication, studies the creation of an artificial language to encode a high task-utility message directly from data. However, in most cases, emergent communication sends insufficiently compressed messages with little or null information, which also may not be understandable to a third-party listener. This paper proposes an unsupervised method based on the information bottleneck to capture both referential complexity and task-specific utility to adequately explore sparse social communication scenarios in multi-agent reinforcement learning (MARL). We show that our model is able to i) develop a natural-language-inspired lexicon of messages that is independently composed of a set of emergent concepts, which span the observations and intents with minimal bits, ii) develop communication to align the action policies of heterogeneous agents with dissimilar feature models, and iii) learn a communication policy from watching an expert's action policy, which we term `social shadowing'.


title: DECOR-NET: A COVID-19 Lung Infection Segmentation Network Improved by Emphasizing Low-level Features and Decorrelating Features

abstract: Since 2019, coronavirus Disease 2019 (COVID-19) has been widely spread and posed a serious threat to public health. Chest Computed Tomography (CT) holds great potential for screening and diagnosis of this disease. The segmentation of COVID-19 CT imaging can achieves quantitative evaluation of infections and tracks disease progression. COVID-19 infections are characterized by high heterogeneity and unclear boundaries, so capturing low-level features such as texture and intensity is critical for segmentation. However, segmentation networks that emphasize low-level features are still lacking. In this work, we propose a DECOR-Net capable of capturing more decorrelated low-level features. The channel re-weighting strategy is applied to obtain plenty of low-level features and the dependencies between channels are reduced by proposed decorrelation loss. Experiments show that DECOR-Net outperforms other cutting-edge methods and surpasses the baseline by 5.1% and 4.9% in terms of Dice coefficient and intersection over union. Moreover, the proposed decorrelation loss can improve the performance constantly under different settings. The Code is available at https://github.com/jiesihu/DECOR-Net.git.


title: Multi-Layer Attention-Based Explainability via Transformers for Tabular Data

abstract: We propose a graph-oriented attention-based explainability method for tabular data. Tasks involving tabular data have been solved mostly using traditional tree-based machine learning models which have the challenges of feature selection and engineering. With that in mind, we consider a transformer architecture for tabular data, which is amenable to explainability, and present a novel way to leverage self-attention mechanism to provide explanations by taking into account the attention matrices of all heads and layers as a whole. The matrices are mapped to a graph structure where groups of features correspond to nodes and attention values to arcs. By finding the maximum probability paths in the graph, we identify groups of features providing larger contributions to explain the model's predictions. To assess the quality of multi-layer attention-based explanations, we compare them with popular attention-, gradient-, and perturbation-based explanability methods.


title: Critical behavior of Ising model by preparing thermal state on quantum computer

abstract: We simulate the critical behavior of the Ising model utilizing a thermal state prepared using quantum computing techniques. The preparation of the thermal state is based on the variational quantum imaginary time evolution (QITE) algorithm. The initial state of QITE is prepared as a classical product state, and we propose a systematic method to design the variational ansatz for QITE. We calculate the specific heat and susceptibility of the long-range interacting Ising model and observe indications of the Ising criticality on a small lattice size. We find the results derived by the quantum algorithm are well consistent with the ones from exact diagonalization, both in the neighbourhood of the critical temperature and the low-temperature region.


title: On the error-sum function of Pierce expansions

abstract: We introduce the error-sum function of Pierce expansions. Some basic properties of the error-sum function are analyzed. We also examine the fractal property of the graph of it by calculating the Hausdorff dimension, the box-counting dimension, and the covering dimension of the graph.


title: Periodic and open classical spin Calogero-Moser chains

abstract: We construct a class of interacting spin Calogero-Moser type systems. They can be regarded as a many particle system with spin degrees of freedom and as an integrable spin chain of Gaudin type. We prove that these Hamiltonian systems are superintegrable.


title: Dynamic locational marginal emissions via implicit differentiation

abstract: Locational marginal emissions rates (LMEs) estimate the rate of change in emissions due to a small change in demand in a transmission network, and are an important metric for assessing the impact of various energy policies or interventions. In this work, we develop a new method for computing the LMEs of an electricity system via implicit differentiation. The method is model agnostic; it can compute LMEs for any convex optimization-based dispatch model, including some of the complex dispatch models employed by system operators in real electricity systems. In particular, this method lets us derive LMEs for dynamic dispatch models, i.e., models with temporal constraints such as ramping and storage. Using real data from the U.S. electricity system, we validate the proposed method against a state-of-the-art merit-order-based method and show that incorporating dynamic constraints improves model accuracy by 8.2%. Finally, we use simulations on a realistic 240-bus model of WECC to demonstrate the flexibility of the tool and the importance of incorporating dynamic constraints. Namely, static LMEs and dynamic LMEs exhibit a normalized average RMS deviation of 28.40%, implying dynamic constraints are essential to accurately modeling emissions rates.


title: Limits to the strain engineering of layered square-planar nickelate thin films

abstract: The layered square-planar nickelates, Nd$_{n+1}$Ni$_{n}$O$_{2n+2}$, are an appealing system to tune the electronic properties of square-planar nickelates via dimensionality; indeed, superconductivity was recently observed in Nd$_{6}$Ni$_{5}$O$_{12}$ thin films. Here, we investigate the role of epitaxial strain in the competing requirements for the synthesis of the $n=3$ Ruddlesden-Popper compound, Nd$_{4}$Ni$_{3}$O$_{10}$, and subsequent reduction to the square-planar phase, Nd$_{4}$Ni$_{3}$O$_{8}$. We synthesize our highest quality Nd$_{4}$Ni$_{3}$O$_{10}$ films under compressive strain on LaAlO$_{3}$ (001), while Nd$_{4}$Ni$_{3}$O$_{10}$ on NdGaO$_{3}$ (110) exhibits tensile strain-induced rock salt faults but retains bulk-like transport properties. A high density of extended defects forms in Nd$_{4}$Ni$_{3}$O$_{10}$ on SrTiO$_{3}$ (001). Films reduced on LaAlO$_{3}$ become insulating and form compressive strain-induced $c$-axis canting defects, while Nd$_{4}$Ni$_{3}$O$_{8}$ films on NdGaO$_{3}$ are metallic. This work provides a pathway to the synthesis of Nd$_{n+1}$Ni$_{n}$O$_{2n+2}$ thin films and sets limits on the ability to strain engineer these compounds via epitaxy.


title: Rethink Long-tailed Recognition with Vision Transformers

abstract: In the real world, data tends to follow long-tailed distributions w.r.t. class or attribution, motivating the challenging Long-Tailed Recognition (LTR) problem. In this paper, we revisit recent LTR methods with promising Vision Transformers (ViT). We figure out that 1) ViT is hard to train with long-tailed data. 2) ViT learns generalized features in an unsupervised manner, like mask generative training, either on long-tailed or balanced datasets. Hence, we propose to adopt unsupervised learning to utilize long-tailed data. Furthermore, we propose the Predictive Distribution Calibration (PDC) as a novel metric for LTR, where the model tends to simply classify inputs into common classes. Our PDC can measure the model calibration of predictive preferences quantitatively. On this basis, we find many LTR approaches alleviate it slightly, despite the accuracy improvement. Extensive experiments on benchmark datasets validate that PDC reflects the model's predictive preference precisely, which is consistent with the visualization.


title: Model for the propagation of fermions in a Bose-Einstein condensate

abstract: We consider the dispersion relations of fermions that propagate in the background of a scalar Bose-Einstein condensate. Some illustrative examples are discussed using simple Yukawa-type coupling models between the fermions and the scalar fields. The dispersion relations are determined explicitly in those cases, to the lowest order. The method also allows to determine the corrections to the dispersion relations due to the interactions with the excitations of the Bose-Einstein condensate. Possible applications of the results to the case of neutrinos are indicated.


title: HugNLP: A Unified and Comprehensive Library for Natural Language Processing

abstract: In this paper, we introduce HugNLP, a unified and comprehensive library for natural language processing (NLP) with the prevalent backend of HuggingFace Transformers, which is designed for NLP researchers to easily utilize off-the-shelf algorithms and develop novel methods with user-defined models and tasks in real-world scenarios. HugNLP consists of a hierarchical structure including models, processors and applications that unifies the learning process of pre-trained language models (PLMs) on different NLP tasks. Additionally, we present some featured NLP applications to show the effectiveness of HugNLP, such as knowledge-enhanced PLMs, universal information extraction, low-resource mining, and code understanding and generation, etc. The source code will be released on GitHub (https://github.com/wjn1996/HugNLP).


title: WISK: A Workload-aware Learned Index for Spatial Keyword Queries

abstract: Spatial objects often come with textual information, such as Points of Interest (POIs) with their descriptions, which are referred to as geo-textual data. To retrieve such data, spatial keyword queries that take into account both spatial proximity and textual relevance have been extensively studied. Existing indexes designed for spatial keyword queries are mostly built based on the geo-textual data without considering the distribution of queries already received. However, previous studies have shown that utilizing the known query distribution can improve the index structure for future query processing. In this paper, we propose WISK, a learned index for spatial keyword queries, which self-adapts for optimizing querying costs given a query workload. One key challenge is how to utilize both structured spatial attributes and unstructured textual information during learning the index. We first divide the data objects into partitions, aiming to minimize the processing costs of the given query workload. We prove the NP-hardness of the partitioning problem and propose a machine learning model to find the optimal partitions. Then, to achieve more pruning power, we build a hierarchical structure based on the generated partitions in a bottom-up manner with a reinforcement learning-based approach. We conduct extensive experiments on real-world datasets and query workloads with various distributions, and the results show that WISK outperforms all competitors, achieving up to 8x speedup in querying time with comparable storage overhead.


title: Numerical Investigation of a Rotating Double Compression Ramp Intake

abstract: The intakes of air-breathing high-speed flying vehicles produce a large share of the thrust propulsion. Furthermore, the propulsion performance of these engines increases when the single-ramp intake is replaced with a multiple-ramps intake. Many scholars numerically and experimentally studied the high-speed engine performance over static single and multiple compression ramps. However, the transient behavior of the flow during the rotation of the double compression ramp from a single ramp is not fully investigated. The present paper aims to numerically investigate the transient shock reflection phenomenon over a rotating double wedge. The problem will start with a 3-Mach number inviscid flow over a single wedge. Then, a portion of the wedge will be rotated upstream at a quite low trailing Mach number to avoid the significant lag effect in the shock waves system. This idea could be applied in the supersonic intake or extensionally in the hypersonic intake of scramjets with a somehow complex mechanism. Further, the length of the rotating portion of the wedge will be changed three times to study its effect on the shock system. The results show a high gain in the pressure due to the rotation of the wedge. Moreover, the wave angles were larger at the low chord ratio value of $w_2/w_i= 0.25$ than at the high values of $w_2/w_i$ at the same second wedge rotating angle, $\theta_2$, resulting in a higher pressure distribution.


title: DrMaMP: Distributed Real-time Multi-agent Mission Planning in Cluttered Environment

abstract: Solving a collision-aware multi-agent mission planning (task allocation and path finding) problem is challenging due to the requirement of real-time computational performance, scalability, and capability of handling static/dynamic obstacles and tasks in a cluttered environment. This paper proposes a distributed real-time (on the order of millisecond) algorithm DrMaMP, which partitions the entire unassigned task set into subsets via approximation and decomposes the original problem into several single-agent mission planning problems. This paper presents experiments with dynamic obstacles and tasks and conducts optimality and scalability comparisons with an existing method, where DrMaMP outperforms the existing method in both indices. Finally, this paper analyzes the computational burden of DrMaMP which is consistent with the observations from comparisons, and presents the optimality gap in small-size problems.


title: Learning to Retain while Acquiring: Combating Distribution-Shift in Adversarial Data-Free Knowledge Distillation

abstract: Data-free Knowledge Distillation (DFKD) has gained popularity recently, with the fundamental idea of carrying out knowledge transfer from a Teacher neural network to a Student neural network in the absence of training data. However, in the Adversarial DFKD framework, the student network's accuracy, suffers due to the non-stationary distribution of the pseudo-samples under multiple generator updates. To this end, at every generator update, we aim to maintain the student's performance on previously encountered examples while acquiring knowledge from samples of the current distribution. Thus, we propose a meta-learning inspired framework by treating the task of Knowledge-Acquisition (learning from newly generated samples) and Knowledge-Retention (retaining knowledge on previously met samples) as meta-train and meta-test, respectively. Hence, we dub our method as Learning to Retain while Acquiring. Moreover, we identify an implicit aligning factor between the Knowledge-Retention and Knowledge-Acquisition tasks indicating that the proposed student update strategy enforces a common gradient direction for both tasks, alleviating interference between the two objectives. Finally, we support our hypothesis by exhibiting extensive evaluation and comparison of our method with prior arts on multiple datasets.


title: Battery Valuation and Management for Battery Swapping Station with an Intertemporal Framework

abstract: Battery swapping as a business model for battery energy storage (BES) has great potential in future integrated low-carbon energy and transportation systems. However, frequent battery swapping will inevitably accelerate battery degradation and shorten the battery life accordingly. To model the tradeoff of BES use between energy and transportation applications coupled by battery swapping, we develop a life-cycle decision model that coordinates battery charging and swapping. This model is derived based on an improved intertemporal decision framework, in which the optimal marginal degradation cost (MDC) of BES is determined to maximize the BES benefit across time and application. The proposed framework and model are applied to manage a battery swapping station that simultaneously provides battery swapping services to electric vehicle customers and provides flexibility service to the power grid, including energy arbitrage and reserve. The case study shows that while the end of the physical life of BES occurs faster with battery swapping, the economic life becomes considerably longer. The results also reveal that the optimal MDC depends on the battery values in each application, and we analyze how the battery swapping price affects the optimal MDC and battery life. The proposed framework and model can also provide decision support for on-demand BES service, such as battery trading, renting and secondary use.


title: One-loop corrections to the celestial chiral algebra from Koszul Duality

abstract: We consider self-dual Yang-Mills theory (SDYM) in four dimensions and its lift to holomorphic BF theory on twistor space. Following the work of Costello and Paquette, we couple SDYM to a quartic axion field, which guarantees associativity of the (extended) celestial chiral algebra at the quantum level. We demonstrate how to reproduce their one-loop quantum deformation to the chiral algebra using Koszul duality.


title: Large-Scale Evaluation of Method-Level Bug Localization with FinerBench4BL

abstract: Bug localization is an important aspect of software maintenance because it can locate modules that need to be changed to fix a specific bug. Although method-level bug localization is helpful for developers, there are only a few tools and techniques for this task; moreover, there is no large-scale framework for their evaluation. In this paper, we present FinerBench4BL, an evaluation framework for method-level information retrieval-based bug localization techniques, and a comparative study using this framework. This framework was semi-automatically constructed from Bench4BL, a file-level bug localization evaluation framework, using a repository transformation approach. We converted the original file-level version repositories provided by Bench4BL into method-level repositories by repository transformation. Method-level data components such as oracle methods can also be automatically derived by applying the oracle generation approach via bug-commit linking in Bench4BL to the generated method repositories. Furthermore, we tailored existing file-level bug localization technique implementations at the method level. We created a framework for method-level evaluation by merging the generated dataset and implementations. The comparison results show that the method-level techniques decreased accuracy whereas improved debugging efficiency compared to file-level techniques.


title: Flocking to Mastodon: Tracking the Great Twitter Migration

abstract: The acquisition of Twitter by Elon Musk has spurred controversy and uncertainty among Twitter users. The move raised as many praises as concerns, particularly regarding Musk's views on free speech. As a result, a large number of Twitter users have looked for alternatives to Twitter. Mastodon, a decentralized micro-blogging social network, has attracted the attention of many users and the general media. In this paper, we track and analyze the migration of 136,009 users from Twitter to Mastodon. Our analysis sheds light on the user-driven pressure towards centralization in a decentralized ecosystem and identifies the strong influence of the social network in platform migration. We also characterize the activity of migrated users on both Twitter and Mastodon.


title: On curvature-squared invariants of minimal five-dimensional supergravity from superspace

abstract: We elaborate on the off-shell superspace construction of curvature-squared invariants in minimal five-dimensional supergravity. This is described by the standard Weyl multiplet of conformal supergravity coupled to two compensators being a vector multiplet and a linear multiplet. In this set-up, we review the definition of the off-shell two-derivative gauged supergravity together with the three independent four-derivative superspace invariants defined in arXiv:1410.8682. We provide the explicit expression for the linear multiplet based on a prepotential given by the logarithm of the vector multiplet primary superfield. We then present for the first time the primary equations of motion for minimal gauged off-shell supergravity deformed by an arbitrary combination of these three four-derivative locally superconformal invariants. We also identify a four-derivative invariant based on the linear multiplet compensator and the kinetic superfield of a vector multiplet which can be used to engineer an alternative supersymmetric completion of the scalar curvature squared.


title: Discrete-time Optimal Covariance Steering via Semidefinite Programming

abstract: This paper addresses the optimal covariance steering problem for stochastic discrete-time linear systems subject to probabilistic state and control constraints. A method is presented for efficiently attaining the exact solution of the problem based on a lossless convex relaxation of the original non-linear program using semidefinite programming. Both the constrained and the unconstrained versions of the problem with either equality or inequality terminal covariance boundary conditions are addressed. We first prove that the proposed relaxation is lossless for all of the above cases. A numerical example is then provided to illustrate the method. Finally, a comparative study is performed in systems of various sizes and steering horizons to illustrate the advantages of the proposed method in terms of computational resources compared to the state of the art.


title: On-the-Fly Communication-and-Computing for Distributed Tensor Decomposition Over MIMO Channels

abstract: Distributed tensor decomposition (DTD) is a fundamental data-analytics technique that extracts latent important properties from high-dimensional multi-attribute datasets distributed over edge devices. Conventionally its wireless implementation follows a one-shot approach that first computes local results at devices using local data and then aggregates them to a server with communication-efficient techniques such as over-the-air computation (AirComp) for global computation. Such implementation is confronted with the issues of limited storage-and-computation capacities and link interruption, which motivates us to propose a framework of on-the-fly communication-and-computing (FlyCom$^2$) in this work. The proposed framework enables streaming computation with low complexity by leveraging a random sketching technique and achieves progressive global aggregation through the integration of progressive uploading and multiple-input-multiple-output (MIMO) AirComp. To develop FlyCom$^2$, an on-the-fly sub-space estimator is designed to take real-time sketches accumulated at the server to generate online estimates for the decomposition. Its performance is evaluated by deriving both deterministic and probabilistic error bounds using the perturbation theory and concentration of measure. Both results reveal that the decomposition error is inversely proportional to the population of sketching observations received by the server. To further rein in the noise effect on the error, we propose a threshold-based scheme to select a subset of sufficiently reliable received sketches for DTD at the server. Experimental results validate the performance gain of the proposed selection algorithm and show that compared to its one-shot counterparts, the proposed FlyCom$^2$ achieves comparable (even better in the case of large eigen-gaps) decomposition accuracy besides dramatically reducing devices' complexity costs.


title: LIWO: Lidar-Inertial-Wheel Odometry

abstract: LiDAR-inertial odometry (LIO), which fuses complementary information of a LiDAR and an Inertial Measurement Unit (IMU), is an attractive solution for state estimation. In LIO, both pose and velocity are regarded as state variables that need to be solved. However, the widely-used Iterative Closest Point (ICP) algorithm can only provide constraint for pose, while the velocity can only be constrained by IMU pre-integration. As a result, the velocity estimates inclined to be updated accordingly with the pose results. In this paper, we propose LIWO, an accurate and robust LiDAR-inertialwheel (LIW) odometry, which fuses the measurements from LiDAR, IMU and wheel encoder in a bundle adjustment (BA) based optimization framework. The involvement of a wheel encoder could provide velocity measurement as an important observation, which assists LIO to provide a more accurate state prediction. In addition, constraining the velocity variable by the observation from wheel encoder in optimization can further improve the accuracy of state estimation. Experiment results on two public datasets demonstrate that our system outperforms all state-of-the-art LIO systems in terms of smaller absolute trajectory error (ATE), and embedding a wheel encoder can greatly improve the performance of LIO based on the BA framework.


title: Gradient-Boosted Based Structured and Unstructured Learning

abstract: We propose two frameworks to deal with problem settings in which both structured and unstructured data are available. Structured data problems are best solved by traditional machine learning models such as boosting and tree-based algorithms, whereas deep learning has been widely applied to problems dealing with images, text, audio, and other unstructured data sources. However, for the setting in which both structured and unstructured data are accessible, it is not obvious what the best modeling approach is to enhance performance on both data sources simultaneously. Our proposed frameworks allow joint learning on both kinds of data by integrating the paradigms of boosting models and deep neural networks. The first framework, the boosted-feature-vector deep learning network, learns features from the structured data using gradient boosting and combines them with embeddings from unstructured data via a two-branch deep neural network. Secondly, the two-weak-learner boosting framework extends the boosting paradigm to the setting with two input data sources. We present and compare first- and second-order methods of this framework. Our experimental results on both public and real-world datasets show performance gains achieved by the frameworks over selected baselines by magnitudes of 0.1% - 4.7%.


title: On the consistency of $\Lambda$CDM with CMB measurements in light of the latest Planck, ACT, and SPT data

abstract: Using Gaussian Processes we perform a thorough, non-parametric consistency test of the $\Lambda$CDM model when confronted with state-of-the-art TT, TE, and EE measurements of the anisotropies in the Cosmic Microwave Background by the Planck, ACT, and SPT collaborations. Using $\Lambda$CDM's best-fit predictions to the TTTEEE data from Planck, we find no statistically significant deviations when looking for signatures in the residuals across the different datasets. The results of SPT are in good agreement with the $\Lambda$CDM best-fit predictions to the Planck data, while the results of ACT are only marginally consistent. However, when using the best-fit predictions to CamSpec -- a recent reanalysis of the Planck data -- as the mean function, we find larger discrepancies between the datasets. Our analysis also reveals an interesting feature in the polarisation (EE) measurements from the CamSpec analysis, which could be explained by a slight underestimation of the covariance matrix. Interestingly, the disagreement between CamSpec and Planck/ACT is mainly visible in the residuals of the TT spectrum, the latter favoring a scale-invariant tilt $n_s\simeq1$, which is consistent with previous findings from parametric analyses. We also report some features in the EE measurements captured both by ACT and SPT which are independent of the chosen mean function and could be hinting towards a common physical origin. For completeness, we repeat our analysis using the best-fit spectra to ACT+WMAP as the mean function. Finally, we test the internal consistency of the Planck data alone by studying the high and low-$\ell$ ranges separately, finding no discrepancy between small and large angular scales.


title: A Comprehensive Study on Robustness of Image Classification Models: Benchmarking and Rethinking

abstract: The robustness of deep neural networks is usually lacking under adversarial examples, common corruptions, and distribution shifts, which becomes an important research problem in the development of deep learning. Although new deep learning methods and robustness improvement techniques have been constantly proposed, the robustness evaluations of existing methods are often inadequate due to their rapid development, diverse noise patterns, and simple evaluation metrics. Without thorough robustness evaluations, it is hard to understand the advances in the field and identify the effective methods. In this paper, we establish a comprehensive robustness benchmark called \textbf{ARES-Bench} on the image classification task. In our benchmark, we evaluate the robustness of 55 typical deep learning models on ImageNet with diverse architectures (e.g., CNNs, Transformers) and learning algorithms (e.g., normal supervised training, pre-training, adversarial training) under numerous adversarial attacks and out-of-distribution (OOD) datasets. Using robustness curves as the major evaluation criteria, we conduct large-scale experiments and draw several important findings, including: 1) there is an inherent trade-off between adversarial and natural robustness for the same model architecture; 2) adversarial training effectively improves adversarial robustness, especially when performed on Transformer architectures; 3) pre-training significantly improves natural robustness based on more training data or self-supervised learning. Based on ARES-Bench, we further analyze the training tricks in large-scale adversarial training on ImageNet. By designing the training settings accordingly, we achieve the new state-of-the-art adversarial robustness. We have made the benchmarking results and code platform publicly available.


title: Improving Model Generalization by On-manifold Adversarial Augmentation in the Frequency Domain

abstract: Deep neural networks (DNNs) may suffer from significantly degenerated performance when the training and test data are of different underlying distributions. Despite the importance of model generalization to out-of-distribution (OOD) data, the accuracy of state-of-the-art (SOTA) models on OOD data can plummet. Recent work has demonstrated that regular or off-manifold adversarial examples, as a special case of data augmentation, can be used to improve OOD generalization. Inspired by this, we theoretically prove that on-manifold adversarial examples can better benefit OOD generalization. Nevertheless, it is nontrivial to generate on-manifold adversarial examples because the real manifold is generally complex. To address this issue, we proposed a novel method of Augmenting data with Adversarial examples via a Wavelet module (AdvWavAug), an on-manifold adversarial data augmentation technique that is simple to implement. In particular, we project a benign image into a wavelet domain. With the assistance of the sparsity characteristic of wavelet transformation, we can modify an image on the estimated data manifold. We conduct adversarial augmentation based on AdvProp training framework. Extensive experiments on different models and different datasets, including ImageNet and its distorted versions, demonstrate that our method can improve model generalization, especially on OOD data. By integrating AdvWavAug into the training process, we have achieved SOTA results on some recent transformer-based models.


title: Complex-valued Holographic Pseudo Entropy via Real-time AdS/CFT Correspondence

abstract: The pseudo entropy is a promising recent generalization of the entanglement entropy to the situations in which both the initial and final state are involved, with the density matrix promoted to the transition matrix. However, in contrast to the non-Hermiticity of the generic transition matrix, the holographic pseudo entropy formulated via the Euclidean AdS/CFT turns out to be always real-valued, which potentially conceals the crucial natures of this novel quantity. In this note, we make the first attempt to formulate a real-time prescription for computations to incorporate naturally the pseudo entropy, as a generally complex-valued entanglement measure, into the AdS/CFT context. It is then conjectured that the holographic pseudo entropy is dual to the extremal codimension-2 area surface in the generally time-dependent Lorentzian asymptotically AdS spacetime, but may also receive imaginary contribution from the regularized extrinsic curvature term of the area surface, which is not included in the covariant holographic entanglement entropy. In this real-time prescription, the holographic pseudo entropy can be considered as a generalization of the covariant holographic entanglement entropy, as well.


title: On discrete boundary value problems with nonlocal conditions in a quarter-plane

abstract: We consider discrete analogue of model pseudo-differential equations in discrete plane sector using discrete variant of Sobolev--Slobodetskii spaces. Starting from the concept of wave factorization for elliptic periodic symbol we describe solvability conditions for the equations and corresponding discrete boundary value problems. We give also a comparison between discrete and continuous solutions in appropriate discrete normed spaces.


title: Ultra-high vacuum pressure measurement using cold atoms

abstract: In this work, we have measured the background pressure in an ultra-high vacuum (UHV) chamber by measuring the collisional loss rates in a Rb atom magneto-optical trap (MOT) on an atom chip. The loss rate due to non-Rb gases in the background has been estimated by measuring the MOT loss rate in low Rb pressure regime. These results can be useful for development of cold-atoms based UHV pressure standards.


title: CLR-GAM: Contrastive Point Cloud Learning with Guided Augmentation and Feature Mapping

abstract: Point cloud data plays an essential role in robotics and self-driving applications. Yet, annotating point cloud data is time-consuming and nontrivial while they enable learning discriminative 3D representations that empower downstream tasks, such as classification and segmentation. Recently, contrastive learning-based frameworks have shown promising results for learning 3D representations in a self-supervised manner. However, existing contrastive learning methods cannot precisely encode and associate structural features and search the higher dimensional augmentation space efficiently. In this paper, we present CLR-GAM, a novel contrastive learning-based framework with Guided Augmentation (GA) for efficient dynamic exploration strategy and Guided Feature Mapping (GFM) for similar structural feature association between augmented point clouds. We empirically demonstrate that the proposed approach achieves state-of-the-art performance on both simulated and real-world 3D point cloud datasets for three different downstream tasks, i.e., 3D point cloud classification, few-shot learning, and object part segmentation.


title: GradMA: A Gradient-Memory-based Accelerated Federated Learning with Alleviated Catastrophic Forgetting

abstract: Federated Learning (FL) has emerged as a de facto machine learning area and received rapid increasing research interests from the community. However, catastrophic forgetting caused by data heterogeneity and partial participation poses distinctive challenges for FL, which are detrimental to the performance. To tackle the problems, we propose a new FL approach (namely GradMA), which takes inspiration from continual learning to simultaneously correct the server-side and worker-side update directions as well as take full advantage of server's rich computing and memory resources. Furthermore, we elaborate a memory reduction strategy to enable GradMA to accommodate FL with a large scale of workers. We then analyze convergence of GradMA theoretically under the smooth non-convex setting and show that its convergence rate achieves a linear speed up w.r.t the increasing number of sampled active workers. At last, our extensive experiments on various image classification tasks show that GradMA achieves significant performance gains in accuracy and communication efficiency compared to SOTA baselines.


title: Effects of $N(2080){3/2}^-$ and $N(2270)3/2^-$ molecules on $K^\ast \Sigma$ photoproduction

abstract: In the present work, we re-analyze the available data for $\gamma p\to K^{\ast +}\Sigma^0$ and $\gamma p \to K^{\ast 0}\Sigma^+$ by considering the contributions from the $N(2080){3/2}^-$ and $N(2270)3/2^-$ molecules instead of any nucleon resonances in the $s$ channel, where the $N(2080)3/2^-$ was proposed to be a $K^\ast \Sigma$ molecule as the strange partner of the $P_c^+(4457)$ hadronic molecular state, and the $N(2270)3/2^-$ was assumed to be a $K^*\Sigma^*$ molecule as the strange partner of the $\bar{D}^\ast \Sigma^\ast_c$ bound states that are predicated as members in the same heavy-quark spin symmetry multiplet as the $P_c$ states. It turns out that all the available cross-section data can be well reproduced, indicating that the molecular structures of the possible $N(2080){3/2}^-$ and $N(2270)3/2^-$ states are compatible with the available data for $K^\ast\Sigma$ photoproduction reactions. Further analysis shows that for both $\gamma p\to K^{\ast +}\Sigma^0$ and $\gamma p \to K^{\ast 0}\Sigma^+$ reactions, the $N(2080){3/2}^-$ exchange provides dominant contributions to the cross-sections in the near-threshold energy region, and significant contributions from the $N(2270)3/2^-$ exchange to the cross-sections in the higher energy region are also found. Predictions of the beam asymmetry $\Sigma$, target asymmetry $T$, and recoil baryon asymmetry $P$ are presented and compared with those from our previous work. Measurements of the data on these observables are called on to further constrain the reaction mechanisms of $K^\ast\Sigma$ photoproduction reactions and to verify the molecular scenario of the $N(2080){3/2}^-$ and $N(2270)3/2^-$ states.


title: Temporal Coherent Test-Time Optimization for Robust Video Classification

abstract: Deep neural networks are likely to fail when the test data is corrupted in real-world deployment (e.g., blur, weather, etc.). Test-time optimization is an effective way that adapts models to generalize to corrupted data during testing, which has been shown in the image domain. However, the techniques for improving video classification corruption robustness remain few. In this work, we propose a Temporal Coherent Test-time Optimization framework (TeCo) to utilize spatio-temporal information in test-time optimization for robust video classification. To exploit information in video with self-supervised learning, TeCo uses global content from video clips and optimizes models for entropy minimization. TeCo minimizes the entropy of the prediction based on the global content from video clips. Meanwhile, it also feeds local content to regularize the temporal coherence at the feature level. TeCo retains the generalization ability of various video classification models and achieves significant improvements in corruption robustness across Mini Kinetics-C and Mini SSV2-C. Furthermore, TeCo sets a new baseline in video classification corruption robustness via test-time optimization.


title: FeynGrav 2.0

abstract: We present a new version of FeynGrav. The present version supports Feynman rules for matter with non-vanishing mass and $SU(N)$ Yang-Mills model. We revisit the gauge fixing procedure for gravity and derive interaction rules valid for an arbitrary gauge fixing parameter. We provide a few simple examples of calculations to illustrate package usage.


title: Towards Memory- and Time-Efficient Backpropagation for Training Spiking Neural Networks

abstract: Spiking Neural Networks (SNNs) are promising energy-efficient models for neuromorphic computing. For training the non-differentiable SNN models, the backpropagation through time (BPTT) with surrogate gradients (SG) method has achieved high performance. However, this method suffers from considerable memory cost and training time during training. In this paper, we propose the Spatial Learning Through Time (SLTT) method that can achieve high performance while greatly improving training efficiency compared with BPTT. First, we show that the backpropagation of SNNs through the temporal domain contributes just a little to the final calculated gradients. Thus, we propose to ignore the unimportant routes in the computational graph during backpropagation. The proposed method reduces the number of scalar multiplications and achieves a small memory occupation that is independent of the total time steps. Furthermore, we propose a variant of SLTT, called SLTT-K, that allows backpropagation only at K time steps, then the required number of scalar multiplications is further reduced and is independent of the total time steps. Experiments on both static and neuromorphic datasets demonstrate superior training efficiency and performance of our SLTT. In particular, our method achieves state-of-the-art accuracy on ImageNet, while the memory cost and training time are reduced by more than 70% and 50%, respectively, compared with BPTT.


title: Auxiliary Task-based Deep Reinforcement Learning for Quantum Control

abstract: Due to its property of not requiring prior knowledge of the environment, reinforcement learning has significant potential for quantum control problems. In this work, we investigate the effectiveness of continuous control policies based on deep deterministic policy gradient. To solve the sparse reward signal in quantum learning control problems, we propose an auxiliary task-based deep reinforcement learning (AT-DRL) for quantum control. In particular, we first design a guided reward function based on the fidelity of quantum states that enables incremental fidelity improvement. Then, we introduce the concept of an auxiliary task whose network shares parameters with the main network to predict the reward provided by the environment (called the main task). The auxiliary task learns synchronously with the main task, allowing one to select the most relevant features of the environment, thus aiding the agent in comprehending how to achieve the desired state. The numerical simulations demonstrate that the proposed AT-DRL can provide a solution to the sparse reward in quantum systems, and has great potential in designing control pulses that achieve efficient quantum state preparation.


title: Finite-temperature simulations of strongly correlated systems

abstract: This thesis describes several topics related to finite temperature studies of strongly correlated systems: finite temperature density matrix embedding theory (FT-DMET), finite temperature metal-insulator transition, and quantum algorithms including quantum imaginary time evolution (QITE), quantum Lanczos (QLanczos), and quantum minimally entangled typical thermal states (QMETTS) algorithms. While the absolute zero temperature is not reachable, studies of physical and chemical problems at finite temperatures, especially at low temperature, is essential for understanding the quantum behaviors of materials in realistic conditions. Here we define low temperature as the temperature regime where the quantum effect is not largely dissipated due to thermal fluctuation. Treatment of systems at low temperatures is especially difficult compared to both high temperatures - where classical approximation can be applied - and zero temperatures where only the ground state is required to describe the system of interest.


title: Adapter Incremental Continual Learning of Efficient Audio Spectrogram Transformers

abstract: Continual learning involves training neural networks incrementally for new tasks while retaining the knowledge of previous tasks. However, efficiently fine-tuning the model for sequential tasks with minimal computational resources remains a challenge. In this paper, we propose Task Incremental Continual Learning (TI-CL) of audio classifiers with both parameter-efficient and compute-efficient Audio Spectrogram Transformers (AST). To reduce the trainable parameters without performance degradation for TI-CL, we compare several Parameter Efficient Transfer (PET) methods and propose AST with Convolutional Adapters for TI-CL, which has less than 5% of trainable parameters of the fully fine-tuned counterparts. To reduce the computational complexity, we introduce a novel Frequency-Time factorized Attention (FTA) method that replaces the traditional self-attention in transformers for audio spectrograms. FTA achieves competitive performance with only a factor of the computations required by Global Self-Attention (GSA). Finally, we formulate our method for TI-CL, called Adapter Incremental Continual Learning (AI-CL), as a combination of the "parameter-efficient" Convolutional Adapter and the "compute-efficient" FTA. Experiments on ESC-50, SpeechCommandsV2 (SCv2), and Audio-Visual Event (AVE) benchmarks show that our proposed method prevents catastrophic forgetting in TI-CL while maintaining a lower computational budget.


title: Deformed Cartan matrices and generalized preprojective algebras II: General type

abstract: We propose a definition of deformed symmetrizable generalized Cartan matrices with several deformation parameters, which admit a categorical interpretation by graded modules over the generalized preprojective algebras in the sense of Gei\ss-Leclerc-Schr\"oer. Using the categorical interpretation, we deduce a combinatorial formula for the inverses of our deformed Cartan matrices in terms of braid group actions. Under a certain condition, which is satisfied in all the symmetric cases or in all the finite and affine cases, our definition coincides with that of the mass-deformed Cartan matrices introduced by Kimura-Pestun in their study of quiver $\mathcal{W}$-algebras.


title: Near-field localization of the boson peak on tantalum films for superconducting quantum devices

abstract: Superconducting circuits are among the most advanced quantum computing technologies, however their performance is currently limited by losses found in surface oxides and disordered materials. Here, we identify and spatially localize a near-field signature of loss centers on tantalum films using terahertz scattering-type scanning near-field optical microscopy (s-SNOM). Making use of terahertz nanospectroscopy, we observe a localized excess vibrational mode around 0.5 THz and identify this resonance as the boson peak, a signature of amorphous materials. Grazing-incidence wide-angle x-ray scattering (GIWAXS) shows that oxides on freshly solvent-cleaned samples are amorphous, whereas crystalline phases emerge after aging in air. By localizing defect centers at the nanoscale, our characterization techniques and results will inform the optimization of fabrication procedures for new low-loss superconducting circuits.


title: Shock formation for 2D Isentropic Euler equations with self-similar variables

abstract: We study the 2D isentropic Euler equations with the ideal gas law. We exhibit a set of smooth initial data that give rise to shock formation at a single point near the planar symmetry. These solutions are associated with non-zero vorticity at the shock and have uniform-in-time 1/3-H\"older bound. Moreover, these point shocks are of self-similar type and share the same profile, which is a solution to the 2D self-similar Burgers equation. Our proof, following the 3D shock formation result of Buckmaster, Shkoller and Vicol, is based on the stable 2D self-similar Burgers profile and the modulation method.


title: Canonical Purification and the Quantum Extremal Shock

abstract: We study the canonical purification (with respect to one of the parties) of pure, bi-partite states obtained by turning on sources in the Euclidean path integral. In holographic conformal field theories, the Lorentzian bulk dual of the canonical purification consists of the corresponding entanglement wedge glued to its CPT image at the quantum extremal surface. However, the mismatch in the classical expansions at the QES due to quantum corrections needs to be supported by a shock in the bulk matter stress tensor in order for the bulk to satisfy Einstein's equations. Working perturbatively to first order in double-trace sources around the thermofield double state, we demonstrate that the state of the bulk matter in the dual to the canonically purified boundary CFT state precisely has this quantum extremal shock in the bulk stress tensor. We interpret our results as the emergence of gravitational physics from the CFT entanglement structure in a context where bulk quantum corrections are important.


title: Two-fold refinement of non simply laced Chern-Simons theories

abstract: Inspired by the two-parameter Macdonald-Cherednik deformation of the formulae for non simply laced simple Lie algebras, we propose a two-fold refinement of the partition function of the corresponding Chern-Simons theory on $S^3$. It is based on a two-fold refinement of the Kac-Peterson formula for the volume of the fundamental domain of the coroot lattice of non simply laced Lie algebras. We further derive explicit integral representations of the two-fold refined Chern-Simons partition functions. We also present the corresponding generalized universal-like expressions for them. With these formulae in hand, one can try to investigate a possible duality of the corresponding Chern-Simons theories with hypothetical two-fold refined topological string theories.


title: $(\alpha_D,\alpha_G)$-GANs: Addressing GAN Training Instabilities via Dual Objectives

abstract: In an effort to address the training instabilities of GANs, we introduce a class of dual-objective GANs with different value functions (objectives) for the generator (G) and discriminator (D). In particular, we model each objective using $\alpha$-loss, a tunable classification loss, to obtain $(\alpha_D,\alpha_G)$-GANs, parameterized by $(\alpha_D,\alpha_G)\in (0,\infty]^2$. For sufficiently large number of samples and capacities for G and D, we show that the resulting non-zero sum game simplifies to minimizing an $f$-divergence under appropriate conditions on $(\alpha_D,\alpha_G)$. In the finite sample and capacity setting, we define estimation error to quantify the gap in the generator's performance relative to the optimal setting with infinite samples and obtain upper bounds on this error, showing it to be order optimal under certain conditions. Finally, we highlight the value of tuning $(\alpha_D,\alpha_G)$ in alleviating training instabilities for the synthetic 2D Gaussian mixture ring and the Stacked MNIST datasets.


title: Dynamic Transition From Regular to Mach Reflection Over a Moving Wedge

abstract: The transition between the Regular Reflection (RR) and Mach Reflection (MR) phenomenon impacts the design of the supersonic and hypersonic air-breathing vehicles. The aim of this paper is to numerically investigate the dynamic transition from RR to MR of unsteady supersonic flow over a two-dimensional wedge, whose trailing edge moves along the $x$-direction upstream with a velocity, $V(t)$ at a free-stream Mach number of $M_{\infty}=3$. The simulation is conducted using the unsteady compressible inviscid flow solver, which is implemented in OpenFOAM\textsuperscript{\textregistered}, the open-source CFD tool. Further, the wedge motion is applied by moving the mesh boundary, performing the Arbitrary Lagrangian-Eulerian (ALE) technique. In addition, the sonic and detachment criteria are used to define the dynamic transition from RR to MR during the increase of the wedge angle. Different reduced frequencies, $\kappa$, in the range of $[0.1-2]$ for the moving wedge are applied to study the lag in the dynamic transition from the steady-state condition. The results show that the critical value of $\kappa=0.4$ distinguishes between the rapid and gradual lag in the transition from RR to MR. In addition, the transition from RR to MR occurs above the Dual Solution Domain (DSD), since the shock is curved downstream during the rapid motion of the wedge.


title: Euler-type integrals for the generalized hypergeometric matrix function

abstract: In this paper, we investigate the Euler-type integral representations for the generalized hypergeometric matrix function and develop some transformations in terms of hypergeometric matrix functions. Furthermore, unit and half arguments have been provided for several particular cases.


title: Read Pointer Meters in complex environments based on a Human-like Alignment and Recognition Algorithm

abstract: Recently, developing an automatic reading system for analog measuring instruments has gained increased attention, as it enables the collection of numerous state of equipment. Nonetheless, two major obstacles still obstruct its deployment to real-world applications. The first issue is that they rarely take the entire pipeline's speed into account. The second is that they are incapable of dealing with some low-quality images (i.e., meter breakage, blur, and uneven scale). In this paper, we propose a human-like alignment and recognition algorithm to overcome these problems. More specifically, a Spatial Transformed Module(STM) is proposed to obtain the front view of images in a self-autonomous way based on an improved Spatial Transformer Networks(STN). Meanwhile, a Value Acquisition Module(VAM) is proposed to infer accurate meter values by an end-to-end trained framework. In contrast to previous research, our model aligns and recognizes meters totally implemented by learnable processing, which mimics human's behaviours and thus achieves higher performances. Extensive results verify the good robustness of the proposed model in terms of the accuracy and efficiency.


title: A CS guide to the quantum singular value transformation

abstract: We present a simplified exposition of some pieces of [Gily\'en, Su, Low, and Wiebe, STOC'19, arXiv:1806.01838], which introduced a quantum singular value transformation (QSVT) framework for applying polynomial functions to block-encoded matrices. The QSVT framework has garnered substantial recent interest from the quantum algorithms community, as it was demonstrated by [GSLW19] to encapsulate many existing algorithms naturally phrased as an application of a matrix function. First, we posit that the lifting of quantum singular processing (QSP) to QSVT is better viewed not through Jordan's lemma (as was suggested by [GSLW19]) but as an application of the cosine-sine decomposition, which can be thought of as a more explicit and stronger version of Jordan's lemma. Second, we demonstrate that the constructions of bounded polynomial approximations given in [GSLW19], which use a variety of ad hoc approaches drawing from Fourier analysis, Chebyshev series, and Taylor series, can be unified under the framework of truncation of Chebyshev series, and indeed, can in large part be matched via a bounded variant of a standard meta-theorem from [Trefethen, 2013]. We hope this work finds use to the community as a companion guide for understanding and applying the powerful framework of [GSLW19].


title: BEVPlace: Learning LiDAR-based Place Recognition using Bird's Eye View Images

abstract: Place recognition is a key module for long-term SLAM systems. Current LiDAR-based place recognition methods usually use representations of point clouds such as unordered points or range images. These methods achieve high recall rates of retrieval, but their performance may degrade in the case of view variation or scene changes. In this work, we explore the potential of a different representation in place recognition, i.e. bird's eye view (BEV) images. We observe that the structural contents of BEV images are less influenced by rotations and translations of point clouds. We validate that, without any delicate design, a simple VGGNet trained on BEV images achieves comparable performance with the state-of-the-art place recognition methods in scenes of slight viewpoint changes. For more robust place recognition, we design a rotation-invariant network called BEVPlace. We use group convolution to extract rotation-equivariant local features from the images and NetVLAD for global feature aggregation. In addition, we observe that the distance between BEV features is correlated with the geometry distance of point clouds. Based on the observation, we develop a method to estimate the position of the query cloud, extending the usage of place recognition. The experiments conducted on large-scale public datasets show that our method 1) achieves state-of-the-art performance in terms of recall rates, 2) is robust to view changes, 3) shows strong generalization ability, and 4) can estimate the positions of query point clouds. Source codes are publicly available at https://github.com/zjuluolun/BEVPlace.


title: Ethical Frameworks and Computer Security Trolley Problems: Foundations for Conversations

abstract: The computer security research community regularly tackles ethical questions. The field of ethics / moral philosophy has for centuries considered what it means to be "morally good" or at least "morally allowed / acceptable". Among philosophy's contributions are (1) frameworks for evaluating the morality of actions -- including the well-established consequentialist and deontological frameworks -- and (2) scenarios (like trolley problems) featuring moral dilemmas that can facilitate discussion about and intellectual inquiry into different perspectives on moral reasoning and decision-making. In a classic trolley problem, consequentialist and deontological analyses may render different opinions. In this research, we explicitly make and explore connections between moral questions in computer security research and ethics / moral philosophy through the creation and analysis of trolley problem-like computer security-themed moral dilemmas and, in doing so, we seek to contribute to conversations among security researchers about the morality of security research-related decisions. We explicitly do not seek to define what is morally right or wrong, nor do we argue for one framework over another. Indeed, the consequentialist and deontological frameworks that we center, in addition to coming to different conclusions for our scenarios, have significant limitations. Instead, by offering our scenarios and by comparing two different approaches to ethics, we strive to contribute to how the computer security research field considers and converses about ethical questions, especially when there are different perspectives on what is morally right or acceptable.


title: Multi-target Range and Angle detection for MIMO-FMCW radar with limited antennas

abstract: Multiple-input multiple-output (MIMO) radar has several advantages with respect to the traditional radar array systems in terms of performance and flexibility. However, in order to achieve high angular resolution, a MIMO radar requires a large number of transmit and receive antennas, which increases hardware design and computational complexities. Although spatial compressive sensing (CS) has been recently considered for a pulsed-waveform MIMO radar with sparse random arrays, such methods for the frequency-modulated continuous wave (FMCW) radar remain largely unexplored. In this context, we propose a novel multi-target localization algorithm in the range-angle domain for a MIMO FMCW radar with a sparse array of randomly placed transmit and receive elements. In particular, we first obtain the targets' range-delays using a discrete Fourier transform (DFT)-based focusing operation. The target angles are then recovered at each detected range using CS-based techniques exploiting the sparsity of the target scene. Our simulation results demonstrate the effectiveness of the proposed algorithm over the classical methods in detecting multiple targets with a sparse array.


title: Emergent glassiness in disorder-free Kitaev model: Density matrix renormalization group study on a one-dimensional ladder setting

abstract: The complete phase diagram of the Kitaev model with a magnetic field remains elusive, as do the experimental results in the candidate material {\alpha}-RuCl3. Here, we study the Kitaev model on a one-dimensional ladder setting within the density-matrix renormalization group method in the presence of a magnetic field at zero temperature. We find five distinct phases with increasing magnetic field, which are characterized by a homogeneous flux phase, the Z2 vortex gas, solid and emergent glass phase, and finally, a spin-polarized phase. The emergent glassiness is confirmed by calculating correlation functions showing quasi-long-range behavior and ground state fidelity, showing a plethora of energetically accessible orthogonal saddle points corresponding to different flux configurations. This glassy behavior seems to arise from the slow dynamics of the Z2 fluxes, which is a consequence of the local constraints present in the underlying Hilbert space. This phenomenon can also be explored in other spin-liquid systems where the corresponding low-energy excitations are similarly retarded due to constraints.


title: Towards Personalized Preprocessing Pipeline Search

abstract: Feature preprocessing, which transforms raw input features into numerical representations, is a crucial step in automated machine learning (AutoML) systems. However, the existing systems often have a very small search space for feature preprocessing with the same preprocessing pipeline applied to all the numerical features. This may result in sub-optimal performance since different datasets often have various feature characteristics, and features within a dataset may also have their own preprocessing preferences. To bridge this gap, we explore personalized preprocessing pipeline search, where the search algorithm is allowed to adopt a different preprocessing pipeline for each feature. This is a challenging task because the search space grows exponentially with more features. To tackle this challenge, we propose ClusterP3S, a novel framework for Personalized Preprocessing Pipeline Search via Clustering. The key idea is to learn feature clusters such that the search space can be significantly reduced by using the same preprocessing pipeline for the features within a cluster. To this end, we propose a hierarchical search strategy to jointly learn the clusters and search for the optimal pipelines, where the upper-level search optimizes the feature clustering to enable better pipelines built upon the clusters, and the lower-level search optimizes the pipeline given a specific cluster assignment. We instantiate this idea with a deep clustering network that is trained with reinforcement learning at the upper level, and random search at the lower level. Experiments on benchmark classification datasets demonstrate the effectiveness of enabling feature-wise preprocessing pipeline search.


title: Phononic-subsurface flow stabilization by subwavelength locally resonant metamaterials

abstract: The interactions between a solid surface and a fluid flow underlie dynamical processes relevant to air, sea, and land vehicle performance and numerous other technologies. Key among these processes are unstable flow disturbances that contribute to fundamental transformations in the flow field. Precise control of these disturbances is possible by introducing a phononic subsurface (PSub). This comprises locally attaching a finite phononic structure perpendicular to an elastic surface exposed to the flowing fluid. This structure experiences ongoing excitation by an unstable flow mode traveling in conjunction with the mean flow. The excitation generates small deformations at the surface that trigger elastic wave propagation within the structure. By targeted tuning of the unit-cell and finite-structure characteristics of the PSub, the returning waves may be devised to resonate and reenter the flow out of phase, leading to significant destructive interference of the incoming flow waves near the surface and subsequently to their attenuation over the spatial extent of the control region. This control mechanism is passive, responsive, and engineered offline without needing coupled fluid-structure simulations; only the flow instability's frequency, wavelength, and overall modal characteristics must be known. We present a PSub in the form of a locally resonant elastic metamaterial, designed to operate in the elastic subwavelength regime and hence being significantly shorter in length compared to a phononic-crystal-based PSub. Using direct numerical simulations (DNS) of channel flows, both types of PSubs are investigated, and their controlled spatial and energetic influence on the wall-bounded flow behavior is demonstrated and analyzed. We show that the PSub's effect is spatially localized as intended, with a rapidly diminishing streamwise influence away from its location in the subsurface.


title: Lifetime-configurable soft robots via photodegradable silicone elastomer composites

abstract: Developing soft robots that can control their own life-cycle and degrade on-demand while maintaining hyper-elasticity is a significant research challenge. On-demand degradable soft robots, which conserve their original functionality during operation and rapidly degrade under specific external stimulation, present the opportunity to self-direct the disappearance of temporary robots. This study proposes soft robots and materials that exhibit excellent mechanical stretchability and can degrade under ultraviolet (UV) light by mixing a fluoride-generating diphenyliodonium hexafluorophosphate (DPI-HFP) with a silicone resin. Spectroscopic analysis revealed the mechanism of Si-O-Si backbone cleavage using fluoride ion (F-), which was generated from UV exposed DPI-HFP. Furthermore, photo-differential scanning calorimetry (DSC) based thermal analysis indicated increased decomposition kinetics at increased temperatures. Additionally, we demonstrated a robotics application of this composite by fabricating a gaiting robot. The integration of soft electronics, including strain sensors, temperature sensors, and photodetectors, expanded the robotic functionalities. This study provides a simple yet novel strategy for designing lifecycle mimicking soft robotics that can be applied to reduce soft robotics waste, explore hazardous areas where retrieval of robots is impossible, and ensure hardware security with on-demand destructive material platforms.