title: Twisted Self-Similarity and the Einstein Vacuum Equations

abstract: In the previous works [I. Rodnianski and Y. Shlapentokh-Rothman, Naked Singularities for the Einstein Vacuum Equations: The Exterior Solution, arXiv:1912.08478 and Y. Shlapentokh-Rothman, Naked Singularities for the Einstein Vacuum Equations: The Interior Solution, arXiv:2204.09891] we have introduced a new type of self-similarity for the Einstein vacuum equations characterized by the fact that the homothetic vector field may be spacelike on the past light cone of the singularity. In this work we give a systematic treatment of this new self-similarity. In particular, we provide geometric characterizations of spacetimes admitting the new symmetry and show the existence and uniqueness of formal expansions around the past null cone of the singularity which may be considered analogues of the well-known Fefferman--Graham expansions. In combination with previous results, our analysis will show that the twisted self-similar solutions are sufficiently general to describe all possible asymptotic behaviors for spacetimes in the small data regime which are self-similar and whose homothetic vector field is everywhere spacelike on an initial spacelike hypersurface. We present an application of this later fact to the understanding of the global structure of Fefferman--Graham spacetimes and the naked singularity exteriors of [I. Rodnianski and Y. Shlapentokh-Rothman, Naked Singularities for the Einstein Vacuum Equations: The Exterior Solution, arXiv:1912.08478]. Lastly, we observe that by an amalgamation of techniques from previous works, one may associate true solutions to the Einstein vacuum equations to each of our formal expansions in a suitable region of spacetime.


title: Randomly Initialized One-Layer Neural Networks Make Data Linearly Separable

abstract: Recently, neural networks have demonstrated remarkable capabilities in mapping two arbitrary sets to two linearly separable sets. The prospect of achieving this with randomly initialized neural networks is particularly appealing due to the computational efficiency compared to fully trained networks. This paper contributes by establishing that, given sufficient width, a randomly initialized one-layer neural network can, with high probability, transform two sets into two linearly separable sets without any training. Moreover, we furnish precise bounds on the necessary width of the neural network for this phenomenon to occur. Our initial bound exhibits exponential dependence on the input dimension while maintaining polynomial dependence on all other parameters. In contrast, our second bound is independent of input dimension, effectively surmounting the curse of dimensionality. The main tools used in our proof heavily relies on a fusion of geometric principles and concentration of random matrices.


title: Realization of ultra-broadband IR up-conversion imaging

abstract: Ultra-broadband imaging devices with high performance are in great demand for a variety of technological applications, including imaging, remote sensing, and communications. An ultra-broadband up-converter is realized based on a p-GaAs homojunction interfacial workfunction internal photoemission (HIWIP) detector-light emitting diode (LED) device. The device demonstrates an ultra-broad response ranging from visible to terahertz (THz) with good reproducibility. The peak responsivity in the mid-infrared (MIR) region is 140 mA/W at 10.5 microns. The HIWIP-LED shows enormous potential for ultra-broadband up-conversion covering all infrared atmospheric windows, as well as the THz region, and the pixel-less imaging of the MIR spot from the CO2 laser is further demonstrated. In addition, the proposed up-converter also performs as a near-infrared and visible detector under zero bias by using a bi-functional LED. Thanks to its ultra-wide response, the HIWIP-LED up-converter has great promise for stable, high-performance ultra-broadband pixel-less imaging and multi-functional analysis systems.


title: Semi-Parametric Inducing Point Networks and Neural Processes

abstract: We introduce semi-parametric inducing point networks (SPIN), a general-purpose architecture that can query the training set at inference time in a compute-efficient manner. Semi-parametric architectures are typically more compact than parametric models, but their computational complexity is often quadratic. In contrast, SPIN attains linear complexity via a cross-attention mechanism between datapoints inspired by inducing point methods. Querying large training sets can be particularly useful in meta-learning, as it unlocks additional training signal, but often exceeds the scaling limits of existing models. We use SPIN as the basis of the Inducing Point Neural Process, a probabilistic model which supports large contexts in meta-learning and achieves high accuracy where existing models fail. In our experiments, SPIN reduces memory requirements, improves accuracy across a range of meta-learning tasks, and improves state-of-the-art performance on an important practical problem, genotype imputation.


title: Safe, Occlusion-Aware Manipulation for Online Object Reconstruction in Confined Spaces

abstract: Recent work in robotic manipulation focuses on object retrieval in cluttered spaces under occlusion. Nevertheless, the majority of efforts lack an analysis of conditions for the completeness of the approaches or the methods apply only when objects can be removed from the workspace. This work formulates the general, occlusion-aware manipulation task, and focuses on safe object reconstruction in a confined space with in-place rearrangement. It proposes a framework that ensures safety with completeness guarantees. Furthermore, an algorithm, which is an instantiation of this abstract framework for monotone instances is developed and evaluated empirically by comparing against a random and a greedy baseline on randomly generated experiments in simulation. Even for cluttered scenes with realistic objects, the proposed algorithm significantly outperforms the baselines and maintains a high success rate across experimental conditions.


title: ENS-t-SNE: Embedding Neighborhoods Simultaneously t-SNE

abstract: When visualizing a high-dimensional dataset, dimension reduction techniques are commonly employed which provide a single 2-dimensional view of the data. We describe ENS-t-SNE: an algorithm for Embedding Neighborhoods Simultaneously that generalizes the t-Stochastic Neighborhood Embedding approach. By using different viewpoints in ENS-t-SNE's 3D embedding, one can visualize different types of clusters within the same high-dimensional dataset. This enables the viewer to see and keep track of the different types of clusters, which is harder to do when providing multiple 2D embeddings, where corresponding points cannot be easily identified. We illustrate the utility of ENS-t-SNE with real-world applications and provide an extensive quantitative evaluation with datasets of different types and sizes.


title: Delayed Coding Scheme for Channels with Insertion, Deletion, and Substitution Errors

abstract: We propose a new coding scheme, called the delayed coding (DC) scheme, for channels with insertion, deletion, and substitution (IDS) errors. The proposed scheme employs delayed encoding and non-iterative detection and decoding strategies to manage the transmission of multiple codewords in a linear code. In the DC scheme, a channel input sequence consists of subblocks of multiple codewords from the previous to current time instances. At the receiver side, the maximum a posteriori detection applies to the received sequences that contain information of the codeword at the current time instance, where priorly decoded codewords aid the detection. The channel code decoding is then performed, and extrinsic messages are exploited for the codeword estimations of the following time instances. We show that the rate achievable with the DC scheme over the IDS channel approaches the symmetric information rate of the channel. Moreover, we show the excellent asymptotic and finite-length performances of the DC scheme in conjunction with low-density parity-check codes.


title: Improving Shape Awareness and Interpretability in Deep Networks Using Geometric Moments

abstract: Deep networks for image classification often rely more on texture information than object shape. While efforts have been made to make deep-models shape-aware, it is often difficult to make such models simple, interpretable, or rooted in known mathematical definitions of shape. This paper presents a deep-learning model inspired by geometric moments, a classically well understood approach to measure shape-related properties. The proposed method consists of a trainable network for generating coordinate bases and affine parameters for making the features geometrically invariant yet in a task-specific manner. The proposed model improves the final feature's interpretation. We demonstrate the effectiveness of our method on standard image classification datasets. The proposed model achieves higher classification performance compared to the baseline and standard ResNet models while substantially improving interpretability.


title: Galvanic Corrosion and Electric Field in Lithium Anode Passivation Films: Effects on Self-Discharge

abstract: Battery interfaces help govern rate capability, safety/stability, cycle life, and self-discharge, but significant gaps remain in our understanding at atomic length scales that can be exploited to improve interfacial properties. In particular, Li partially plated on copper current collectors, relevant to the anodeless, lithium metal cell which is a holy grail of high density energy battery research, has recently been reported to undergo galvanic corrosion and exhibit short shelf lives. We apply large scale Density Functional Theory (DFT) calculations and X-ray photoelectron spectroscopy to examine the reaction between the electrolyte and Li|Cu junctions coated with thin, uniform electrolyte interphase (SEI) passivating films at two applied voltages. These novel DFT galvanic corrosion simulations show that electrolyte degradation preferentially occurs on Li-plated regions and should lead to thicker SEI films. Our simulations reveal similarities but also fundamental differences between traditional metal localized pitting and Li-corrosion mechanisms. Furthermore, using the recently proposed, highly reactive lithium hydride (LiH) component SEI as example, we distinguish between electrochemical and chemical degradation pathways which are partially responsible for self-discharge, with the chemical pathway found to exhibit slow kinetics. We also predict that electric fields should in general exist across natural SEI components like LiH, and across artificial SEI films like LiI and LiAlO(2) often applied to improve battery cycling. Underlying and unifying these predictions is a framework of DFT voltage/overpotential definitions which we have derived from electrochemistry disciplines like structural metal corrosion studies; our analysis can only be made using the correct electronic voltage definitions.


title: Nil$_{\ast}$-Noetherian rings

abstract: In this paper, we say a ring $R$ is Nil$_{\ast}$-Noetherian provided that any nil ideal is finitely generated. First, we show that the Hilbert basis theorem holds for Nil$_{\ast}$-Noetherian rings, that is, $R$ is Nil$_{\ast}$-Noetherian if and only if $R[x]$ is Nil$_{\ast}$-Noetherian, if and only if $R[[x]]$ is Nil$_{\ast}$-Noetherian. Then we discuss some Nil$_{\ast}$-Noetherian properties on idealizations and bi-amalgamated algebras. Finally, we give the Cartan-Eilenberg-Bass Theorem for Nil$_{\ast}$-Noetherian rings in terms of Nil$_{\ast}$-injective modules and Nil$_{\ast}$-FP-injective modules. Besides, some examples are given to distinguish Nil$_{\ast}$-Noetherian rings, Nil$_{\ast}$-coherent rings and so on.


title: A Survey on Neural Open Information Extraction: Current Status and Future Directions

abstract: Open Information Extraction (OpenIE) facilitates domain-independent discovery of relational facts from large corpora. The technique well suits many open-world natural language understanding scenarios, such as automatic knowledge base construction, open-domain question answering, and explicit reasoning. Thanks to the rapid development in deep learning technologies, numerous neural OpenIE architectures have been proposed and achieve considerable performance improvement. In this survey, we provide an extensive overview of the-state-of-the-art neural OpenIE models, their key design decisions, strengths and weakness. Then, we discuss limitations of current solutions and the open issues in OpenIE problem itself. Finally we list recent trends that could help expand its scope and applicability, setting up promising directions for future research in OpenIE. To our best knowledge, this paper is the first review on this specific topic.


title: On the Role of Bidirectionality in Language Model Pre-Training

abstract: Prior work on language model pre-training has explored different architectures and learning objectives, but differences in data, hyperparameters and evaluation make a principled comparison difficult. In this work, we focus on bidirectionality as a key factor that differentiates existing approaches, and present a comprehensive study of its role in next token prediction, text infilling, zero-shot priming and fine-tuning. We propose a new framework that generalizes prior approaches, including fully unidirectional models like GPT, fully bidirectional models like BERT, and hybrid models like CM3 and prefix LM. Our framework distinguishes between two notions of bidirectionality (bidirectional context and bidirectional attention) and allows us to control each of them separately. We find that the optimal configuration is largely application-dependent (e.g., bidirectional attention is beneficial for fine-tuning and infilling, but harmful for next token prediction and zero-shot priming). We train models with up to 6.7B parameters, and find differences to remain consistent at scale. While prior work on scaling has focused on left-to-right autoregressive models, our results suggest that this approach comes with some trade-offs, and it might be worthwhile to develop very large bidirectional models.


title: Spinning test particle motion around a rotating wormhole

abstract: In this work, we investigated the motion of spinning test particles around a rotating wormhole, extending, in this way, the previous work of Benavides-Gallego et al. in [Phys. Rev. D 101, no.12, 124024] to the general case. Using the Mathisson-Papapetrous-Dixon equations, we study the effective potential, circular orbits, and the innermost stable circular orbit (ISCO) of spinning test particles. We found that both the particle and wormhole spins affect the location of the ISCO significantly. On the other hand, Similar to the non-rotating case, we also found two possible configurations in the effective potential: plus and minus. Furthermore, the minimum value of the effective potential is not at the throat due to its spin, in contrast to the motion of the non-spinning test particles in a non-rotating wormhole, where the effective potential is symmetric, and its minimum value is at the throat. In the case of the ISCO, we found that it increases as the spin of the wormhole a increases, in contrast to black holes where the presence of spin decreases the value of the ISCO. Finally, since the dynamical four-momentum and kinematical four-velocity of the spinning particle are not always parallel, we consider the superluminal bound, finding that the allowed values of s change as the wormhole's spin a increases.


title: ItemSage: Learning Product Embeddings for Shopping Recommendations at Pinterest

abstract: Learned embeddings for products are an important building block for web-scale e-commerce recommendation systems. At Pinterest, we build a single set of product embeddings called ItemSage to provide relevant recommendations in all shopping use cases including user, image and search based recommendations. This approach has led to significant improvements in engagement and conversion metrics, while reducing both infrastructure and maintenance cost. While most prior work focuses on building product embeddings from features coming from a single modality, we introduce a transformer-based architecture capable of aggregating information from both text and image modalities and show that it significantly outperforms single modality baselines. We also utilize multi-task learning to make ItemSage optimized for several engagement types, leading to a candidate generation system that is efficient for all of the engagement objectives of the end-to-end recommendation system. Extensive offline experiments are conducted to illustrate the effectiveness of our approach and results from online A/B experiments show substantial gains in key business metrics (up to +7% gross merchandise value/user and +11% click volume).


title: From Easy to Hard: Two-stage Selector and Reader for Multi-hop Question Answering

abstract: Multi-hop question answering (QA) is a challenging task requiring QA systems to perform complex reasoning over multiple documents and provide supporting facts together with the exact answer. Existing works tend to utilize graph-based reasoning and question decomposition to obtain the reasoning chain, which inevitably introduces additional complexity and cumulative error to the system. To address the above issue, we propose a simple yet effective novel framework, From Easy to Hard (FE2H), to remove distracting information and obtain better contextual representations for the multi-hop QA task. Inspired by the iterative document selection process and the progressive learning custom of humans, FE2H divides both the document selector and reader into two stages following an easy-to-hard manner. Specifically, we first select the document most relevant to the question and then utilize the question together with this document to select other pertinent documents. As for the QA phase, our reader is first trained on a single-hop QA dataset and then transferred into the multi-hop QA task. We comprehensively evaluate our model on the popular multi-hop QA benchmark HotpotQA. Experimental results demonstrate that our method ourperforms all other methods in the leaderboard of HotpotQA (distractor setting).


title: BSM Higgs Production at a Muon Collider

abstract: The potential of the non-Standard Model heavy Higgs bosons in 2HDM at a muon collider is studied. The pair production of the non-SM Higgs bosons via the universal gauge interactions is the dominant mechanism once above the kinematic threshold. On the other hand, single Higgs boson production associated with a pair of heavy fermions is also important in the parameter region with enhanced Yukawa couplings. Both $\mu^+\mu^-$ annihilation channels and Vector Boson Fusion processes are considered, as well as radiative return $s$-channel production. Different types of 2HDMs can also be distinguishable for moderate and large values of $\tan\beta$.


title: Dynamic virial theorem at nonequilibrium and applications

abstract: We show that a variety of nonequilibrium dynamics of interacting many-body systems are universally characterized by an elegant relation, which we call the dynamic virial theorem. The out-of-equilibrium dynamics of quantum correlations is entirely governed by Tan\textquoteright s contact. It gives rise to a series of observable consequences and is closely related to experiments with ultracold atoms. Especially, we show that the dynamic virial theorem provides an experimentally accessible verification of maximum energy growth theorem [Qi et al., Phys. Rev. Lett. 126, 240401 (2021)], which is encoded in the evolution of the atomic cloud size during expansion. In addition, the dynamic virial theorem leads to a simple thermodynamic relation of strongly interacting quantum gases in the framework of two-fluid hydrodynamic theory, which holds in a wide range of temperature. This thermodynamic relation is a kind of the out-of-equilibrium analog of Tan's pressure relation at equilibrium. Our results provide fundamental understanding of generic behaviors of interacting many-body systems at nonequilibrium, and are readily examined in experiments with ultracold atoms.


title: Universal scattering phase shift in the presence of spin-orbit coupling

abstract: Scattering phase shift, as a key parameter in scattering theory, plays an important role in characterizing low-energy collisions between ultracold atoms. In this work, we theoretically investigate the universal low-energy behavior of the scattering phase shifts for cold atoms in the presence of spin-orbit coupling. We first construct the asymptotic form of the two-body wave function when two fermions get as close as the interaction range, and consider perturbatively the correction of the spin-orbit coupling up to the second order, in which new scattering parameters are introduced. Then for elastic collisions, the scattering phase shifts are defined according to the unitary scattering $S$ matrix. We show how the low-energy behavior of the scattering phase shifts is modified by these new scattering parameters introduced by spin-orbit coupling. The universality of the scattering phase shifts is manifested as the independence of the specific form of the interatomic potential. The explicit forms of the new scattering parameters are analytically derived within a model of the spherical-square-well potential. Our method provides a unified description of the low-energy properties of scattering phase shifts in the presence of spin-orbit coupling.


title: Single-View View Synthesis in the Wild with Learned Adaptive Multiplane Images

abstract: This paper deals with the challenging task of synthesizing novel views for in-the-wild photographs. Existing methods have shown promising results leveraging monocular depth estimation and color inpainting with layered depth representations. However, these methods still have limited capability to handle scenes with complex 3D geometry. We propose a new method based on the multiplane image (MPI) representation. To accommodate diverse scene layouts in the wild and tackle the difficulty in producing high-dimensional MPI contents, we design a network structure that consists of two novel modules, one for plane depth adjustment and another for depth-aware color prediction. The former adjusts the initial plane positions using the RGBD context feature and an attention mechanism. Given adjusted depth values, the latter predicts the color and density for each plane separately with proper inter-plane interactions achieved via a feature masking strategy. To train our method, we construct large-scale stereo training data using only unconstrained single-view image collections by a simple yet effective warp-back strategy. The experiments on both synthetic and real datasets demonstrate that our trained model works remarkably well and achieves state-of-the-art results.


title: Mass-Ratio Distribution of Binaries From the LAMOST-MRS Survey

abstract: Binary evolution leads to the formation of important objects crucial to the development of astrophysics, but the statistical properties of binary populations are still poorly understood. The LAMOST-MRS has provided a large sample of stars to study the properties of binary populations, especially for the mass ratio distributions and the binary fractions. We have devised a Peak Amplitude Ratio (PAR) approach to derive the mass ratio of a binary system based on results obtained from its spectrum. By computing a cross-correlation function (CCF), we established a relationship between the derived mass ratio and the PARs of the binary systems. By utilizing spectral observations obtained from LAMSOT DR6 & DR7, we applied the PAR approach to form distributions of the derived mass ratio of the binary systems to the spectral types. We selected the mass ratio within the range of $0.6-1.0$ for investigating the mass-ratio distribution. Through a power-law fitting, we obtained the power index $\gamma$ values of $-0.42\pm0.27$, $0.03\pm0.12$, and $2.12\pm0.19$ for A-, F-, and G-type stars identified in the sample, respectively. The derived $\gamma$-values display an increasing trend toward lower primary star masses, and G-type binaries tend to be more in twins. The close binary fractions (for $P\lesssim 150\,{\rm d}$ and $q\gtrsim 0.6$) in our sample for A, F and G binaries are $7.6\pm 0.5 \%$, $4.9\pm 0.2 \%$ and $3.7 \pm 0.1 \%$, respectively. Note that the PAR approach can be applied to large spectroscopic surveys of stars.


title: Soft-SVM Regression For Binary Classification

abstract: The binomial deviance and the SVM hinge loss functions are two of the most widely used loss functions in machine learning. While there are many similarities between them, they also have their own strengths when dealing with different types of data. In this work, we introduce a new exponential family based on a convex relaxation of the hinge loss function using softness and class-separation parameters. This new family, denoted Soft-SVM, allows us to prescribe a generalized linear model that effectively bridges between logistic regression and SVM classification. This new model is interpretable and avoids data separability issues, attaining good fitting and predictive performance by automatically adjusting for data label separability via the softness parameter. These results are confirmed empirically through simulations and case studies as we compare regularized logistic, SVM, and Soft-SVM regressions and conclude that the proposed model performs well in terms of both classification and prediction errors.


title: Towards a Defense Against Federated Backdoor Attacks Under Continuous Training

abstract: Backdoor attacks are dangerous and difficult to prevent in federated learning (FL), where training data is sourced from untrusted clients over long periods of time. These difficulties arise because: (a) defenders in FL do not have access to raw training data, and (b) a new phenomenon we identify called backdoor leakage causes models trained continuously to eventually suffer from backdoors due to cumulative errors in defense mechanisms. We propose shadow learning, a framework for defending against backdoor attacks in the FL setting under long-range training. Shadow learning trains two models in parallel: a backbone model and a shadow model. The backbone is trained without any defense mechanism to obtain good performance on the main task. The shadow model combines filtering of malicious clients with early-stopping to control the attack success rate even as the data distribution changes. We theoretically motivate our design and show experimentally that our framework significantly improves upon existing defenses against backdoor attacks.


title: PERT: A New Solution to Pinyin to Character Conversion Task

abstract: Pinyin to Character conversion (P2C) task is the key task of Input Method Engine (IME) in commercial input software for Asian languages, such as Chinese, Japanese, Thai language and so on. It's usually treated as sequence labelling task and resolved by language model, i.e. n-gram or RNN. However, the low capacity of the n-gram or RNN limits its performance. This paper introduces a new solution named PERT which stands for bidirectional Pinyin Encoder Representations from Transformers. It achieves significant improvement of performance over baselines. Furthermore, we combine PERT with n-gram under a Markov framework, and improve performance further. Lastly, the external lexicon is incorporated into PERT so as to resolve the OOD issue of IME.


title: Adaptive Few-Shot Learning Algorithm for Rare Sound Event Detection

abstract: Sound event detection is to infer the event by understanding the surrounding environmental sounds. Due to the scarcity of rare sound events, it becomes challenging for the well-trained detectors which have learned too much prior knowledge. Meanwhile, few-shot learning methods promise a good generalization ability when facing a new limited-data task. Recent approaches have achieved promising results in this field. However, these approaches treat each support example independently, ignoring the information of other examples from the whole task. Because of this, most of previous methods are constrained to generate a same feature embedding for all test-time tasks, which is not adaptive to each inputted data. In this work, we propose a novel task-adaptive module which is easy to plant into any metric-based few-shot learning frameworks. The module could identify the task-relevant feature dimension. Incorporating our module improves the performance considerably on two datasets over baseline methods, especially for the transductive propagation network. Such as +6.8% for 5-way 1-shot accuracy on ESC-50, and +5.9% on noiseESC-50. We investigate our approach in the domain-mismatch setting and also achieve better results than previous methods.


title: Deep Learning Meets Software Engineering: A Survey on Pre-Trained Models of Source Code

abstract: Recent years have seen the successful application of deep learning to software engineering (SE). In particular, the development and use of pre-trained models of source code has enabled state-of-the-art results to be achieved on a wide variety of SE tasks. This paper provides an overview of this rapidly advancing field of research and reflects on future research directions.


title: Trends in Workplace Wearable Technologies and Connected-Worker Solutions for Next-Generation Occupational Safety, Health, and Productivity

abstract: The workplace influences the safety, health, and productivity of workers at multiple levels. To protect and promote total worker health, smart hardware, and software tools have emerged for the identification, elimination, substitution, and control of occupational hazards. Wearable devices enable constant monitoring of individual workers and the environment, whereas connected worker solutions provide contextual information and decision support. Here, the recent trends in commercial workplace technologies to monitor and manage occupational risks, injuries, accidents, and diseases are reviewed. Workplace safety wearables for safe lifting, ergonomics, hazard identification, sleep monitoring, fatigue management, and heat and cold stress are discussed. Examples of workplace productivity wearables for asset tracking, augmented reality, gesture and motion control, brain wave sensing, and work stress management are given. Workplace health wearables designed for work-related musculoskeletal disorders, functional movement disorders, respiratory hazards, cardiovascular health, outdoor sun exposure, and continuous glucose monitoring are shown. Connected worker platforms are discussed with information about the architecture, system modules, intelligent operations, and industry applications. Predictive analytics provide contextual information about occupational safety risks, resource allocation, equipment failure, and predictive maintenance. Altogether, these examples highlight the ground-level benefits of real-time visibility about frontline workers, work environment, distributed assets, workforce efficiency, and safety compliance


title: Disambigutaion Decomposition of Mean Skin Friction and Heat Flux on Arbitrary-Curvature Surface

abstract: Since it is difficult to apply the existing method of friction and heat flux decomposition on the complex surface, a combined decomposition method of friction and heat flux with clear physical interpretation is proposed, which is based on FIK and RD decomposition method and can be applied to arbitrary surface. Based on this method, the aerothermodynamic characteristics of bistable states of curved compression ramps are analyzed from the perspective of energy transformation. The results show that the decrease of friction in the interaction region of the attachment state and the minimum values of friction in the separation bubble are all caused by the energy injection of the work by the adverse pressure gradient. The peak friction is mainly induced by the viscous dissipation, and its position is affected by the mechanical energy transport. The peak heat flux is mainly induced by viscous dissipation, and the enthalpy transport of the separation state plays a greater role in the peak heat flux generation than that of the attachment state. These results indicate that reducing viscous dissipation is a potential way for realizing friction and heat flux control simultaneously.


title: Compact Molecular Simulation on Quantum Computers via Combinatorial Mapping and Variational State Preparation

abstract: Compact representations of fermionic Hamiltonians are necessary to perform calculations on quantum computers that lack error-correction. A fermionic system is typically defined within a subspace of fixed particle number and spin while unnecessary states are projected out of the Hilbert space. We provide a bijective mapping using combinatoric ranking to bijectively map fermion basis states to qubit basis states and express operators in the standard spin representation. We then evaluate compact mapping using the Variational Quantum Eigensolver (VQE) with the unitary coupled cluster singles and doubles excitations (UCCSD) ansatz in the compact representation. Compactness is beneficial when the orbital filling is well away from half, and we show at 30 spin orbital $H_{2}$ calculation with only 8 qubits. We find that the gate depth needed to prepare the compact wavefunction is not much greater than the full configuration space in practice. A notable observation regards the number of calls to the optimizer needed for the compact simulation compared to the full simulation. We find that the compact representation converges faster than the full representation using the ADAM optimizer in all cases. Our analysis demonstrates the effect of compact mapping in practice.


title: Demand Response Method Considering Multiple Types of Flexible Loads in Industrial Parks

abstract: With the rapid development of the energy internet, the proportion of flexible loads in smart grid is getting much higher than before. It is highly important to model flexible loads based on demand response. Therefore, a new demand response method considering multiple flexible loads is proposed in this paper to character the integrated demand response (IDR) resources. Firstly, a physical process analytical deduction (PPAD) model is proposed to improve the classification of flexible loads in industrial parks. Scenario generation, data point augmentation, and smooth curves under various operating conditions are considered to enhance the applicability of the model. Secondly, in view of the strong volatility and poor modeling effect of Wasserstein-generative adversarial networks (WGAN), an improved WGAN-gradient penalty (IWGAN-GP) model is developed to get a faster convergence speed than traditional WGAN and generate a higher quality samples. Finally, the PPAD and IWGAN-GP models are jointly implemented to reveal the degree of correlation between flexible loads. Meanwhile, an intelligent offline database is built to deal with the impact of nonlinear factors in different response scenarios. Numerical examples have been performed with the results proving that the proposed method is significantly better than the existing technologies in reducing load modeling deviation and improving the responsiveness of park loads.


title: Alleviating Robust Overfitting of Adversarial Training With Consistency Regularization

abstract: Adversarial training (AT) has proven to be one of the most effective ways to defend Deep Neural Networks (DNNs) against adversarial attacks. However, the phenomenon of robust overfitting, i.e., the robustness will drop sharply at a certain stage, always exists during AT. It is of great importance to decrease this robust generalization gap in order to obtain a robust model. In this paper, we present an in-depth study towards the robust overfitting from a new angle. We observe that consistency regularization, a popular technique in semi-supervised learning, has a similar goal as AT and can be used to alleviate robust overfitting. We empirically validate this observation, and find a majority of prior solutions have implicit connections to consistency regularization. Motivated by this, we introduce a new AT solution, which integrates the consistency regularization and Mean Teacher (MT) strategy into AT. Specifically, we introduce a teacher model, coming from the average weights of the student models over the training steps. Then we design a consistency loss function to make the prediction distribution of the student models over adversarial examples consistent with that of the teacher model over clean samples. Experiments show that our proposed method can effectively alleviate robust overfitting and improve the robustness of DNN models against common adversarial attacks.


title: Ion-Implantation as Pixel Isolation for Fabrication of Planar Strain-Balanced Antimony-based Superlattice Infrared Photodetectors

abstract: Strained layer superlattice (SLS) material system is a dynamic and relatively new material for infrared detection. Large format, small-pitch and low-cost focal plane arrays (FPAs) with more pixels are in demand for different applications. For the current SLS based FPAs mesa etching are used to define the pixels. For those SLS based FPAs with scaled pixel size making the mesa structures can be challenging due to the need for deep etch, and then passivation process. One of the possible solutions to address this issue is to consider a planar structure and avoiding the mesa-isolation etching or complex surface treatment/ passivation process. In this work, the recent progress on planar SLS infrared photodetectors using ion-implantation for device isolation is reviewed. In this method of fabrication, ion implantation was applied from the top to bombardment the surface for device isolation, like mesa-isolation step in device fabrication.


title: DeWitt wave function in Ho\v{r}ava-Lifshitz cosmology with tensor perturbation

abstract: We present a well-tempered DeWitt wave function, which vanishes at the classical big-bang singularity, in Ho\v{r}ava-Lifshitz (HL) cosmology with tensor perturbation, both analytically and numerically. In general relativity, the DeWitt wave function is ill-behaved once the tensor perturbation is taken into account. This is essentially because the amplitude of the perturbation diverges at the singularity and the perturbative expansion completely breaks down. On the other hand, in HL gravity it is known that the higher dimensional operators required by the perturbative renormalizability render the tensor perturbation scale-invariant and regular all the way up to the singularity. In this paper we analytically show that in $d+1$ dimensional HL gravity the DeWitt wave function for tensor perturbation is indeed well-defined around the classical big-bang singularity. Also, we numerically demonstrate the well-behaved DeWitt wave function for tensor perturbation from the big-bang to a finite size of the Universe.


title: BabyBear: Cheap inference triage for expensive language models

abstract: Transformer language models provide superior accuracy over previous models but they are computationally and environmentally expensive. Borrowing the concept of model cascading from computer vision, we introduce BabyBear, a framework for cascading models for natural language processing (NLP) tasks to minimize cost. The core strategy is inference triage, exiting early when the least expensive model in the cascade achieves a sufficiently high-confidence prediction. We test BabyBear on several open source data sets related to document classification and entity recognition. We find that for common NLP tasks a high proportion of the inference load can be accomplished with cheap, fast models that have learned by observing a deep learning model. This allows us to reduce the compute cost of large-scale classification jobs by more than 50% while retaining overall accuracy. For named entity recognition, we save 33% of the deep learning compute while maintaining an F1 score higher than 95% on the CoNLL benchmark.


title: Deep Learning-based automated classification of Chinese Speech Sound Disorders

abstract: This article describes a system for analyzing acoustic data to assist in the diagnosis and classification of children's speech sound disorders (SSDs) using a computer. The analysis concentrated on identifying and categorizing four distinct types of Chinese SSDs. The study collected and generated a speech corpus containing 2540 stopping, backing, final consonant deletion process (FCDP), and affrication samples from 90 children aged 3--6 years with normal or pathological articulatory features. Each recording was accompanied by a detailed diagnostic annotation by two speech-language pathologists (SLPs). Classification of the speech samples was accomplished using three well-established neural network models for image classification. The feature maps were created using three sets of Mel-frequency cepstral coefficients (MFCC) parameters extracted from speech sounds and aggregated into a three-dimensional data structure as model input. We employed six techniques for data augmentation to augment the available dataset while avoiding overfitting. The experiments examine the usability of four different categories of Chinese phrases and characters. Experiments with different data subsets demonstrate the system's ability to accurately detect the analyzed pronunciation disorders. The best multi-class classification using a single Chinese phrase achieves an accuracy of 74.4~percent.


title: Vehicular Connectivity on Complex Trajectories: Roadway-Geometry Aware ISAC Beam-tracking

abstract: In this paper, we propose sensing-assisted beamforming designs for vehicles on arbitrarily shaped roads by relying on integrated sensing and communication (ISAC) signalling.Specifically, we aim to address the limitations of conventional ISAC beam-tracking schemes that do not apply to complex road geometries. To improve the tracking accuracy and communication quality of service (QoS) in vehicle to infrastructure (V2I) networks, it is essential to model the complicated roadway geometry. To that end, we impose the curvilinear coordinate system (CCS) in an interacting multiple model extended Kalman filter (IMM-EKF) framework. By doing so, both the position and the motion of the vehicle on a complicated road can be explicitly modeled and precisely tracked attributing to the benefits from the CCS. Furthermore, an optimization problem is formulated to maximize the array gain through dynamically adjusting the array size and thereby controlling the beamwidth, which takes the performance loss caused by beam misalignment into account.Numerical simulations demonstrate that the roadway geometry-aware ISAC beamforming approach outperforms the communication-only based and ISAC kinematic-only based technique in the tracking performance. Moreover, the effectiveness of the dynamic beamwidth design is also verified by our numerical results.


title: Slow Magnetoacoustic Oscillations in Stellar Coronal Loops

abstract: Slow magnetoacoustic oscillations in stellar coronal loops with gravitational stratification are analyzed with a numerical solution of the boundary-value problem for eigenvalues and eigen functions. In this study, we only focus on the resonant periods. The effects of the gravitational stratification, star mass, loop temperature, and loop length on the properties of slow magnetoacoustic oscillations are investigated. It is shown that the discrepancy between stratified and non-stratified loops is higher in density perturbations than velocity perturbations. When the star has larger mass, higher coronal temperature, and longer loop, the density perturbations in stratified loop are significantly different from the harmonic functions. The periods in the stratified loop are slightly longer than in the non-stratified loop. The periods calculated in our model (14-644 min) are consistent with the periods of stellar quasi-periodic pulsations observed in both soft x-rays (2-70 min) and white lights (8-390 min).


title: Video Capsule Endoscopy and Ingestible Electronics: Emerging Trends in Sensors, Circuits, Materials, Telemetry, Optics, and Rapid Reading Software

abstract: Real-time monitoring of the gastrointestinal tract in a safe and comfortable manner is valuable for the diagnosis and therapy of many diseases. Within this realm, our review captures the trends in ingestible capsule systems with a focus on hardware and software technologies used for capsule endoscopy and remote patient monitoring. We introduce the structure and functions of the gastrointestinal tract, and the FDA guidelines for ingestible wireless telemetric medical devices. We survey the advanced features incorporated in ingestible capsule systems, such as microrobotics, closed-loop feedback, physiological sensing, nerve stimulation, sampling and delivery, panoramic imaging with adaptive frame rates, and rapid reading software. Examples of experimental and commercialized capsule systems are presented with descriptions of their sensors, devices, and circuits for gastrointestinal health monitoring. We also show the recent research in biocompatible materials and batteries, edible electronics, and alternative energy sources for ingestible capsule systems. The results from clinical studies are discussed for the assessment of key performance indicators related to the safety and effectiveness of ingestible capsule procedures. Lastly, the present challenges and outlook are summarized with respect to the risks to health, clinical testing and approval process, and technology adoption by patients and clinicians.


title: Boundedness of Gaussian Bessel Potentials and Bessel Fractional Derivatives on variable Gaussian Besov-Lipschitz spaces

abstract: In this paper we study the regularity properties of the Gaussian Bessel potentials and Gaussian Bessel fractional derivatives on variable Gaussian Besov-Lipschitz spaces $B_{p(\cdot),q(\cdot)}^{\alpha}(\gamma_{d}),$ that were defined in a previous paper \cite{Pinrodurb}, under certain conditions on $p(\cdot)$ and $q(\cdot)$.


title: Efficient LSM-Tree Key-Value Data Management on Hybrid SSD/HDD Zoned Storage

abstract: Zoned storage devices, such as zoned namespace (ZNS) solid-state drives (SSDs) and host-managed shingled magnetic recording (HM-SMR) hard-disk drives (HDDs), expose interfaces for host-level applications to support fine-grained, high-performance storage management. Combining ZNS SSDs and HM-SMR HDDs into a unified hybrid storage system is a natural direction to scale zoned storage at low cost, yet how to effectively incorporate zoned storage awareness into hybrid storage is a non-trivial issue. We make a case for key-value (KV) stores based on log-structured merge trees (LSM-trees) as host-level applications, and present HHZS, a middleware system that bridges an LSM-tree KV store with hybrid zoned storage devices based on hints. HHZS leverages hints issued by the flushing, compaction, and caching operations of the LSM-tree KV store to manage KV objects in placement, migration, and caching in hybrid ZNS SSD and HM-SMR HDD zoned storage. Experiments show that our HHZS prototype, when running on real ZNS SSD and HM-SMR HDD devices, achieves the highest throughput compared with all baselines under various settings.


title: Reheating after relaxation of large cosmological constant

abstract: We present a cosmological model of an early-time scenario that incorporates a relaxation process of the would-be large vacuum energy, followed by a reheating era connecting to the standard hot big bang universe. Avoiding fine-tuning the cosmological constant is achieved by the dynamics of a scalar field whose kinetic term is modulated by an inverse power of spacetime curvature. While it is at work against radiative corrections to the dark energy, this mechanism alone would wipe out not only the vacuum energy but also all other matter contents. Our present work aims to complete the scenario by exploiting a null-energy-condition violating sector whose energy is eventually transferred to a reheating sector. We provide an explicit example of this process and thus a concrete scenario of the cosmic onset that realizes the thermal history of the Universe with a negligible cosmological constant.


title: MOSPAT: AutoML based Model Selection and Parameter Tuning for Time Series Anomaly Detection

abstract: Organizations leverage anomaly and changepoint detection algorithms to detect changes in user behavior or service availability and performance. Many off-the-shelf detection algorithms, though effective, cannot readily be used in large organizations where thousands of users monitor millions of use cases and metrics with varied time series characteristics and anomaly patterns. The selection of algorithm and parameters needs to be precise for each use case: manual tuning does not scale, and automated tuning requires ground truth, which is rarely available. In this paper, we explore MOSPAT, an end-to-end automated machine learning based approach for model and parameter selection, combined with a generative model to produce labeled data. Our scalable end-to-end system allows individual users in large organizations to tailor time-series monitoring to their specific use case and data characteristics, without expert knowledge of anomaly detection algorithms or laborious manual labeling. Our extensive experiments on real and synthetic data demonstrate that this method consistently outperforms using any single algorithm.


title: UMSNet: An Universal Multi-sensor Network for Human Activity Recognition

abstract: Human activity recognition (HAR) based on multimodal sensors has become a rapidly growing branch of biometric recognition and artificial intelligence. However, how to fully mine multimodal time series data and effectively learn accurate behavioral features has always been a hot topic in this field. Practical applications also require a well-generalized framework that can quickly process a variety of raw sensor data and learn better feature representations. This paper proposes a universal multi-sensor network (UMSNet) for human activity recognition. In particular, we propose a new lightweight sensor residual block (called LSR block), which improves the performance by reducing the number of activation function and normalization layers, and adding inverted bottleneck structure and grouping convolution. Then, the Transformer is used to extract the relationship of series features to realize the classification and recognition of human activities. Our framework has a clear structure and can be directly applied to various types of multi-modal Time Series Classification (TSC) tasks after simple specialization. Extensive experiments show that the proposed UMSNet outperforms other state-of-the-art methods on two popular multi-sensor human activity recognition datasets (i.e. HHAR dataset and MHEALTH dataset).


title: Robotic agricultural instrument for automated extraction of nematode cysts and eggs from soil to improve integrated pest management

abstract: Soybeans are an important crop for global food security. Every year, soybean yields are reduced by numerous soybean diseases, particularly the soybean cyst nematode (SCN). It is difficult to visually identify the presence of SCN in the field, let alone its population densities or numbers, as there are no obvious aboveground disease symptoms. The only definitive way to assess SCN population densities is to directly extract the SCN cysts from soil and then extract the eggs from cysts and count them. Extraction is typically conducted in commercial soil analysis laboratories and university plant diagnostic clinics and involves repeated steps of sieving, washing, collecting, grinding, and cleaning. Here we present a robotic instrument to reproduce and automate the functions of the conventional methods to extract nematode cysts from soil and subsequently extract eggs from the recovered nematode cysts. We incorporated mechanisms to actuate the stage system, manipulate positions of individual sieves using the gripper, recover cysts and cyst-sized objects from soil suspended in water, and grind the cysts to release their eggs. All system functions are controlled and operated by a touchscreen interface software. The performance of the robotic instrument is evaluated using soil samples infested with SCN from two farms at different locations and results were comparable to the conventional technique. Our new technology brings the benefits of automation to SCN soil diagnostics, a step towards long-term integrated pest management of this serious soybean pest.


title: Analyzing the Mono- and Cross-Lingual Pretraining Dynamics of Multilingual Language Models

abstract: The emergent cross-lingual transfer seen in multilingual pretrained models has sparked significant interest in studying their behavior. However, because these analyses have focused on fully trained multilingual models, little is known about the dynamics of the multilingual pretraining process. We investigate when these models acquire their in-language and cross-lingual abilities by probing checkpoints taken from throughout XLM-R pretraining, using a suite of linguistic tasks. Our analysis shows that the model achieves high in-language performance early on, with lower-level linguistic skills acquired before more complex ones. In contrast, the point in pretraining when the model learns to transfer cross-lingually differs across language pairs. Interestingly, we also observe that, across many languages and tasks, the final model layer exhibits significant performance degradation over time, while linguistic knowledge propagates to lower layers of the network. Taken together, these insights highlight the complexity of multilingual pretraining and the resulting varied behavior for different languages over time.


title: UNet#: A UNet-like Redesigning Skip Connections for Medical Image Segmentation

abstract: As an essential prerequisite for developing a medical intelligent assistant system, medical image segmentation has received extensive research and concentration from the neural network community. A series of UNet-like networks with encoder-decoder architecture has achieved extraordinary success, in which UNet2+ and UNet3+ redesign skip connections, respectively proposing dense skip connection and full-scale skip connection and dramatically improving compared with UNet in medical image segmentation. However, UNet2+ lacks sufficient information explored from the full scale, which will affect the learning of organs' location and boundary. Although UNet3+ can obtain the full-scale aggregation feature map, owing to the small number of neurons in the structure, it does not satisfy the segmentation of tiny objects when the number of samples is small. This paper proposes a novel network structure combining dense skip connections and full-scale skip connections, named UNet-sharp (UNet\#) for its shape similar to symbol \#. The proposed UNet\# can aggregate feature maps of different scales in the decoder sub-network and capture fine-grained details and coarse-grained semantics from the full scale, which benefits learning the exact location and accurately segmenting the boundary of organs or lesions. We perform deep supervision for model pruning to speed up testing and make it possible for the model to run on mobile devices; furthermore, designing two classification-guided modules to reduce false positives achieves more accurate segmentation results. Various experiments of semantic segmentation and instance segmentation on different modalities (EM, CT, MRI) and dimensions (2D, 3D) datasets, including the nuclei, brain tumor, liver, and lung, demonstrate that the proposed method outperforms state-of-the-art models.


title: Optical Properties of an Axially Symmetric Black Hole in the Rastall Gravity

abstract: This work is devoted to the study of the optical properties of the charged-rotating-NUT-Kiselev (CRNK) black hole in the Rastall theory of gravity. By investigating the motion of photons in the CRNK black hole spacetime in the Rastall gravity we show that the deflection angle of photons due to the gravitational lensing is mostly influenced by the NUT charge, parameter of the equation of state for the quintessence and the quintessential intensity. We observe that the effects of the rest of the spacetime parameters are negligible on the deflection angle. We present the shape of the shadow cast by the CRNK black hole in the Rastall gravity for various values of the spacetime parameters. We demonstrate that spin parameter $a$ of the black hole changes the position and size of the shadow of the black hole very little. While changing the values of the rest of the spacetime parameters can alter the shape and the size of the observed shadow of the black hole significantly. We observe that the radius of the black hole shadow and the deflection angle of a photon are bigger for the CRNK black hole in the Rastall gravity, as compared with the case of the Kerr black hole. Lastly, we show how the spacetime parameters can change the observables $R_s$ and $\delta_s$, being the average radius of the shadow and the distortion parameter that measures the deviation of the shape of the shadow from a perfect circle with radius $R_s$, respectively. Our results show that in most scenarios, for bigger values of $R_s$ we get smaller values of the parameter $\delta_s$.


title: Ranking-Based Siamese Visual Tracking

abstract: Current Siamese-based trackers mainly formulate the visual tracking into two independent subtasks, including classification and localization. They learn the classification subnetwork by processing each sample separately and neglect the relationship among positive and negative samples. Moreover, such tracking paradigm takes only the classification confidence of proposals for the final prediction, which may yield the misalignment between classification and localization. To resolve these issues, this paper proposes a ranking-based optimization algorithm to explore the relationship among different proposals. To this end, we introduce two ranking losses, including the classification one and the IoU-guided one, as optimization constraints. The classification ranking loss can ensure that positive samples rank higher than hard negative ones, i.e., distractors, so that the trackers can select the foreground samples successfully without being fooled by the distractors. The IoU-guided ranking loss aims to align classification confidence scores with the Intersection over Union(IoU) of the corresponding localization prediction for positive samples, enabling the well-localized prediction to be represented by high classification confidence. Specifically, the proposed two ranking losses are compatible with most Siamese trackers and incur no additional computation for inference. Extensive experiments on seven tracking benchmarks, including OTB100, UAV123, TC128, VOT2016, NFS30, GOT-10k and LaSOT, demonstrate the effectiveness of the proposed ranking-based optimization algorithm. The code and raw results are available at https://github.com/sansanfree/RBO.


title: QAOA-in-QAOA: solving large-scale MaxCut problems on small quantum machines

abstract: The design of fast algorithms for combinatorial optimization greatly contributes to a plethora of domains such as logistics, finance, and chemistry. Quantum approximate optimization algorithms (QAOAs), which utilize the power of quantum machines and inherit the spirit of adiabatic evolution, are novel approaches to tackle combinatorial problems with potential runtime speedups. However, hurdled by the limited quantum resources nowadays, QAOAs are infeasible to manipulate large-scale problems. To address this issue, here we revisit the MaxCut problem via the divide-and-conquer heuristic: seek the solutions of subgraphs in parallel and then merge these solutions to obtain the global solution. Due to the $\mathbb{Z}_2$ symmetry in MaxCut, we prove that the merging process can be further cast into a new MaxCut problem and thus be addressed by QAOAs or other MaxCut solvers. With this regard, we propose QAOA-in-QAOA ($\text{QAOA}^2$) to solve arbitrary large-scale MaxCut problems using small quantum machines. We also prove that the approximation ratio of $\text{QAOA}^2$ is lower bounded by 1/2. Experiment results illustrate that under different graph settings, $\text{QAOA}^2$ attains a competitive or even better performance over the best known classical algorithms when the node count is around 2000. Our method can be seamlessly embedded into other advanced strategies to enhance the capability of QAOAs in large-scale combinatorial optimization problems.


title: Accessing DEMP and DVCS at Backward Angles above the Resonance Region

abstract: The proposed measurement is a dedicated study to investigate the exclusive electroproduction process: 1H(e, e'p)X, in the backward angle above the resonance region. Here, the produced particle X (pi0 or gamma) is emitted 180 degrees opposite to the virtual photon momentum. This study will apply the well-known L/T separation method of the electroproduction process to this unexplored backward angle kinematics region. The available theoretical frameworks give parallel interpretations to the backward angle meson production at the proposed kinematics. According to the QCD GPD-like TDA model, backward meson production as the virtual-photon probes the transverse meson cloud structure inside of the nucleon; whereas the hadronic Regge based model describes backward meson production as the interference between nucleon exchange and the meson produced via re-scattering of the nucleon. Testing these two approaches is like testing the onset of quarks and gluon physics, i.e. going deeper into the structure of nucleon to probe its quark and gluon content. Combining knowledge from both frameworks has the potential to provide complementary knowledge to the forward angle physics programs and obtain new physics insights to study the QCD transition from meson-nucleon to quark-hadron degrees of freedom.


title: D4: a Chinese Dialogue Dataset for Depression-Diagnosis-Oriented Chat

abstract: In a depression-diagnosis-directed clinical session, doctors initiate a conversation with ample emotional support that guides the patients to expose their symptoms based on clinical diagnosis criteria. Such a dialogue system is distinguished from existing single-purpose human-machine dialog systems, as it combines task-oriented and chit-chats with uniqueness in dialogue topics and procedures. However, due to the social stigma associated with mental illness, the dialogue data related to depression consultation and diagnosis are rarely disclosed. Based on clinical depression diagnostic criteria ICD-11 and DSM-5, we designed a 3-phase procedure to construct D$^4$: a Chinese Dialogue Dataset for Depression-Diagnosis-Oriented Chat, which simulates the dialogue between doctors and patients during the diagnosis of depression, including diagnosis results and symptom summary given by professional psychiatrists for each conversation. Upon the newly-constructed dataset, four tasks mirroring the depression diagnosis process are established: response generation, topic prediction, dialog summary, and severity classification of depressive episode and suicide risk. Multi-scale evaluation results demonstrate that a more empathy-driven and diagnostic-accurate consultation dialogue system trained on our dataset can be achieved compared to rule-based bots.


title: Byzantine-Robust Federated Learning with Optimal Statistical Rates and Privacy Guarantees

abstract: We propose Byzantine-robust federated learning protocols with nearly optimal statistical rates. In contrast to prior work, our proposed protocols improve the dimension dependence and achieve a tight statistical rate in terms of all the parameters for strongly convex losses. We benchmark against competing protocols and show the empirical superiority of the proposed protocols. Finally, we remark that our protocols with bucketing can be naturally combined with privacy-guaranteeing procedures to introduce security against a semi-honest server. The code for evaluation is provided in https://github.com/wanglun1996/secure-robust-federated-learning.


title: Leptophilic Gauge Bosons at Lepton Beam Dump Experiments

abstract: It has been recently known that we can use beams of future lepton colliders, the International Linear Collider (ILC), the Compact Linear Collider (CLIC), and the muon collider, for beam dump experiments if a shield and a detector are installed behind the beam dump. We study the prospect of searching for leptophilic gauge bosons (LGBs) in association with $U(1)_{L_e-L_\mu}$, $U(1)_{L_e-L_\tau}$, and $U(1)_{L_\mu-L_\tau}$ gauge symmetries at such lepton beam dump experiments. We perform a detailed calculation of the event rates of the LGB events, taking into account bremsstrahlung and pair-annihilation processes. We show that the lepton beam dump experiments at future lepton colliders can reach parameter regions which are not been covered.


title: Charting Galactic Accelerations with Stellar Streams and Machine Learning

abstract: We present a data-driven method for reconstructing the galactic acceleration field from phase-space measurements of stellar streams. Our approach is based on a flexible and differentiable fit to the stream in phase-space, enabling a direct estimate of the acceleration vector along the stream. Reconstruction of the local acceleration field can be applied independently to each of several streams, allowing us to sample the acceleration field due to the underlying galactic potential across a range of scales. Our approach is methodologically different from previous works, since a model for the gravitational potential does not need to be adopted beforehand. Instead, our flexible neural-network-based model treats the stream as a collection of orbits with a locally similar mixture of energies, rather than assuming that the stream delineates a single stellar orbit. Accordingly, our approach allows for distinct regions of the stream to have different mean energies, as is the case for real stellar streams. Once the acceleration vector is sampled along the stream, standard analytic models for the galactic potential can then be rapidly constrained. We find our method recovers the correct parameters for a ground-truth triaxial logarithmic halo potential when applied to simulated stellar streams. Alternatively, we demonstrate that a flexible potential can be constrained with a neural network, though standard multipole expansions can also be constrained. Our approach is applicable to simple and complicated gravitational potentials alike, and enables potential reconstruction from a fully data-driven standpoint using measurements of slowly phase-mixing tidal debris.


title: Isometric immersions of RCD$(K,N)$ spaces via heat kernels

abstract: Given an RCD$(K,N)$ space $({X},\mathsf{d},\mathfrak{m})$, one can use its heat kernel $\rho$ to map it into the $L^2$ space by a locally Lipschitz map $\Phi_t(x):=\rho(x,\cdot,t)$. The space $(X,\mathsf{d},\mathfrak{m})$ is said to be an isometrically heat kernel immersing space, if each $\Phi_t$ is an isometric immersion {}{after a normalization}. A main result states that any compact isometrically heat kernel immersing RCD$(K,N)$ space is isometric to an unweighted closed smooth Riemannian manifold. This is justified by a more general result: if a compact non-collapsed RCD$(K, N)$ space has an isometrically immersing eigenmap, then the space is isometric to an unweighted closed Riemannian manifold, which greatly improves a regularity result in \cite{H21} by Honda. As an application of these results, we give a $C^\infty$-compactness theorem for a certain class of Riemannian manifolds with a curvature-dimension-diameter bound and an isometrically immersing eigenmap.


title: Conceptual Design Report of DaRveX: Decay at Rest $\nu_e$ + Lead Cross Section Measurement at J-PARC MLF

abstract: DaRveX stands for "Decay at Rest $\nu_e$-Pb cross (X) section measurement". So far, there has not been good target to detect low energy $\nu_e$. Lead is expected to be an excellent $\nu_e$ target because the cross section is expected to be very large and the delayed coincidence technique can be used using final state neutron(s). However, the cross section have not been measured yet. If it is measured, it opens a new window to the future neutrino research field, such as low energy $\nu_e$ oscillation measurements, flavor specific detection of the supernova explosion $\nu_e$ and understanding of $\nu_e$-nucleus interactions. This report explains a conceptual design of DaRveX experiment, which measures cross section of $\nu_e$+Pb charged current interaction, $\nu_e$(E~30MeV)+Pb $\to$ $e^-$+$xn$+Bi; ($x$=1 or 2), using $\nu_e$ from $\mu^+$ decay at rest at J-PARC MLF. The energy and direction of the final state $e^-$ will be measured by using 1-ton scale lead-scintillator sandwich detector. With two years of data taking, the cross section is expected to be measured with 20% of precision.


title: Understanding temperature-dependent SU($3$) spin dynamics in the $S=1$ antiferromagnet Ba$_2$FeSi$_2$O$_7$

abstract: Quantum magnets admit more than one classical limit and $N$-level systems with strong single-ion anisotropy are expected to be described by a classical approximation based on SU($N$) coherent states. Here we test this hypothesis by modeling finite temperature inelastic neutron scattering (INS) data of the effective spin-one antiferromagnet \bfso{}. The measured dynamic structure factor is calculated with a generalized Landau-Lifshitz dynamics for SU($3$) spins. Unlike the traditional classical limit based on SU($2$) coherent states, the results obtained with classical SU($3$) spins are in good agreement with the measured temperature-dependent spectrum. The SU($3$) approach developed here provides a general framework to understand the broad class of materials comprising weakly coupled antiferromagnetic dimers, trimers, or tetramers, and magnets with strong single-ion anisotropy.


title: Learning Context-Aware Service Representation for Service Recommendation in Workflow Composition

abstract: As increasingly more software services have been published onto the Internet, it remains a significant challenge to recommend suitable services to facilitate scientific workflow composition. This paper proposes a novel NLP-inspired approach to recommending services throughout a workflow development process, based on incrementally learning latent service representation from workflow provenance. A workflow composition process is formalized as a step-wise, context-aware service generation procedure, which is mapped to next-word prediction in a natural language sentence. Historical service dependencies are extracted from workflow provenance to build and enrich a knowledge graph. Each path in the knowledge graph reflects a scenario in a data analytics experiment, which is analogous to a sentence in a conversation. All paths are thus formalized as composable service sequences and are mined, using various patterns, from the established knowledge graph to construct a corpus. Service embeddings are then learned by applying deep learning model from the NLP field. Extensive experiments on the real-world dataset demonstrate the effectiveness and efficiency of the approach.


title: Multi-Augmentation for Efficient Visual Representation Learning for Self-supervised Pre-training

abstract: In recent years, self-supervised learning has been studied to deal with the limitation of available labeled-dataset. Among the major components of self-supervised learning, the data augmentation pipeline is one key factor in enhancing the resulting performance. However, most researchers manually designed the augmentation pipeline, and the limited collections of transformation may cause the lack of robustness of the learned feature representation. In this work, we proposed Multi-Augmentations for Self-Supervised Representation Learning (MA-SSRL), which fully searched for various augmentation policies to build the entire pipeline to improve the robustness of the learned feature representation. MA-SSRL successfully learns the invariant feature representation and presents an efficient, effective, and adaptable data augmentation pipeline for self-supervised pre-training on different distribution and domain datasets. MA-SSRL outperforms the previous state-of-the-art methods on transfer and semi-supervised benchmarks while requiring fewer training epochs.


title: Constrained Error Pattern Generation for GRAND

abstract: Maximum-likelihood (ML) decoding can be used to obtain the optimal performance of error correction codes. However, the size of the search space and consequently the decoding complexity grows exponentially, making it impractical to be employed for long codes. In this paper, we propose an approach to constrain the search space for error patterns under a recently introduced near ML decoding scheme called guessing random additive noise decoding (GRAND). In this approach, the syndrome-based constraints which divide the search space into disjoint sets are progressively evaluated. By employing $p$ constraints extracted from the parity check matrix, the average number of queries reduces by a factor of $2^p$ while the error correction performance remains intact.


title: A generalization of the Schwarz lemma for transversally harmonic maps

abstract: In this paper, we consider transversally harmonic maps between Riemannian manifolds with Riemannian foliations. In terms of the Bochner techniques and sub-Laplacian comparison theorem, we are able to establish a generalization of the Schwarz lemma for transversally harmonic maps of bounded generalized transversal dilatation. In addition, we also obtain a Schwarz type lemma for transversally holomorphic maps between K\"ahler foliations.


title: Constrained Monotonic Neural Networks

abstract: Wider adoption of neural networks in many critical domains such as finance and healthcare is being hindered by the need to explain their predictions and to impose additional constraints on them. Monotonicity constraint is one of the most requested properties in real-world scenarios and is the focus of this paper. One of the oldest ways to construct a monotonic fully connected neural network is to constrain signs on its weights. Unfortunately, this construction does not work with popular non-saturated activation functions as it can only approximate convex functions. We show this shortcoming can be fixed by constructing two additional activation functions from a typical unsaturated monotonic activation function and employing each of them on the part of neurons. Our experiments show this approach of building monotonic neural networks has better accuracy when compared to other state-of-the-art methods, while being the simplest one in the sense of having the least number of parameters, and not requiring any modifications to the learning procedure or post-learning steps. Finally, we prove it can approximate any continuous monotone function on a compact subset of $\mathbb{R}^n$.


title: Numerical computation for the exact distribution of Roy's largest root statistic under linear alternative

abstract: This paper discusses the computation of exact powers for Roy's test in multivariate analysis of variance~(MANOVA). We derive an exact expression for the largest eigenvalue of a singular noncentral Beta matrix in terms of the product of zonal polynomials. The numerical computation for that distribution is conducted by an algorithm that expands the product of zonal polynomials as a linear combination of zonal polynomials. Furthermore, we provide an exact distribution of the largest eigenvalue in a form that is convenient for numerical calculations under the linear alternative.


title: Statistical complexity and the road to equilibrium in many-body chaotic quantum systems

abstract: In this work we revisit the problem of equilibration in isolated many-body interacting quantum systems. We pay particular attention to quantum chaotic Hamiltonians, and rather than focusing on the properties of the asymptotic states and how they adhere to the predictions of the Eigenstate Thermalization Hypothesis, we focus on the equilibration process itself, i.e., \emph{the road to equilibrium}. Along the road to equilibrium the diagonal ensembles obey an emergent form of the second law of thermodynamics and we provide an information theoretic proof of this fact. With this proof at hand we show that the road to equilibrium is nothing but a hierarchy in time of diagonal ensembles. Furthermore, introducing the notions of statistical complexity and the entropy-complexity plane, we investigate the uniqueness of the road to equilibrium in a generic many-body system by comparing its trajectories in the entropy-complexity plane to those generated by a random Hamiltonian. Finally by treating the random Hamiltonian as a perturbation we analyzed the stability of entropy-complexity trajectories associated with the road to equilibrium for a chaotic Hamiltonian and different types of initial states.


title: Weighted badly approximable complex vectors and bounded orbits of certain diagonalizable flows

abstract: We show an analogue of a theorem of An, Ghosh, Guan, and Ly on weighted badly approximable vectors for totally imaginary number fields. We show that for $G=\mathrm{SL}_2(\mathbb{C})\times\dots\times\mathrm{SL}_2(\mathbb{C})$ and $\Gamma<G$ a lattice subgroup, the points of $G/\Gamma$ with bounded orbits under a one-parameter Ad-semisimple subgroup of $G$ form a hyperplane-absolute-winning set. As an application, we also provide a generalization of a result of Esdahl-Schou and Kristensen about the set of badly approximable complex numbers.


title: Wireless Ad Hoc Federated Learning: A Fully Distributed Cooperative Machine Learning

abstract: Privacy-sensitive data is stored in autonomous vehicles, smart devices, or sensor nodes that can move around with making opportunistic contact with each other. Federation among such nodes was mainly discussed in the context of federated learning with a centralized mechanism in many works. However, because of multi-vendor issues, those nodes do not want to rely on a specific server operated by a third party for this purpose. In this paper, we propose a wireless ad hoc federated learning (WAFL) -- a fully distributed cooperative machine learning organized by the nodes physically nearby. WAFL can develop generalized models from Non-IID datasets stored in distributed nodes locally by exchanging and aggregating them with each other over opportunistic node-to-node contacts. In our benchmark-based evaluation with various opportunistic networks, WAFL has achieved higher accuracy of 94.8-96.3% than the self-training case of 84.7%. All our evaluation results show that WAFL can train and converge the model parameters from highly-partitioned Non-IID datasets over opportunistic networks without any centralized mechanisms.


title: Renormalization of excitonic properties by polar phonons

abstract: We employ quasiparticle path integral molecular dynamics to study how the excitonic properties of model semiconductors are altered by electron-phonon coupling. We describe ways within a path integral representation of the system to evaluate the renormalized mass, binding energy, and radiative recombination rate of excitons in the presence of a fluctuating lattice. To illustrate this approach, we consider Fr\"ohlich-type electron-phonon interactions and employ an imaginary time influence functional to incorporate phonon-induced effects nonperturbatively. The effective mass and binding energies are compared with perturbative and variational approaches, which provide qualitatively consistent trends. We evaluate electron-hole recombination rates as mediated through both trap-assisted and bimolecular processes, developing a consistent statistical mechanical approach valid in the reaction limited regime. These calculations demonstrate how phonons screen electron-hole interactions, generically reducing exciton binding energies and increasing their radiative lifetimes.


title: Attributing AUC-ROC to Analyze Binary Classifier Performance

abstract: Area Under the Receiver Operating Characteristic Curve (AUC-ROC) is a popular evaluation metric for binary classifiers. In this paper, we discuss techniques to segment the AUC-ROC along human-interpretable dimensions. AUC-ROC is not an additive/linear function over the data samples, therefore such segmenting the overall AUC-ROC is different from tabulating the AUC-ROC of data segments. To segment the overall AUC-ROC, we must first solve an \emph{attribution} problem to identify credit for individual examples. We observe that AUC-ROC, though non-linear over examples, is linear over \emph{pairs} of examples. This observation leads to a simple, efficient attribution technique for examples (example attributions), and for pairs of examples (pair attributions). We automatically slice these attributions using decision trees by making the tree predict the attributions; we use the notion of honest estimates along with a t-test to mitigate false discovery. Our experiments with the method show that an inferior model can outperform a superior model (trained to optimize a different training objective) on the inferior model's own training objective, a manifestation of Goodhart's Law. In contrast, AUC attributions enable a reasonable comparison. Example attributions can be used to slice this comparison. Pair attributions are used to categorize pairs of items -- one positively labeled and one negatively -- that the model has trouble separating. These categories identify the decision boundary of the classifier and the headroom to improve AUC.


title: Fine-grained Poisoning Attack to Local Differential Privacy Protocols for Mean and Variance Estimation

abstract: Although local differential privacy (LDP) protects individual users' data from inference by an untrusted data curator, recent studies show that an attacker can launch a data poisoning attack from the user side to inject carefully-crafted bogus data into the LDP protocols in order to maximally skew the final estimate by the data curator. In this work, we further advance this knowledge by proposing a new fine-grained attack, which allows the attacker to fine-tune and simultaneously manipulate mean and variance estimations that are popular analytical tasks for many real-world applications. To accomplish this goal, the attack leverages the characteristics of LDP to inject fake data into the output domain of the local LDP instance. We call our attack the output poisoning attack (OPA). We observe a security-privacy consistency where a small privacy loss enhances the security of LDP, which contradicts the known security-privacy trade-off from prior work. We further study the consistency and reveal a more holistic view of the threat landscape of data poisoning attacks on LDP. We comprehensively evaluate our attack against a baseline attack that intuitively provides false input to LDP. The experimental results show that OPA outperforms the baseline on three real-world datasets. We also propose a novel defense method that can recover the result accuracy from polluted data collection and offer insight into the secure LDP design.


title: Smart Grid: Cyber Attacks, Critical Defense Approaches, and Digital Twin

abstract: As a national critical infrastructure, the smart grid has attracted widespread attention for its cybersecurity issues. The development towards an intelligent, digital, and Internetconnected smart grid has attracted external adversaries for malicious activities. It is necessary to enhance its cybersecurity by either improving the existing defense approaches or introducing novel developed technologies to the smart grid context. As an emerging technology, digital twin (DT) is considered as an enabler for enhanced security. However, the practical implementation is quite challenging. This is due to the knowledge barriers among smart grid designers, security experts, and DT developers. Each single domain is a complicated system covering various components and technologies. As a result, works are needed to sort out relevant contents so that DT can be better embedded in the security architecture design of smart grid. In order to meet this demand, our paper covers the above three domains, i.e., smart grid, cybersecurity, and DT. Specifically, the paper i) introduces the background of the smart grid; ii) reviews external cyber attacks from attack incidents and attack methods; iii) introduces critical defense approaches in industrial cyber systems, which include device identification, vulnerability discovery, intrusion detection systems (IDSs), honeypots, attribution, and threat intelligence (TI); iv) reviews the relevant content of DT, including its basic concepts, applications in the smart grid, and how DT enhances the security. In the end, the paper puts forward our security considerations on the future development of DT-based smart grid. The survey is expected to help developers break knowledge barriers among smart grid, cybersecurity, and DT, and provide guidelines for future security design of DT-based smart grid.


title: LOCUS 2.0: Robust and Computationally Efficient Lidar Odometry for Real-Time Underground 3D Mapping

abstract: Lidar odometry has attracted considerable attention as a robust localization method for autonomous robots operating in complex GNSS-denied environments. However, achieving reliable and efficient performance on heterogeneous platforms in large-scale environments remains an open challenge due to the limitations of onboard computation and memory resources needed for autonomous operation. In this work, we present LOCUS 2.0, a robust and computationally-efficient \lidar odometry system for real-time underground 3D mapping. LOCUS 2.0 includes a novel normals-based \morrell{Generalized Iterative Closest Point (GICP)} formulation that reduces the computation time of point cloud alignment, an adaptive voxel grid filter that maintains the desired computation load regardless of the environment's geometry, and a sliding-window map approach that bounds the memory consumption. The proposed approach is shown to be suitable to be deployed on heterogeneous robotic platforms involved in large-scale explorations under severe computation and memory constraints. We demonstrate LOCUS 2.0, a key element of the CoSTAR team's entry in the DARPA Subterranean Challenge, across various underground scenarios. We release LOCUS 2.0 as an open-source library and also release a \lidar-based odometry dataset in challenging and large-scale underground environments. The dataset features legged and wheeled platforms in multiple environments including fog, dust, darkness, and geometrically degenerate surroundings with a total of $11~h$ of operations and $16~km$ of distance traveled.


title: AFNet-M: Adaptive Fusion Network with Masks for 2D+3D Facial Expression Recognition

abstract: 2D+3D facial expression recognition (FER) can effectively cope with illumination changes and pose variations by simultaneously merging 2D texture and more robust 3D depth information. Most deep learning-based approaches employ the simple fusion strategy that concatenates the multimodal features directly after fully-connected layers, without considering the different degrees of significance for each modality. Meanwhile, how to focus on both 2D and 3D local features in salient regions is still a great challenge. In this letter, we propose the adaptive fusion network with masks (AFNet-M) for 2D+3D FER. To enhance 2D and 3D local features, we take the masks annotating salient regions of the face as prior knowledge and design the mask attention module (MA) which can automatically learn two modulation vectors to adjust the feature maps. Moreover, we introduce a novel fusion strategy that can perform adaptive fusion at convolutional layers through the designed importance weights computing module (IWC). Experimental results demonstrate that our AFNet-M achieves the state-of-the-art performance on BU-3DFE and Bosphorus datasets and requires fewer parameters in comparison with other models.


title: Transition to Linearity of General Neural Networks with Directed Acyclic Graph Architecture

abstract: In this paper we show that feedforward neural networks corresponding to arbitrary directed acyclic graphs undergo transition to linearity as their "width" approaches infinity. The width of these general networks is characterized by the minimum in-degree of their neurons, except for the input and first layers. Our results identify the mathematical structure underlying transition to linearity and generalize a number of recent works aimed at characterizing transition to linearity or constancy of the Neural Tangent Kernel for standard architectures.


title: Quadratic models for understanding catapult dynamics of neural networks

abstract: While neural networks can be approximated by linear models as their width increases, certain properties of wide neural networks cannot be captured by linear models. In this work we show that recently proposed Neural Quadratic Models can exhibit the "catapult phase" [Lewkowycz et al. 2020] that arises when training such models with large learning rates. We then empirically show that the behaviour of neural quadratic models parallels that of neural networks in generalization, especially in the catapult phase regime. Our analysis further demonstrates that quadratic models can be an effective tool for analysis of neural networks.


title: Meta Policy Learning for Cold-Start Conversational Recommendation

abstract: Conversational recommender systems (CRS) explicitly solicit users' preferences for improved recommendations on the fly. Most existing CRS solutions count on a single policy trained by reinforcement learning for a population of users. However, for users new to the system, such a global policy becomes ineffective to satisfy them, i.e., the cold-start challenge. In this paper, we study CRS policy learning for cold-start users via meta-reinforcement learning. We propose to learn a meta policy and adapt it to new users with only a few trials of conversational recommendations. To facilitate fast policy adaptation, we design three synergetic components. Firstly, we design a meta-exploration policy dedicated to identifying user preferences via a few exploratory conversations, which accelerates personalized policy adaptation from the meta policy. Secondly, we adapt the item recommendation module for each user to maximize the recommendation quality based on the collected conversation states during conversations. Thirdly, we propose a Transformer-based state encoder as the backbone to connect the previous two components. It provides comprehensive state representations by modeling complicated relations between positive and negative feedback during the conversation. Extensive experiments on three datasets demonstrate the advantage of our solution in serving new users, compared with a rich set of state-of-the-art CRS solutions.


title: Study of Interaction and Complete Merging of Binary Cyclones Using Complex Networks

abstract: Cyclones are amongst the most hazardous extreme weather events on Earth. When two co-rotating cyclones come in close proximity, a possibility of complete merger (CM) arises due to their interactions. However, identifying the transitions in the interaction of binary cyclones and predicting the merger is challenging for weather forecasters. In the present study, we suggest an innovative approach to understand the evolving vortical interactions between the cyclones during two such CM events using time-evolving induced velocity based unweighted directed networks. We find that network-based indicators, namely, in-degree and out-degree, can quantify the changes during the interaction between two cyclones and are better candidates than the traditionally used separation distance to classify the interaction stages before a CM. The network indicators also help to identify the dominating cyclone during the period of interaction and quantify the variation of the strength of the dominating and merged cyclones. Finally, we show that the network measures also provide an early indication of the CM event well before its occurrence.


title: Hierarchical Planning Through Goal-Conditioned Offline Reinforcement Learning

abstract: Offline Reinforcement learning (RL) has shown potent in many safe-critical tasks in robotics where exploration is risky and expensive. However, it still struggles to acquire skills in temporally extended tasks. In this paper, we study the problem of offline RL for temporally extended tasks. We propose a hierarchical planning framework, consisting of a low-level goal-conditioned RL policy and a high-level goal planner. The low-level policy is trained via offline RL. We improve the offline training to deal with out-of-distribution goals by a perturbed goal sampling process. The high-level planner selects intermediate sub-goals by taking advantages of model-based planning methods. It plans over future sub-goal sequences based on the learned value function of the low-level policy. We adopt a Conditional Variational Autoencoder to sample meaningful high-dimensional sub-goal candidates and to solve the high-level long-term strategy optimization problem. We evaluate our proposed method in long-horizon driving and robot navigation tasks. Experiments show that our method outperforms baselines with different hierarchical designs and other regular planners without hierarchy in these complex tasks.


title: The monopole-dimer model on Cartesian products of plane graphs

abstract: The monopole-dimer model is a signed variant of the monomer-dimer model which has determinantal structure. We extend the monopole-dimer model for planar graphs (Math. Phys. Anal. Geom., 2015) to Cartesian products thereof and show that the partition function of this model can be expressed as a determinant of a generalised signed adjacency matrix. We then show that the partition function is independent of the orientations of the planar graphs so long as the orientations are Pfaffian. When these planar graphs are bipartite, we show that the computation of the partition function becomes especially simple. We then give an explicit product formula for the partition function of three-dimensional grid graphs a la Kasteleyn and Temperley--Fischer, which turns out to be fourth power of a polynomial when all grid lengths are even. Finally, we generalise this product formula to $d$ dimensions, again obtaining an explicit product formula. We conclude with a discussion on asymptotic formulas for the free energy and monopole densities.


title: On large externally definable sets in NIP

abstract: We study cofinal systems of finite subsets of $\omega_1$. We show that while such systems can be NIP, they cannot be defined in an NIP structure. We deduce a positive answer to a question of Chernikov and Simon from 2013: in an NIP theory, any uncountable externally definable set contains an infinite definable subset. A similar result holds for larger cardinals.


title: Interval Optimization Problems on Hadamard manifolds

abstract: In this article, we introduce the interval optimization problems (IOPs) on Hadamard manifolds as well as study the relationship between them and the interval variational inequalities. To achieve the theoretical results, we build up some new concepts about $gH$-directional derivative and $gH$-G\^ateaux differentiability of interval valued functions and their properties on the Hadamard manifolds. The obtained results pave a way to further study on Riemannian interval optimization problems (RIOPs).


title: Accelerating Frank-Wolfe via Averaging Step Directions

abstract: The Frank-Wolfe method is a popular method in sparse constrained optimization, due to its fast per-iteration complexity. However, the tradeoff is that its worst case global convergence is comparatively slow, and importantly, is fundamentally slower than its flow rate--that is to say, the convergence rate is throttled by discretization error. In this work, we consider a modified Frank-Wolfe where the step direction is a simple weighted average of past oracle calls. This method requires very little memory and computational overhead, and provably decays this discretization error term. Numerically, we show that this method improves the convergence rate over several problems, especially after the sparse manifold has been detected. Theoretically, we show the method has an overall global convergence rate of $O(1/k^p)$, where $0< p < 1$; after manifold identification, this rate speeds to $O(1/k^{3p/2})$. We also observe that the method achieves this accelerated rate from a very early stage, suggesting a promising mode of acceleration for this family of methods.


title: Influence of perspective taking through robotic virtual agents on prosocial behavior

abstract: Perspective taking, which allows people to imagine another's thinking and goals, is known to be an effective method for promoting prosocial behaviors in human-computer interactions. However, most of the previous studies have focused on simulating human-human interactions in the real world by offering participants experiences related to various moral tasks through the use of human-like virtual agents. In this study, we investigated whether taking the perspective of a different robot in a robot-altruistic task would influence the social behaviors of participants in a dictator game. Our findings showed that participants who watched the help-receiver view exhibited more altruistic behaviors toward a robot than those who watched the help-provider view. We also found that, after watching robots from two different viewpoints in the task, participants did not change their behavior toward another participant.