title: A New Dataset and A Baseline Model for Breast Lesion Detection in Ultrasound Videos

abstract: Breast lesion detection in ultrasound is critical for breast cancer diagnosis. Existing methods mainly rely on individual 2D ultrasound images or combine unlabeled video and labeled 2D images to train models for breast lesion detection. In this paper, we first collect and annotate an ultrasound video dataset (188 videos) for breast lesion detection. Moreover, we propose a clip-level and video-level feature aggregated network (CVA-Net) for addressing breast lesion detection in ultrasound videos by aggregating video-level lesion classification features and clip-level temporal features. The clip-level temporal features encode local temporal information of ordered video frames and global temporal information of shuffled video frames. In our CVA-Net, an inter-video fusion module is devised to fuse local features from original video frames and global features from shuffled video frames, and an intra-video fusion module is devised to learn the temporal information among adjacent video frames. Moreover, we learn video-level features to classify the breast lesions of the original video as benign or malignant lesions to further enhance the final breast lesion detection performance in ultrasound videos. Experimental results on our annotated dataset demonstrate that our CVA-Net clearly outperforms state-of-the-art methods. The corresponding code and dataset are publicly available at \url{https://github.com/jhl-Det/CVA-Net}.


title: More Constraints on the Georgi-Machacek Model

abstract: In this work, we investigate the parameter space of the Georgi-Machacek (GM) model, where we consider many theoretical and experimental constraints such as the perturbativity, vacuum stability, unitarity, electroweak precision tests, the Higgs di-photon decay, the Higgs total decay width and the LHC measurements of the signal strengths of the SM-like Higgs boson $h$ in addition to the constraints from doubly charged Higgs bosons and Drell-Yan di-photon production and the indirect constraint from the $b\to s$ transition processes. We investigate also the possibility that the electroweak vacuum could be destabilized by unwanted wrong minima that may violate the CP and/or the electric charge symmetries. We found that about 40 \% of the parameter space that fulfills the above mentioned constraints; are excluded by these unwanted minima. In addition, we found that the negative searches for a heavy resonance could exclude a significant part of the viable parameter space; and future searches could exclude more regions in the parameter space.


title: Enriching Wikidata with Linked Open Data

abstract: Large public knowledge graphs, like Wikidata, contain billions of statements about tens of millions of entities, thus inspiring various use cases to exploit such knowledge graphs. However, practice shows that much of the relevant information that fits users' needs is still missing in Wikidata, while current linked open data (LOD) tools are not suitable to enrich large graphs like Wikidata. In this paper, we investigate the potential of enriching Wikidata with structured data sources from the LOD cloud. We present a novel workflow that includes gap detection, source selection, schema alignment, and semantic validation. We evaluate our enrichment method with two complementary LOD sources: a noisy source with broad coverage, DBpedia, and a manually curated source with a narrow focus on the art domain, Getty. Our experiments show that our workflow can enrich Wikidata with millions of novel statements from external LOD sources with high quality. Property alignment and data quality are key challenges, whereas entity alignment and source selection are well-supported by existing Wikidata mechanisms. We make our code and data available to support future work.


title: Morse hyper-graphs and abstract weak orbit spaces of semi-decompositions

abstract: We introduce topological invariants of semi-decompositions (e.g. filtrations, semi-group actions, multi-valued dynamical systems, combinatorial dynamical systems) on a topological space to analyze semi-decompositions from a dynamical systems point of view. In fact, we construct Morse hyper-graphs and abstract weak elements of semi-decompositions. Moreover, the Morse hyper-graphs of the set of sublevel sets of a Morse function of a compact manifold is the Reeb graph of such function as abstract multi-graphs. The abstract weak element space for a simplicial complex is the face poset. The abstract weak element spaces of positive orbits of acyclic directed graphs are their abstract directed multi-graphs.


title: Fully-gapped superconducting state in interstitial-carbon-doped Zr5Pt3

abstract: We report a comprehensive study of the Zr$_5$Pt$_3$C$_x$ superconductors, with interstitial carbon comprised between 0 and 0.3. At a macroscopic level, their superconductivity, with $T_c$ ranging from 4.5 to 6.3 K, was investigated via electrical-resistivity-, magnetic-susceptibility-, and specific-heat measurements. The upper critical fields $\mu_0H_\mathrm{c2}$ $\sim$ 7 T were determined mostly from measurements of the electrical resistivity in applied magnetic fields. The microscopic electronic properties were investigated by means of muon-spin rotation and relaxation ($\mu$SR) and nuclear magnetic resonance (NMR) techniques. In the normal state, NMR relaxation data indicate an almost ideal metallic behavior, confirmed by band-structure calculations, which suggest a relatively high electronic density of states at the Fermi level, dominated by the Zr 4$d$ orbitals. The low-temperature superfluid density, obtained via transverse-field $\mu$SR, suggests a fully-gapped superconducting state in Zr$_5$Pt$_3$ and Zr$_5$Pt$_3$C$_{0.3}$, with a zero-temperature gap $\Delta_0$ = 1.20 and 0.60 meV and a magnetic penetration depth $\lambda_0$ = 333 and 493 nm, respectively. The exponential dependence of the NMR relaxation rates below $T_c$ further supports a nodeless superconductivity. The absence of spontaneous magnetic fields below the onset of superconductivity, as determined from zero-field $\mu$SR measurements, confirms a preserved time-reversal symmetry in the superconducting state of Zr$_5$Pt$_3$C$_x$. In contrast to a previous study, our $\mu$SR and NMR results suggest a conventional superconductivity in the Zr$_5$Pt$_3$C$_x$ family, independent of the C content.


title: Error Analysis of Cooperative NOMA with Practical Constraints: Hardware-Impairment, Imperfect SIC and CSI

abstract: Non-orthogonal multiple access (NOMA) has been a strong candidate to support massive connectivity in future wireless networks. In this regard, its implementation into cooperative relaying, named cooperative-NOMA (CNOMA), has received tremendous attention by researchers. However, most of the existing CNOMA studies have failed to address practical constraints since they assume ideal conditions. Particularly, error performance of CNOMA schemes with imperfections has not been investigated, yet. In this letter, we provide an analytical framework for error performance of CNOMA schemes under practical assumptions where we take into account imperfect successive interference canceler (SIC), imperfect channel estimation (ICSI), and hardware impairments (HWI) at the transceivers. We derive bit error rate (BER) expressions in CNOMA schemes whether the direct links between source and users exist or not which is, to the best of the authors' knowledge, the first study in the open literature. For comparisons, we also provide BER expression for downlink NOMA with practical constraints which has also not been given in literature, yet. The theoretical BER expressions are validated with computer simulations where the perfect-match is observed. Finally, we discuss the effects of the system parameters (e.g., power allocation, HWI level) on the performance of CNOMA schemes to reveal fruitful insights for the society.


title: ChrSNet: Chromosome Straightening using Self-attention Guided Networks

abstract: Karyotyping is an important procedure to assess the possible existence of chromosomal abnormalities. However, because of the non-rigid nature, chromosomes are usually heavily curved in microscopic images and such deformed shapes hinder the chromosome analysis for cytogeneticists. In this paper, we present a self-attention guided framework to erase the curvature of chromosomes. The proposed framework extracts spatial information and local textures to preserve banding patterns in a regression module. With complementary information from the bent chromosome, a refinement module is designed to further improve fine details. In addition, we propose two dedicated geometric constraints to maintain the length and restore the distortion of chromosomes. To train our framework, we create a synthetic dataset where curved chromosomes are generated from the real-world straight chromosomes by grid-deformation. Quantitative and qualitative experiments are conducted on synthetic and real-world data. Experimental results show that our proposed method can effectively straighten bent chromosomes while keeping banding details and length.


title: Generating Counterfactual Hard Negative Samples for Graph Contrastive Learning

abstract: Graph contrastive learning has emerged as a powerful tool for unsupervised graph representation learning. The key to the success of graph contrastive learning is to acquire high-quality positive and negative samples as contrasting pairs for the purpose of learning underlying structural semantics of the input graph. Recent works usually sample negative samples from the same training batch with the positive samples, or from an external irrelevant graph. However, a significant limitation lies in such strategies, which is the unavoidable problem of sampling false negative samples. In this paper, we propose a novel method to utilize \textbf{C}ounterfactual mechanism to generate artificial hard negative samples for \textbf{G}raph \textbf{C}ontrastive learning, namely \textbf{CGC}, which has a different perspective compared to those sampling-based strategies. We utilize counterfactual mechanism to produce hard negative samples, which ensures that the generated samples are similar to, but have labels that different from the positive sample. The proposed method achieves satisfying results on several datasets compared to some traditional unsupervised graph learning methods and some SOTA graph contrastive learning methods. We also conduct some supplementary experiments to give an extensive illustration of the proposed method, including the performances of CGC with different hard negative samples and evaluations for hard negative samples generated with different similarity measurements.


title: A Banach space $C(K)$ reading the dimension of $K$

abstract: Assuming Jensen's diamond principle ($\diamondsuit$) we construct for every natural number $n>0$ a compact Hausdorff space $K$ such that whenever the Banach spaces $C(K)$ and $C(L)$ are isomorphic for some compact Hausdorff $L$, then the covering dimension of $L$ is equal to $n$. The constructed space $K$ is separable and connected, and the Banach space $C(K)$ has few operators i.e. every bounded linear operator $T:C(K)\rightarrow C(K)$ is of the form $T(f)=fg+S(f)$, where $g\in C(K)$ and $S$ is weakly compact.


title: SASV Based on Pre-trained ASV System and Integrated Scoring Module

abstract: Based on the assumption that there is a correlation between anti-spoofing and speaker verification, a Total-Divide-Total integrated Spoofing-Aware Speaker Verification (SASV) system based on pre-trained automatic speaker verification (ASV) system and integrated scoring module is proposed and submitted to the SASV 2022 Challenge. The training and scoring of ASV and anti-spoofing countermeasure (CM) in current SASV systems are relatively independent, ignoring the correlation. In this paper, by leveraging the correlation between the two tasks, an integrated SASV system can be obtained by simply training a few more layers on the basis of the baseline pre-trained ASV subsystem. The features in pre-trained ASV system are utilized for logical access spoofing speech detection. Further, speaker embeddings extracted by the pre-trained ASV system are used to improve the performance of the CM. The integrated scoring module takes the embeddings of the ASV and anti-spoofing branches as input and preserves the correlation between the two tasks through matrix operations to produce integrated SASV scores. Submitted primary system achieved equal error rate (EER) of 3.07\% on the development dataset of the SASV 2022 Challenge and 4.30\% on the evaluation part, which is a 25\% improvement over the baseline systems.


title: Space Broadband Access: The Race Has Just Begun

abstract: Recent years have witnessed an exponential growth of the commercial space industry, including rocket launch, satellite network deployment, private space travel, and even extraterrestrial colonization. Several trends are predicted in this unprecedented transition to an era of space-enabled broadband access.


title: UWB patch antenna design and realization in the bandwidth 780 MHz to 4.22 GHz

abstract: The proposed UWB antenna covers mobile communications (GSM, EDG, UMTS(3G), LTE(4G)) and wireless networks (WIFI, WiMAX), within a theoretical bandwidth defined from 780MHz to 4.22GHz. The UWB antenna is designed and realized on a FR-4 substrate with an electrical permittivity of 4.4. It presents a 98.75% average analytical efficiency and an omnidirectional radiation within the previous bandwidth. The impedance excitation port is fixed at 50 Ohm according with the SMA impedance used in the practical part. The measured results are in good agreement with those obtained using CST and ADS softwares. The measured bandwidth, defined from 980MHz to 4.2GHz, presents an efficiency of 94.14%. Furthermore, the practical radiation diagram and the excitation port impedance stay the same as that the simulation one.


title: An Analytical Study on Functional Split in Martian 3D Networks

abstract: As space agencies are planning manned missions to reach Mars, researchers need to pave the way for supporting astronauts during their sojourn. This will also be achieved by providing broadband and low-latency connectivity through wireless network infrastructures. In such a framework, we propose a Martian deployment of a 3-Dimensional (3D) network acting as Cloud Radio Access Network (C-RAN). The scenario consists, mostly, of unmanned aerial vehicles (UAVs) and nanosatellites. Thanks to the thin Martian atmosphere, CubeSats can stably orbit at very-low-altitude. This allows to meet strict delay requirements to split functions of the baseband processing between drones and CubeSats. The detailed analytical study, presented in this paper, confirmed the viability of the proposed 3D architecture, under some constraints and trade-off concerning the involved Space communication infrastructures, that are discussed in detail.


title: A Resource Allocation Scheme for Energy Demand Management in 6G-enabled Smart Grid

abstract: Smart grid (SG) systems enhance grid resilience and efficient operation, leveraging the bidirectional flow of energy and information between generation facilities and prosumers. For energy demand management (EDM), the SG network requires computing a large amount of data generated by massive Internet-of-things sensors and advanced metering infrastructure (AMI) with minimal latency. This paper proposes a deep reinforcement learning (DRL)-based resource allocation scheme in a 6G-enabled SG edge network to offload resource-consuming EDM computation to edge servers. Automatic resource provisioning is achieved by harnessing the computational capabilities of smart meters in the dynamic edge network. To enforce DRL-assisted policies in dense 6G networks, the state information from multiple edge servers is required. However, adversaries can "poison" such information through false state injection (FSI) attacks, exhausting SG edge computing resources. Toward addressing this issue, we investigate the impact of such FSI attacks with respect to abusive utilization of edge resources, and develop a lightweight FSI detection mechanism based on supervised classifiers. Simulation results demonstrate the efficacy of DRL in dynamic resource allocation, the impact of the FSI attacks, and the effectiveness of the detection technique.


title: Blockage-Peeking Game of Mobile Strategic Nodes in Millimeter Wave Communications

abstract: Given the importance of line-of-sight in mmWave communications, a strategic adversary can harm a transmission by obstructing the receiver, which in turn can react by trying to move around this hurdle. To expand on this point, we study one such scenario from the perspective of game theory, considering a mobile mmWave receiver and an adversary interacting strategically as players in a zero-sum game, where they want to maximize, or respectively minimize, the spectral efficiency of the communication. To do so, the adversary attempts at screening the receiver's line of sight as an obstacle, while the receiver can move around so as to avoid the blockage. We consider preset distances and the choices available to the players are to change their angular coordinates to go around each other. This is framed as a static game of complete information, for which we numerically find the Nash equilibrium in mixed strategies, drawing some interesting conclusions such as connecting it with the beamforming pattern of the transmitter.


title: Usable Region Estimate for Assessing Practical Usability of Medical Image Segmentation Models

abstract: We aim to quantitatively measure the practical usability of medical image segmentation models: to what extent, how often, and on which samples a model's predictions can be used/trusted. We first propose a measure, Correctness-Confidence Rank Correlation (CCRC), to capture how predictions' confidence estimates correlate with their correctness scores in rank. A model with a high value of CCRC means its prediction confidences reliably suggest which samples' predictions are more likely to be correct. Since CCRC does not capture the actual prediction correctness, it alone is insufficient to indicate whether a prediction model is both accurate and reliable to use in practice. Therefore, we further propose another method, Usable Region Estimate (URE), which simultaneously quantifies predictions' correctness and reliability of confidence assessments in one estimate. URE provides concrete information on to what extent a model's predictions are usable. In addition, the sizes of usable regions (UR) can be utilized to compare models: A model with a larger UR can be taken as a more usable and hence better model. Experiments on six datasets validate that the proposed evaluation methods perform well, providing a concrete and concise measure for the practical usability of medical image segmentation models. Code is made available at https://github.com/yizhezhang2000/ure.


title: Improving Disease Classification Performance and Explainability of Deep Learning Models in Radiology with Heatmap Generators

abstract: As deep learning is widely used in the radiology field, the explainability of such models is increasingly becoming essential to gain clinicians' trust when using the models for diagnosis. In this research, three experiment sets were conducted with a U-Net architecture to improve the classification performance while enhancing the heatmaps corresponding to the model's focus through incorporating heatmap generators during training. All of the experiments used the dataset that contained chest radiographs, associated labels from one of the three conditions ("normal", "congestive heart failure (CHF)", and "pneumonia"), and numerical information regarding a radiologist's eye-gaze coordinates on the images. The paper (A. Karargyris and Moradi, 2021) that introduced this dataset developed a U-Net model, which was treated as the baseline model for this research, to show how the eye-gaze data can be used in multi-modal training for explainability improvement. To compare the classification performances, the 95% confidence intervals (CI) of the area under the receiver operating characteristic curve (AUC) were measured. The best method achieved an AUC of 0.913 (CI: 0.860-0.966). The greatest improvements were for the "pneumonia" and "CHF" classes, which the baseline model struggled most to classify, resulting in AUCs of 0.859 (CI: 0.732-0.957) and 0.962 (CI: 0.933-0.989), respectively. The proposed method's decoder was also able to produce probability masks that highlight the determining image parts in model classifications, similarly as the radiologist's eye-gaze data. Hence, this work showed that incorporating heatmap generators and eye-gaze information into training can simultaneously improve disease classification and provide explainable visuals that align well with how the radiologist viewed the chest radiographs when making diagnosis.


title: Experimental Demonstration of Delay-Bounded Wireless Network Based on Precise Time Synchronization

abstract: Low latency and reliable information transfer are highly demanded in fifth generation (5G) and beyond 5G wireless communications. A novel delay-bounded wireless media access control (MAC) protocol called Carrier Sense Multiple Access with Arbitration Point (CSMA/AP) was established to strictly ensure the upper boundary of communication delay. CSMA/AP enables collision-free and delay-bounded communications with a simple arbitration mechanism exploiting the precise time synchronization achieved by Wireless Two-Way Interferometry (Wi-Wi). Experimental demonstration and proving the feasibility in wireless environments are among the most critical steps before any further discussion of CSMA/AP and extension to various applications can take in place. In this work described in this paper, we experimentally demonstrated the fundamental principles of CSMA/AP by constructing a star-topology wireless network using software-defined radio terminals combined with precise time synchronization devices. We show that CSMA/AP was successfully operated, even with dynamic changes of the spatial position of the terminal or the capability to accommodate mobility, thanks to the real-time adaption to the dynamically changing environment by Wi-Wi. We also experimentally confirmed that the proposed CSMA/AP principle cannot be executed without Wi-Wi, which validates the importance of precise time synchronization. This study paves the way toward realizing delay-bounded wireless communications for future low-latency and highly reliable critical applications.


title: Game-theoretic Learning Anti-jamming Approaches in Wireless Networks

abstract: In this article, the anti-jamming communication problem is investigated from a game-theoretic learning perspective. By exploring and analyzing intelligent anti-jamming communication, we present the characteristics of jammers and the requirements of an intelligent anti-jamming approach. Such approach is required of self-sensing, self-decision making, self-coordination, self-evaluation, and learning ability. Then, a game-theoretic learning anti-jamming (GTLAJ) paradigm is proposed, and its framework and challenges of GTLAJ are introduced. Moreover, through three cases, i.e., Stackelberg anti-jamming game, Markov anti-jamming game and hypergraph-based anti-jamming game, different anti-jamming game models and applications are discussed, and some future directions are presented.


title: When Does Differentially Private Learning Not Suffer in High Dimensions?

abstract: Large pretrained models can be privately fine-tuned to achieve performance approaching that of non-private models. A common theme in these results is the surprising observation that high-dimensional models can achieve favorable privacy-utility trade-offs. This seemingly contradicts known results on the model-size dependence of differentially private convex learning and raises the following research question: When does the performance of differentially private learning not degrade with increasing model size? We identify that the magnitudes of gradients projected onto subspaces is a key factor that determines performance. To precisely characterize this for private convex learning, we introduce a condition on the objective that we term \emph{restricted Lipschitz continuity} and derive improved bounds for the excess empirical and population risks that are dimension-independent under additional conditions. We empirically show that in private fine-tuning of large language models, gradients obtained during fine-tuning are mostly controlled by a few principal components. This behavior is similar to conditions under which we obtain dimension-independent bounds in convex settings. Our theoretical and empirical results together provide a possible explanation for recent successes in large-scale private fine-tuning. Code to reproduce our results can be found at \url{https://github.com/lxuechen/private-transformers/tree/main/examples/classification/spectral_analysis}.


title: Mitigating Presentation Attack using DCGAN and Deep CNN

abstract: Biometric based authentication is currently playing an essential role over conventional authentication system; however, the risk of presentation attacks subsequently rising. Our research aims at identifying the areas where presentation attack can be prevented even though adequate biometric image samples of users are limited. Our work focusses on generating photorealistic synthetic images from the real image sets by implementing Deep Convolution Generative Adversarial Net (DCGAN). We have implemented the temporal and spatial augmentation during the fake image generation. Our work detects the presentation attacks on facial and iris images using our deep CNN, inspired by VGGNet [1]. We applied the deep neural net techniques on three different biometric image datasets, namely MICHE I [2], VISOB [3], and UBIPr [4]. The datasets, used in this research, contain images that are captured both in controlled and uncontrolled environment along with different resolutions and sizes. We obtained the best test accuracy of 97% on UBI-Pr [4] Iris datasets. For MICHE-I [2] and VISOB [3] datasets, we achieved the test accuracies of 95% and 96% respectively.


title: Particle paths in equatorial flows

abstract: We investigate particle trajectories in equatorial flows with geophysical corrections caused by the earth's rotation. Particle trajectories in the flows are constructed using pairs of analytic functions defined over the labelling space used in the Lagrangian formalism. Several classes of flow are investigated, and the physical regime in which each is valid is determined using the pressure distribution function of the flow, while the vorticity distribution of each flow is also calculated and found to be effected by earth's rotation.


title: Non-Parametric Inference of Relational Dependence

abstract: Independence testing plays a central role in statistical and causal inference from observational data. Standard independence tests assume that the data samples are independent and identically distributed (i.i.d.) but that assumption is violated in many real-world datasets and applications centered on relational systems. This work examines the problem of estimating independence in data drawn from relational systems by defining sufficient representations for the sets of observations influencing individual instances. Specifically, we define marginal and conditional independence tests for relational data by considering the kernel mean embedding as a flexible aggregation function for relational variables. We propose a consistent, non-parametric, scalable kernel test to operationalize the relational independence test for non-i.i.d. observational data under a set of structural assumptions. We empirically evaluate our proposed method on a variety of synthetic and semi-synthetic networks and demonstrate its effectiveness compared to state-of-the-art kernel-based independence tests.


title: Deep Optical Coding Design in Computational Imaging

abstract: Computational optical imaging (COI) systems leverage optical coding elements (CE) in their setups to encode a high-dimensional scene in a single or multiple snapshots and decode it by using computational algorithms. The performance of COI systems highly depends on the design of its main components: the CE pattern and the computational method used to perform a given task. Conventional approaches rely on random patterns or analytical designs to set the distribution of the CE. However, the available data and algorithm capabilities of deep neural networks (DNNs) have opened a new horizon in CE data-driven designs that jointly consider the optical encoder and computational decoder. Specifically, by modeling the COI measurements through a fully differentiable image formation model that considers the physics-based propagation of light and its interaction with the CEs, the parameters that define the CE and the computational decoder can be optimized in an end-to-end (E2E) manner. Moreover, by optimizing just CEs in the same framework, inference tasks can be performed from pure optics. This work surveys the recent advances on CE data-driven design and provides guidelines on how to parametrize different optical elements to include them in the E2E framework. Since the E2E framework can handle different inference applications by changing the loss function and the DNN, we present low-level tasks such as spectral imaging reconstruction or high-level tasks such as pose estimation with privacy preserving enhanced by using optimal task-based optical architectures. Finally, we illustrate classification and 3D object recognition applications performed at the speed of the light using all-optics DNN.


title: Secure Forward Aggregation for Vertical Federated Neural Networks

abstract: Vertical federated learning (VFL) is attracting much attention because it enables cross-silo data cooperation in a privacy-preserving manner. While most research works in VFL focus on linear and tree models, deep models (e.g., neural networks) are not well studied in VFL. In this paper, we focus on SplitNN, a well-known neural network framework in VFL, and identify a trade-off between data security and model performance in SplitNN. Briefly, SplitNN trains the model by exchanging gradients and transformed data. On the one hand, SplitNN suffers from the loss of model performance since multiply parties jointly train the model using transformed data instead of raw data, and a large amount of low-level feature information is discarded. On the other hand, a naive solution of increasing the model performance through aggregating at lower layers in SplitNN (i.e., the data is less transformed and more low-level feature is preserved) makes raw data vulnerable to inference attacks. To mitigate the above trade-off, we propose a new neural network protocol in VFL called Security Forward Aggregation (SFA). It changes the way of aggregating the transformed data and adopts removable masks to protect the raw data. Experiment results show that networks with SFA achieve both data security and high model performance.


title: Variational Autoencoder Assisted Neural Network Likelihood RSRP Prediction Model

abstract: Measuring customer experience on mobile data is of utmost importance for global mobile operators. The reference signal received power (RSRP) is one of the important indicators for current mobile network management, evaluation and monitoring. Radio data gathered through the minimization of drive test (MDT), a 3GPP standard technique, is commonly used for radio network analysis. Collecting MDT data in different geographical areas is inefficient and constrained by the terrain conditions and user presence, hence is not an adequate technique for dynamic radio environments. In this paper, we study a generative model for RSRP prediction, exploiting MDT data and a digital twin (DT), and propose a data-driven, two-tier neural network (NN) model. In the first tier, environmental information related to user equipment (UE), base stations (BS) and network key performance indicators (KPI) are extracted through a variational autoencoder (VAE). The second tier is designed as a likelihood model. Here, the environmental features and real MDT data features are adopted, formulating an integrated training process. On validation, our proposed model that uses real-world data demonstrates an accuracy improvement of about 20% or more compared with the empirical model and about 10% when compared with a fully connected prediction network.


title: Rethinking Optimization with Differentiable Simulation from a Global Perspective

abstract: Differentiable simulation is a promising toolkit for fast gradient-based policy optimization and system identification. However, existing approaches to differentiable simulation have largely tackled scenarios where obtaining smooth gradients has been relatively easy, such as systems with mostly smooth dynamics. In this work, we study the challenges that differentiable simulation presents when it is not feasible to expect that a single descent reaches a global optimum, which is often a problem in contact-rich scenarios. We analyze the optimization landscapes of diverse scenarios that contain both rigid bodies and deformable objects. In dynamic environments with highly deformable objects and fluids, differentiable simulators produce rugged landscapes with nonetheless useful gradients in some parts of the space. We propose a method that combines Bayesian optimization with semi-local 'leaps' to obtain a global search method that can use gradients effectively, while also maintaining robust performance in regions with noisy gradients. We show that our approach outperforms several gradient-based and gradient-free baselines on an extensive set of experiments in simulation, and also validate the method using experiments with a real robot and deformables. Videos and supplementary materials are available at https://tinyurl.com/globdiff


title: An adaptive bi-objective optimization algorithm for the satellite image data downlink scheduling problem considering request split

abstract: The satellite image data downlink scheduling problem (SIDSP) is well studied in literature for traditional satellites. With recent developments in satellite technology, SIDSP for modern satellites became more complicated, adding new dimensions of complexities and additional opportunities for the effective use of the satellite. In this paper, we introduce the dynamic two-phase satellite image data downlink scheduling problem (D-SIDSP) which combines two interlinked operations of image data segmentation and image data downlink, in a dynamic way, and thereby offering additional modelling flexibility and renewed capabilities. D-SIDSP is formulated as a bi-objective problem of optimizing the image data transmission rate and the service-balance degree. Harnessing the power of an adaptive large neighborhood search algorithm (ALNS) with a nondominated sorting genetic algorithm II (NSGA-II), an adaptive bi-objective memetic algorithm, ALNS+NSGA-II, is developed to solve D-SIDSP. Results of extensive computational experiments carried out using benchmark instances are also presented. Our experimental results disclose that the algorithm ALNS+NSGA-II is a viable alternative to solve D-SIDSP more efficiently and demonstrates superior outcomes based on various performance metrics. The paper also offers new benchmark instances for D-SIDSP that can be used in future research works on the topic.


title: Novel Recursive Inclusion-Exclusion Technology Based on BAT and MPs for Heterogeneous-Arc Binary-State Network Reliability Problems

abstract: Current network applications, such as utility networks (gas, water, electricity, and 4G/5G), the Internet of Things (IoT), social networks, and supply chains, are all based on binary state networks. Reliability is one of the most commonly used tools for evaluating network performance, and the minimal path (MP) is a basic algorithm for calculating reliability. However, almost all existing algorithms assume that all undirected arcs are homogeneous; that is, the probability of an arc from nodes a to b is equal to that from nodes b to a. Therefore, based on MPs, the binary-addition-tree algorithm (BAT), and the inclusion-exclusion technique (IET), a novel recursive inclusion-exclusion technology algorithm known as recursive BAT-based IET (RIE) is proposed to solve the heterogeneous-arc binary-state network reliability problem to overcome the above obstacles in applications. The computational complexity of the proposed RIE is analyzed using an illustrative example. Finally, 11 benchmark problems are used to verify the performance of RIE.


title: TENET: Transformer Encoding Network for Effective Temporal Flow on Motion Prediction

abstract: This technical report presents an effective method for motion prediction in autonomous driving. We develop a Transformer-based method for input encoding and trajectory prediction. Besides, we propose the Temporal Flow Header to enhance the trajectory encoding. In the end, an efficient K-means ensemble method is used. Using our Transformer network and ensemble method, we win the first place of Argoverse 2 Motion Forecasting Challenge with the state-of-the-art brier-minFDE score of 1.90.


title: Off-the-grid learning of sparse mixtures from a continuous dictionary

abstract: We consider a general non-linear model where the signal is a finite mixture of an unknown, possibly increasing, number of features issued from a continuous dictionary parameterized by a real nonlinear parameter. The signal is observed with Gaussian (possibly correlated) noise in either a continuous or a discrete setup. We propose an off-the-grid optimization method, that is, a method which does not use any discretization scheme on the parameter space, to estimate both the non-linear parameters of the features and the linear parameters of the mixture. We use recent results on the geometry of off-the-grid methods to give minimal separation on the true underlying non-linear parameters such that interpolating certificate functions can be constructed. Using also tail bounds for suprema of Gaussian processes we bound the prediction error with high probability. Assuming that the certificate functions can be constructed, our prediction error bound is up to log --factors similar to the rates attained by the Lasso predictor in the linear regression model. We also establish convergence rates that quantify with high probability the quality of estimation for both the linear and the non-linear parameters.


title: Turbo: Opportunistic Enhancement for Edge Video Analytics

abstract: Edge computing is being widely used for video analytics. To alleviate the inherent tension between accuracy and cost, various video analytics pipelines have been proposed to optimize the usage of GPU on edge nodes. Nonetheless, we find that GPU compute resources provisioned for edge nodes are commonly under-utilized due to video content variations, subsampling and filtering at different places of a pipeline. As opposed to model and pipeline optimization, in this work, we study the problem of opportunistic data enhancement using the non-deterministic and fragmented idle GPU resources. In specific, we propose a task-specific discrimination and enhancement module and a model-aware adversarial training mechanism, providing a way to identify and transform low-quality images that are specific to a video pipeline in an accurate and efficient manner. A multi-exit model structure and a resource-aware scheduler is further developed to make online enhancement decisions and fine-grained inference execution under latency and GPU resource constraints. Experiments across multiple video analytics pipelines and datasets reveal that by judiciously allocating a small amount of idle resources on frames that tend to yield greater marginal benefits from enhancement, our system boosts DNN object detection accuracy by $7.3-11.3\%$ without incurring any latency costs.


title: Data-Driven Model for Failure Analysis of Internet of Things Devices: A Preliminary Study

abstract: This paper proposes the preliminary study of the data-driven failure analysis model for the internet of things (IoT) devices. This model focus on the impact of data transferring both get and receiving data in class C of Low Power Wide Area Network (LoRaWAN). To set up the network, the authors develop the combination of four several technology parts, including 1) the End Device Gateway Network server of LoRa IoT, 2) an Application server for storing the data in the database, 3) the Dashboard to show and got the command by the user, and 4) the failure analysis model based on Bayesian belief networks which calculate the probability values that collect the data transferring both uplink and downlink on the network connection in this study. In the testing phase, the authors input the separated data into the data-driven failure analysis model to analyze the time and latency of the connection by the concern of the impact and risk of the failure of the overall system. The model will show the probability value of failure. The authors hope to use the results to clarify whether a tested IoT device is suitable for use or not.


title: Thermodynamic Modeling of Fluid Polyamorphism in Hydrogen at Extreme Conditions

abstract: Fluid polyamorphism, the existence of multiple amorphous fluid states in a single-component system, has been observed or predicted in a variety of substances. A remarkable example of this phenomenon is the fluid-fluid phase transition in high-pressure hydrogen between insulating and conducting high-density fluids. This transition is induced by the reversible dimerization/dissociation of the molecular and atomistic states of hydrogen. In this work, we present the first attempt to thermodynamically model the fluid-fluid phase transition in hydrogen at extreme conditions. Our predictions for the phase coexistence and the reaction equilibrium of the two alternative forms of fluid hydrogen are based on experimental data and supported by the results of simulations. {Remarkably, we find that the law of corresponding states can be utilized to construct a unified equation of state combining the available computational results for different models of hydrogen and the experimental data.


title: Optimal photon polarization toward the observation of the nonlinear Breit-Wheeler pair production

abstract: We investigate the optimization of the photon polarization to increase the yield of the Breit-Wheeler pair production in arbitrarily polarized plane wave backgrounds. We show that the optimized photon polarization can improve the positron yield by more than $20\%$ compared to the unpolarized case, in the intensity regime of current laser-particle experiments. The seed photon's optimal polarization is resulting from the polarization coupling with the polarization of the laser pulse. The compact expressions of the coupling coefficients in both the perturbative and nonperturbative regime are given. Because of the evident difference in the coupling coefficients for the linear and circular polarization components, the seed photon's optimal polarization state in an elliptically polarized laser background, deviates considerably from the orthogonal state of the laser polarization.


title: End-to-end cell recognition by point annotation

abstract: Reliable quantitative analysis of immunohistochemical staining images requires accurate and robust cell detection and classification. Recent weakly-supervised methods usually estimate probability density maps for cell recognition. However, in dense cell scenarios, their performance can be limited by pre- and post-processing as it is impossible to find a universal parameter setting. In this paper, we introduce an end-to-end framework that applies direct regression and classification for preset anchor points. Specifically, we propose a pyramidal feature aggregation strategy to combine low-level features and high-level semantics simultaneously, which provides accurate cell recognition for our purely point-based model. In addition, an optimized cost function is designed to adapt our multi-task learning framework by matching ground truth and predicted points. The experimental results demonstrate the superior accuracy and efficiency of the proposed method, which reveals the high potentiality in assisting pathologist assessments.


title: Deep Motion Network for Freehand 3D Ultrasound Reconstruction

abstract: Freehand 3D ultrasound (US) has important clinical value due to its low cost and unrestricted field of view. Recently deep learning algorithms have removed its dependence on bulky and expensive external positioning devices. However, improving reconstruction accuracy is still hampered by difficult elevational displacement estimation and large cumulative drift. In this context, we propose a novel deep motion network (MoNet) that integrates images and a lightweight sensor known as the inertial measurement unit (IMU) from a velocity perspective to alleviate the obstacles mentioned above. Our contribution is two-fold. First, we introduce IMU acceleration for the first time to estimate elevational displacements outside the plane. We propose a temporal and multi-branch structure to mine the valuable information of low signal-to-noise ratio (SNR) acceleration. Second, we propose a multi-modal online self-supervised strategy that leverages IMU information as weak labels for adaptive optimization to reduce drift errors and further ameliorate the impacts of acceleration noise. Experiments show that our proposed method achieves the superior reconstruction performance, exceeding state-of-the-art methods across the board.


title: Search for Milli-Charged Particles from the Sun at IceCube

abstract: It is assumed that heavy dark matter particles $\phi$ with O(TeV) mass captured by the Sun may decay to relativistic light milli-charged particles (MCPs). These MCPs could be measured by the IceCube detector. The massless hidden photon model was taken for MCPs to interact with nuclei, so that the numbers and fluxes of expected MCPs and neutrinos may be evaluated at IceCube. Based on the assumption that no events are observed at IceCube in 6 years, the corresponding upper limits on MCP fluxes were calculated at 90\% C. L.. These results indicated that MCPs could be directly detected in the secondaries' energy range O(100GeV)-O(10TeV) at IceCube, when $\epsilon^2\gtrsim10^{-10}$. And a new region of 0.6 MeV < $m_{MCP}$ < 10 MeV and $6\times10^{-6}$ < $\epsilon$ $\lesssim$ $10^{-4}$ is ruled out in the $m_{MCP}$-$\epsilon$ plane with 6 years of IceCube data.


title: Reentrant Localized Bulk and Localized-Extended Edge in Quasiperiodic Non-Hermitian Systems

abstract: The localization is one of the active and fundamental research in topology physics. Based on a generalized Su-Schrieffer-Heeger model with the quasiperiodic non-Hermitian emerging at the off-diagonal location, we propose a novel systematic method to analyze the localization behaviors for the bulk and the edge, respectively. For the bulk, it can be found that it undergoes an extended-coexisting-localized-coexisting-localized transition induced by the quasidisorder and nonHermiticity. While for the edge state, it can be broken and recovered with the increase of the quasidisorder strength, and its localized transition is synchronous exactly with the topological phase transition. In addition, the inverse participation ratio of the edge state oscillates with an increase of the disorder strength. Finally, numerical results elucidate that the derivative of the normalized participation ratio exhibits an enormous discontinuity at the localized transition point. Here, our results not only demonstrate the diversity of localization properties of bulk and edge state, but also may provide an extension of the ordinary method for investigating the localization.


title: Asymptotically efficient estimation for diffusion processes with nonsynchronous observations

abstract: We study maximum-likelihood-type estimation for diffusion processes when the coefficients are nonrandom and observation occurs in nonsynchronous manner. The problem of nonsynchronous observations is important when we consider the analysis of high-frequency data in a financial market. Constructing a quasi-likelihood function to define the estimator, we adaptively estimate the parameter for the diffusion part and the drift part. We consider the asymptotic theory when the terminal time point $T_n$ and the observation frequency goes to infinity, and show the consistency and the asymptotic normality of the estimator. Moreover, we show local asymptotic normality for the statistical model, and asymptotic efficiency of the estimator as a consequence. To show the asymptotic properties of the maximum-likelihood-type estimator, we need to control the asymptotic behaviors of some functionals of the sampling scheme. Though it is difficult to directly control those in general, we study tractable sufficient conditions when the sampling scheme is generated by mixing processes.


title: The Periodic Signals of Nova V1674 Herculis (2021)

abstract: We present time-series photometry during eruption of the extremely fast nova V1674 Herculis (Nova Her 2021). The 2021 light curve showed periodic signals at 0.152921(3) d and 501.486(5) s, which we interpret as respectively the orbital and white dwarf spin-periods in the underlying binary. We also detected a sideband signal at the /difference/ frequency between these two clocks. During the first 15 days of outburst, the spin-period appears to have increased by 0.014(1)%. This increase probably arose from the sudden loss of high-angular-momentum gas ("the nova explosion") from the rotating, magnetic white dwarf. Both periodic signals appeared remarkably early in the outburst, which we attribute to the extreme speed with which the nova evolved (and became transparent to radiation from the inner binary). After that very fast initial increase of ~71 ms, the spin-period commenced a steady decrease of ~160 ms/year -- about 100x faster than usually seen in intermediate polars. This is probably due to high accretion torques from very high mass-transfer rates, which might be common when low-mass donor stars are strongly irradiated by a nova outburst.


title: Recovering Detail in 3D Shapes Using Disparity Maps

abstract: We present a fine-tuning method to improve the appearance of 3D geometries reconstructed from single images. We leverage advances in monocular depth estimation to obtain disparity maps and present a novel approach to transforming 2D normalized disparity maps into 3D point clouds by using shape priors to solve an optimization on the relevant camera parameters. After creating a 3D point cloud from disparity, we introduce a method to combine the new point cloud with existing information to form a more faithful and detailed final geometry. We demonstrate the efficacy of our approach with multiple experiments on both synthetic and real images.


title: Hidden-charm Hexaquarks from Lattice QCD

abstract: We present a lattice QCD study of hidden-charm hexaquarks with quark content $usc\bar{d}\bar{s}\bar{c}$ based on four ensembles of gauge configurations generated by CLQCD Collaboration with pion mass in the range of 220-300MeV. Four operators with quantum numbers $0^{++}, 0^{-+}, 1^{++}$ and $1^{--}$ respectively are constructed to interpolate the hexaquarks. After validating the spectrum and the dispersion relation for ordinary hadrons, we calculate the masses of the hexaquarks and extrapolate the results to the physical pion mass and the continuum limit. We find that the masses of the four hexaquarks are all below the $\Xi_c \bar \Xi_c$ threshold, while the $0^{-+}$ hexaquark lies around the $\eta_c K^+K^-$ threshold. These results will be helpful for experimental searches in future and for a deep understanding of the nature of multiquark states.


title: Peierls distortion driven multi-orbital origin of charge density waves in the undoped infinite-layer nickelate

abstract: Understanding similarities and differences between the cuprate and nickelate superconductors is drawing intense current interest. Competing charge orders have been observed recently in the $undoped$ infinite-layer nickelates in sharp contrast to the $undoped$ cuprates which exhibit robust antiferromagnetic insulating ground states. The microscopic mechanisms driving these differences remain unclear. Here, using in-depth first-principles and many-body theory based modeling, we show that the parent compound of the nickelate family, LaNiO$_2$, hosts a charge density wave (CDW) ground state with the predicted wavevectors in accord with the corresponding experimental findings. The CDW ground state is shown to be connected to a multi-orbital Peierls distortion. Our study points to the key role of electron-phonon coupling effects in the infinite-layer nickelates.


title: Likelihood-free Inference with Mixture Density Network

abstract: In this work, we propose using the mixture density network (MDN) to estimate cosmological parameters. We test the MDN method by constraining parameters of the $\Lambda$CDM and $w$CDM models using Type Ia supernovae and the power spectra of the cosmic microwave background. We find that the MDN method can achieve the same level of accuracy as the Markov Chain Monte Carlo method, with a slight difference of $\mathcal{O}(10^{-2}\sigma)$. Furthermore, the MDN method can provide accurate parameter estimates with $\mathcal{O}(10^3)$ forward simulation samples, which are useful for complex and resource-consuming cosmological models. This method can process either one data set or multiple data sets to achieve joint constraints on parameters, extendable for any parameter estimation of complicated models in a wider scientific field. Thus, the MDN provides an alternative way for likelihood-free inference of parameters.


title: MMFN: Multi-Modal-Fusion-Net for End-to-End Driving

abstract: Inspired by the fact that humans use diverse sensory organs to perceive the world, sensors with different modalities are deployed in end-to-end driving to obtain the global context of the 3D scene. In previous works, camera and LiDAR inputs are fused through transformers for better driving performance. These inputs are normally further interpreted as high-level map information to assist navigation tasks. Nevertheless, extracting useful information from the complex map input is challenging, for redundant information may mislead the agent and negatively affect driving performance. We propose a novel approach to efficiently extract features from vectorized High-Definition (HD) maps and utilize them in the end-to-end driving tasks. In addition, we design a new expert to further enhance the model performance by considering multi-road rules. Experimental results prove that both of the proposed improvements enable our agent to achieve superior performance compared with other methods.


title: An Understanding-Oriented Robust Machine Reading Comprehension Model

abstract: Although existing machine reading comprehension models are making rapid progress on many datasets, they are far from robust. In this paper, we propose an understanding-oriented machine reading comprehension model to address three kinds of robustness issues, which are over sensitivity, over stability and generalization. Specifically, we first use a natural language inference module to help the model understand the accurate semantic meanings of input questions so as to address the issues of over sensitivity and over stability. Then in the machine reading comprehension module, we propose a memory-guided multi-head attention method that can further well understand the semantic meanings of input questions and passages. Third, we propose a multilanguage learning mechanism to address the issue of generalization. Finally, these modules are integrated with a multi-task learning based method. We evaluate our model on three benchmark datasets that are designed to measure models robustness, including DuReader (robust) and two SQuAD-related datasets. Extensive experiments show that our model can well address the mentioned three kinds of robustness issues. And it achieves much better results than the compared state-of-the-art models on all these datasets under different evaluation metrics, even under some extreme and unfair evaluations. The source code of our work is available at: https://github.com/neukg/RobustMRC.


title: Rethinking Query-Key Pairwise Interactions in Vision Transformers

abstract: Vision Transformers have achieved state-of-the-art performance in many visual tasks. Due to the quadratic computational and memory complexities of self-attention, recent works either apply attention only to low-resolution inputs or restrict the receptive field to a small local region. To overcome these limitations, we propose key-only attention, which excludes query-key pairwise interactions and uses a compute-efficient saliency-gate to obtain attention weights, modeling local-global interactions in all stages. Key-only attention has linear computational and memory complexities w.r.t input size. We use alternate layout to hybridize convolution and attention layers instead of grafting which is suggested by previous works, so that all stages can benefit from both spatial attentions and convolutions. We leverage these improvements to develop a new self-attention model family, LinGlos, which reach state-of-the-art accuracies on the parameter-limited setting of ImageNet classification benchmark, and outperform baselines significantly in downstream tasks, e.g., COCO object detection and ADE20K semantic segmentation.


title: Facilitating Conversational Interaction in Natural Language Interfaces for Visualization

abstract: Natural language (NL) toolkits enable visualization developers, who may not have a background in natural language processing (NLP), to create natural language interfaces (NLIs) for end-users to flexibly specify and interact with visualizations. However, these toolkits currently only support one-off utterances, with minimal capability to facilitate a multi-turn dialog between the user and the system. Developing NLIs with such conversational interaction capabilities remains a challenging task, requiring implementations of low-level NLP techniques to process a new query as an intent to follow-up on an older query. We extend an existing Python-based toolkit, NL4DV, that processes an NL query about a tabular dataset and returns an analytic specification containing data attributes, analytic tasks, and relevant visualizations, modeled as a JSON object. Specifically, NL4DV now enables developers to facilitate multiple simultaneous conversations about a dataset and resolve associated ambiguities, augmenting new conversational information into the output JSON object. We demonstrate these capabilities through three examples: (1) an NLI to learn aspects of the Vega-Lite grammar, (2) a mind mapping application to create free-flowing conversations, and (3) a chatbot to answer questions and resolve ambiguities.


title: Range of Motion Sensors for Monitoring Recovery of Total Knee Arthroplasty

abstract: A low-cost, accurate device to measure and record knee range of motion (ROM) is of the essential need to improve confidence in at-home rehabilitation. It is to reduce hospital stay duration and overall medical cost after Total Knee Arthroplasty (TKA) procedures. The shift in Medicare funding from pay-as-you-go to the Bundled Payments for Care Improvement (BPCI) has created a push towards at-home care over extended hospital stays. It has heavily affected TKA patients, who typically undergo physical therapy at the clinic after the procedure to ensure full recovery of ROM. In this paper, we use accelerometers to create a ROM sensor that can be integrated into the post-operative surgical dressing, so that the cost of the sensors can be included in the bundled payments. In this paper, we demonstrate the efficacy of our method in comparison to the baseline computer vision method. Our results suggest that calculating angular displacement from accelerometer sensors demonstrates accurate ROM recordings under both stationary and walking conditions. The device would keep track of angle measurements and alert the patient when certain angle thresholds have been crossed, allowing patients to recover safely at home instead of going to multiple physical therapy sessions. The affordability of our sensor makes it more accessible to patients in need.


title: Data generation using simulation technology to improve perception mechanism of autonomous vehicles

abstract: Recent advancements in computer graphics technology allow more realistic ren-dering of car driving environments. They have enabled self-driving car simulators such as DeepGTA-V and CARLA (Car Learning to Act) to generate large amounts of synthetic data that can complement the existing real-world dataset in training autonomous car perception. Furthermore, since self-driving car simulators allow full control of the environment, they can generate dangerous driving scenarios that the real-world dataset lacks such as bad weather and accident scenarios. In this paper, we will demonstrate the effectiveness of combining data gathered from the real world with data generated in the simulated world to train perception systems on object detection and localization task. We will also propose a multi-level deep learning perception framework that aims to emulate a human learning experience in which a series of tasks from the simple to more difficult ones are learned in a certain domain. The autonomous car perceptron can learn from easy-to-drive scenarios to more challenging ones customized by simulation software.


title: Some aspects of the Bergman and Hardy spaces associated with a class of generalized analytic functions

abstract: For $\lambda\ge0$, a $C^2$ function $f$ defined on the unit disk ${{\mathbb D}}$ is said to be $\lambda$-analytic if $D_{\bar{z}}f=0$, where $D_{\bar{z}}$ is the (complex) Dunkl operator given by $D_{\bar{z}}f=\partial_{\bar{z}}f-\lambda(f(z)-f(\bar{z}))/(z-\bar{z})$. The aim of the paper is to study several problems on the associated Bergman spaces $A^{p}_{\lambda}({{\mathbb D}})$ and Hardy spaces $H_{\lambda}^p({{\mathbb D}})$ for $p\ge2\lambda/(2\lambda+1)$, such as boundedness of the Bergman projection, growth of functions, density, completeness, and the dual spaces of $A^{p}_{\lambda}({{\mathbb D}})$ and $H_{\lambda}^p({{\mathbb D}})$, and characterization and interpolation of $A^{p}_{\lambda}({{\mathbb D}})$.


title: Reading and Writing: Discriminative and Generative Modeling for Self-Supervised Text Recognition

abstract: Existing text recognition methods usually need large-scale training data. Most of them rely on synthetic training data due to the lack of annotated real images. However, there is a domain gap between the synthetic data and real data, which limits the performance of the text recognition models. Recent self-supervised text recognition methods attempted to utilize unlabeled real images by introducing contrastive learning, which mainly learns the discrimination of the text images. Inspired by the observation that humans learn to recognize the texts through both reading and writing, we propose to learn discrimination and generation by integrating contrastive learning and masked image modeling in our self-supervised method. The contrastive learning branch is adopted to learn the discrimination of text images, which imitates the reading behavior of humans. Meanwhile, masked image modeling is firstly introduced for text recognition to learn the context generation of the text images, which is similar to the writing behavior. The experimental results show that our method outperforms previous self-supervised text recognition methods by 10.2%-20.2% on irregular scene text recognition datasets. Moreover, our proposed text recognizer exceeds previous state-of-the-art text recognition methods by averagely 5.3% on 11 benchmarks, with similar model size. We also demonstrate that our pre-trained model can be easily applied to other text-related tasks with obvious performance gain. The code is available at https://github.com/ayumiymk/DiG.


title: One dimensional discrete Schr\"odinger operators with resonant embedded eigenvalues

abstract: In this paper, we introduce a new family of functions to construct Schr\"odinger operators with embedded eigenvalues. This particularly allows us to construct discrete Schr\"odinger operators with arbitrary prescribed sets of eigenvalues.


title: Learning Diverse and Physically Feasible Dexterous Grasps with Generative Model and Bilevel Optimization

abstract: To fully utilize the versatility of a multi-fingered dexterous robotic hand for executing diverse object grasps, one must consider the rich physical constraints introduced by hand-object interaction and object geometry. We propose an integrative approach of combining a generative model and a bilevel optimization (BO) to plan diverse grasp configurations on novel objects. First, a conditional variational autoencoder trained on merely six YCB objects predicts the finger placement directly from the object point cloud. The prediction is then used to seed a nonconvex BO that solves for a grasp configuration under collision, reachability, wrench closure, and friction constraints. Our method achieved an 86.7% success over 120 real world grasping trials on 20 household objects, including unseen and challenging geometries. Through quantitative empirical evaluations, we confirm that grasp configurations produced by our pipeline are indeed guaranteed to satisfy kinematic and dynamic constraints. A video summary of our results is available at youtu.be/9DTrImbN99I.


title: The miniJPAS Survey: Detection of double-core Ly{\alpha} morphology of two high-redshift (z>3) QSOs

abstract: The Ly$\alpha$ emission is an important tracer of neutral gas in a circum-galactic medium (CGM) around high-z QSOs. The origin of Lya emission around QSOs is still under debate which has significant implications for galaxy formation and evolution. In this paper, we study Ly$\alpha$ nebulae around two high redshift QSOs, SDSS J141935.58+525710.7 at $z=3.218$ (hereafter QSO1) and SDSS J141813.40+525240.4 at $z=3.287$ (hereafter QSO2), from the miniJPAS survey within the AEGIS field. Using the contiguous narrow-band (NB) images from the miniJPAS survey and SDSS spectra, we analyzed their morphology, nature, and origin. We report the serendipitous detection of double-core Ly\al\ morphology around two QSOs which is rarely seen among other QSOs. The separations of the two Ly\al~cores are 11.07 $\pm$ 2.26 kpcs (1.47 $\pm$ 0.3$^{\prime\prime}$) and 9.73 $\pm$ 1.55 kpcs (1.31 $\pm$ 0.21$^{\prime\prime}$) with Ly$\alpha$~line luminosities of $\sim$ 3.35 $\times 10^{44}$ erg s $^{-1} $ and $\sim$ 6.99 $\times$ 10$^{44}$ erg s $^{-1}$ for QSO1 and QSO2, respectively. The miniJPAS NB images show evidence of extended Ly$\alpha$ and CIV morphology for both QSOs and extended HeII morphology for QSO1. These two QSOs may be potential candidates for the new enormous Lyman alpha nebula (ELAN) found from the miniJPAS survey due to their extended morphology in the shallow depth and relatively high Ly$\alpha$ luminosities. We suggest that galactic outflows are the major powering mechanism for the double-core Ly$\alpha$ morphology. Considering the relatively shallow exposures of miniJPAS, the objects found here could be the tip of the iceberg of a promising number of such objects that will be uncovered in the upcoming full J-PAS survey and deep IFU observations with 8-10m telescopes will be essential for constraining the underlying physical mechanism that is responsible for the double-cored morphology.


title: On the vanishing of twisted $L$-functions of elliptic curves over rational function fields

abstract: We investigate in this paper the vanishing at $s=1$ of the twisted $L$-functions of elliptic curves $E$ defined over the rational function field $\mathbb{F}_q(t)$ (where $\mathbb{F}_q$ is a finite field of $q$ elements and characteristic $\geq 5$) for twists by Dirichlet characters of prime order $\ell \geq 3$, from both a theoretical and numerical point of view. In the case of number fields, it is predicted that such vanishing is a very rare event, and our numerical data seems to indicate that this is also the case over function fields for non-constant curves. For constant curves, we adapt the techniques of Li and Donepudi--Li who proved vanishing at $s=1/2$ for infinitely many Dirichlet $L$-functions over $\mathbb{F}_q(t)$ based on the existence of one, and we can prove that if there is one $\chi_0$ such that $L(E, \chi_0, 1)=0$, then there are infinitely many. Finally, we provide some examples which show that twisted $L$-functions of constant elliptic curves over $\mathbb{F}_q(t)$ behave differently than the general ones.


title: Comprehensive Reactive Safety: No Need For A Trajectory If You Have A Strategy

abstract: Safety guarantees in motion planning for autonomous driving typically involve certifying the trajectory to be collision-free under any motion of the uncontrollable participants in the environment, such as the human-driven vehicles on the road. As a result they usually employ a conservative bound on the behavior of such participants, such as reachability analysis. We point out that planning trajectories to rigorously avoid the entirety of the reachable regions is unnecessary and too restrictive, because observing the environment in the future will allow us to prune away most of them; disregarding this ability to react to future updates could prohibit solutions to scenarios that are easily navigated by human drivers. We propose to account for the autonomous vehicle's reactions to future environment changes by a novel safety framework, Comprehensive Reactive Safety. Validated in simulations in several urban driving scenarios such as unprotected left turns and lane merging, the resulting planning algorithm called Reactive ILQR demonstrates strong negotiation capabilities and better safety at the same time.


title: Study of the buckling effects on the electrical and optical properties of the group III-Nitride monolayers

abstract: We consider electronic and optical properties of group III-Nitride monolayers using first-principle calculations. The group III-Nitride monolayers have flat hexagonal structures with almost zero planar buckling, $\Delta$. By tuning the $\Delta$, the strong $\sigma\text{-}\sigma$ bond through sp$^2$ hybridization of a flat form of these monolayers can be changed to a stronger $\sigma\text{-}\pi$ bond through sp$^3$ hybridization. Consequently, the band gaps of the monolayers are tuned due to a dislocation of the $s$- and $p$-orbitals towards the Fermi energy. The band gaps decrease with increasing $\Delta$ for those flat monolayers, which have a band gap greater than $1.0$ eV, while no noticeable change or a flat dispersion of the band gap is seen for the flat monolayers, that have a band gap less than $1.0$ eV. The decreased band gap causes a decrease in the excitation energy, and thus the static dielectric function, refractive index, and the optical conductivity are increased. In contrast, the flat band gap dispersion of few monolayers in the group III-Nitride induces a reduction in the static dielectric function, the refractive index, and the optical conductivity. We therefore confirm that tuning of the planar buckling can be used to control the physical properties of these monolayers, both for an enhancement and a reduction of the optical properties. These results are of interest for the design of optoelectric devices in nanoscale systems.


title: Studying the impact of magnitude pruning on contrastive learning methods

abstract: We study the impact of different pruning techniques on the representation learned by deep neural networks trained with contrastive loss functions. Our work finds that at high sparsity levels, contrastive learning results in a higher number of misclassified examples relative to models trained with traditional cross-entropy loss. To understand this pronounced difference, we use metrics such as the number of PIEs (Hooker et al., 2019), Q-Score (Kalibhat et al., 2022), and PD-Score (Baldock et al., 2021) to measure the impact of pruning on the learned representation quality. Our analysis suggests the schedule of the pruning method implementation matters. We find that the negative impact of sparsity on the quality of the learned representation is the highest when pruning is introduced early on in the training phase.


title: Parameter estimations for the Gaussian process with drift at discrete observation

abstract: This paper first strictly proved that the growth of the second moment of a large class of Gaussian processes is not greater than power function and the covariance matrix is strictly positive definite. Under these two conditions, the maximum likelihood estimators of the mean and variance of such classes of drift Gaussian process have strong consistency under broader growth of t_n. At the same time, the asymptotic normality of binary random vectors and the Berry-Ess\'{e}en bound of estimators are obtained by using the Stein's method via Malliavian calculus.


title: DiffPills: Differentiable Collision Detection for Capsules and Padded Polygons

abstract: Collision detection plays an important role in simulation, control, and learning for robotic systems. However, no existing method is differentiable with respect to the configurations of the objects, greatly limiting the sort of algorithms that can be built on top of collision detection. In this work, we propose a set of differentiable collision detection algorithms between capsules and padded polygons by formulating these problems as differentiable convex quadratic programs. The resulting algorithms are able to return a proximity value indicating if a collision has taken place, as well as the closest points between objects, all of which are differentiable. As a result, they can be used reliably within other gradient-based optimization methods, including trajectory optimization, state estimation, and reinforcement learning methods.


title: Hyperparametric oscillation via bound states in the continuum

abstract: Optical hyperparametric oscillation based on the third-order nonlinearity is one of the most significant mechanisms to generate coherent electromagnetic radiation and produce quantum states of light. Advances in dispersion-engineered high-$Q$ microresonators allow for generating signal waves far from the pump and decrease the oscillation power threshold to submilliwatt levels. However, the pump-to-signal conversion efficiency and absolute signal power are low, fundamentally limited by parasitic mode competition and attainable cavity intrinsic $Q$ to coupling $Q$ ratio, i.e., $Q_{\rm i}/Q_{\rm c}$. Here, we use Friedrich-Wintgen bound states in the continuum (BICs) to overcome the physical challenges in an integrated microresonator-waveguide system. As a result, on-chip coherent hyperparametric oscillation is generated in BICs with unprecedented conversion efficiency and absolute signal power. This work not only opens a path to generate high-power and efficient continuous-wave electromagnetic radiation in Kerr nonlinear media but also enhances the understanding of microresonator-waveguide system - an elementary unit of modern photonics.


title: Thermal transport driven by Coulomb interactions in quantum dots: Enhancement of thermoelectric and heat currents

abstract: We investigate thermal transport in a serial asymmetric double quantum dot (DQD) coupled to two electron reservoirs with different temperatures. The inter- and intra-Coulomb interactions are taken into account in a Coulomb blockade DQD where the electron sequential tunneling via four different master equation approaches is considered. In the absence of Coulomb interactions, a neglectable thermoelectric and heat currents is found identifying as the Coulomb blockade DQD regime. In the presence of Coulomb interactions, intra- and inter-Coulomb interactions, crossings energies between the intra- and the inter-dot many-body electron states are observed. The crossings induce extra channels in the energy spectrum of the DQD that enhance thermoelectric and heat currents. The extra channels form several peaks in the thermoelectric and heat currents in which intensity and position of the peaks depend on strength of the inter- and intra-dot Coulomb interactions. In addition, the problem of coherences and incoherences are studied using different approaches to the master equation, which are the first order von-Neumann, the Redfield, a first order Lindblad, and the Pauli methods. We find that all methods give almost similar thermal transport when the role of the coherences is irrelevant in the DQD.


title: Remarkable relations between the central binomial series, Eulerian polynomials, and poly-Bernoulli numbers

abstract: The central binomial series at negative integers are expressed as a linear combination of values of certain two polynomials. We show that one of the polynomials is a special value of the bivariate Eulerian polynomial and the other polynomial is related to the antidiagonal sum of poly-Bernoulli numbers. As an application, we prove Stephan's observation from 2004.


title: Valid and Unobtrusive Measurement of Returns to Advertising through Asymmetric Budget Split

abstract: Ad platforms require reliable measurement of advertising returns: what increase in performance (such as clicks or conversions) can an advertiser expect in return for additional budget on the platform? Even from the perspective of the platform, accurately measuring advertising returns is hard. Selection and omitted variable biases make estimates from observational methods unreliable, and straightforward experimentation is often costly or infeasible. We introduce Asymmetric Budget Split, a novel methodology for valid measurement of ad returns from the perspective of the platform. Asymmetric budget split creates small asymmetries in ad budget allocation across comparable partitions of the platform's userbase. By observing performance of the same ad at different budget levels while holding all other factors constant, the platform can obtain a valid measure of ad returns. The methodology is unobtrusive and cost-effective in that it does not require holdout groups or sacrifices in ad or marketplace performance. We discuss a successful deployment of asymmetric budget split to LinkedIn's Jobs Marketplace, an ad marketplace where it is used to measure returns from promotion budgets in terms of incremental job applicants. We outline operational considerations for practitioners and discuss further use cases such as budget-aware performance forecasting.


title: Generating transient noise artifacts in gravitational-wave detector data with generative adversarial networks

abstract: Transient noise glitches in gravitational-wave detector data limit the sensitivity of searches and contaminate detected signals. In this Paper, we show how glitches can be simulated using generative adversarial networks. We produce hundreds of synthetic images for the 22 most common types of glitches seen in the LIGO, KAGRA, and Virgo detectors. The artificial glitches can be used to improve the performance of searches and parameter-estimation algorithms. We perform a neural network classification to show that our artificial glitches are an excellent match for real glitches, with an average classification accuracy across all 22 glitch types of 99.0%.


title: e-CLIP: Large-Scale Vision-Language Representation Learning in E-commerce

abstract: Understanding vision and language representations of product content is vital for search and recommendation applications in e-commerce. As a backbone for online shopping platforms and inspired by the recent success in representation learning research, we propose a contrastive learning framework that aligns language and visual models using unlabeled raw product text and images. We present techniques we used to train large-scale representation learning models and share solutions that address domain-specific challenges. We study the performance using our pre-trained model as backbones for diverse downstream tasks, including category classification, attribute extraction, product matching, product clustering, and adult product recognition. Experimental results show that our proposed method outperforms the baseline in each downstream task regarding both single modality and multiple modalities.


title: Frequency beating and damping of breathing oscillations of a harmonically trapped one-dimensional quasicondensate

abstract: We study the breathing (monopole) oscillations and their damping in a harmonically trapped one-dimensional (1D) Bose gas in the quasicondensate regime using a finite-temperature classical field approach. By characterising the oscillations via the dynamics of the density profile's rms width over long time, we find that the rms width displays beating of two distinct frequencies. This means that 1D Bose gas oscillates not at a single breathing mode frequency, as found in previous studies, but as a superposition of two distinct breathing modes, one oscillating at frequency close to $\simeq\!\sqrt{3}\omega$ and the other at $\simeq\!2\omega$, where $\omega$ is the trap frequency. The breathing mode at $\sim\!\sqrt{3}\omega$ dominates the beating at lower temperatures, deep in the quasicondensate regime, and can be attributed to the oscillations of the bulk of the density distribution comprised of particles populating low-energy, highly-occupied states. The breathing mode at $\simeq\!2\omega$, on the other hand, dominates the beating at higher temperatures, close to the nearly ideal, degenerate Bose gas regime, and is attributed to the oscillations of the tails of the density distribution comprised of thermal particles in higher energy states. The two breathing modes have distinct damping rates, with the damping rate of the bulk component being approximately four times larger than that of the tails component.


title: Neural Parameterization for Dynamic Human Head Editing

abstract: Implicit radiance functions emerged as a powerful scene representation for reconstructing and rendering photo-realistic views of a 3D scene. These representations, however, suffer from poor editability. On the other hand, explicit representations such as polygonal meshes allow easy editing but are not as suitable for reconstructing accurate details in dynamic human heads, such as fine facial features, hair, teeth, and eyes. In this work, we present Neural Parameterization (NeP), a hybrid representation that provides the advantages of both implicit and explicit methods. NeP is capable of photo-realistic rendering while allowing fine-grained editing of the scene geometry and appearance. We first disentangle the geometry and appearance by parameterizing the 3D geometry into 2D texture space. We enable geometric editability by introducing an explicit linear deformation blending layer. The deformation is controlled by a set of sparse key points, which can be explicitly and intuitively displaced to edit the geometry. For appearance, we develop a hybrid 2D texture consisting of an explicit texture map for easy editing and implicit view and time-dependent residuals to model temporal and view variations. We compare our method to several reconstruction and editing baselines. The results show that the NeP achieves almost the same level of rendering accuracy while maintaining high editability.


title: Quantum nucleation of topological solitons

abstract: The chiral soliton lattice is an array of topological solitons realized as ground states of QCD at finite density under strong magnetic fields or rapid rotation, and chiral magnets with an easy-plane anisotropy. In such cases, topological solitons have negative energy due to topological terms originating from the chiral magnetic or vortical effect and the Dzyaloshinskii-Moriya interaction, respectively. We study quantum nucleation of topological solitons in the vacuum through quantum tunneling in $2+1$ and $3+1$ dimensions, by using a complex $\phi^4$ (or the axion) model with a topological term proportional to an external field, which is a simplification of low-energy theories of the above systems. In $2+1$ dimensions, a pair of a vortex and an anti-vortex is connected by a linear soliton, while in $3+1$ dimensions, a vortex is string-like, a soliton is wall-like, and a disk of a soliton wall is bounded by a string loop. Since the tension of solitons can be effectively negative due to the topological term, such a composite configuration of a finite size is created by quantum tunneling and subsequently grows rapidly. We estimate the nucleation probability analytically in the thin-defect approximation and fully calculate it numerically using the relaxation (gradient flow) method. The nucleation probability is maximized when the direction of the soliton is perpendicular to the external field. We find a good agreement between the thin-defect approximation and direct numerical simulation in $2+1$ dimensions if we read the vortex tension from the numerics, while we find a difference between them at short distances interpreted as a remnant energy in $3+1$ dimensions.


title: Formation of Chiral Soliton Lattice

abstract: The Chiral Soliton Lattice (CSL) is a lattice structure composed of domain walls aligned in parallel at equal intervals, which is energetically stable in the presence of a background magnetic field and a finite (baryon) chemical potential due to the topological term originated from the chiral anomaly. We study its formation from the vacuum state, with describing the CSL as a layer of domain-wall disks surrounded by the vortex or string loop, based on the Nambu-Goto-type effective theory. We show that the domain wall nucleates via quantum tunneling when the magnetic field is strong enough. We evaluate its nucleation rate and determine the critical magnetic field strength with which the nucleation rate is no longer exponentially suppressed. We apply this analysis to the neutral pion in the two-flavor QCD as well as the axion-like particles (ALPs) with a finite (baryon) chemical potential under an external magnetic field. In the former case, even though the CSL state is more energetically stable than the vacuum state and the nucleation rate becomes larger for sufficiently strong magnetic field, it cannot be large enough so that the nucleation of the domain walls is not exponentially suppressed and promoted, without suffering from the tachyonic instability of the charged pion fluctuations. In the latter case, we confirm that the effective interaction of the ALPs generically includes the topological term required for the CSL state to be energetically favored. We show that the ALP CSL formation is promoted if the magnetic field strength and the chemical potential of the system is slightly larger than the scale of the axion decay constant.

categories: hep-th astro-ph.CO cond-mat.mes-hall hep-ph nucl-th


title: Quick Relaxation in Collective Motion

abstract: We establish sufficient conditions for the quick relaxation to kinetic equilibrium in the classic Vicsek-Cucker-Smale model of bird flocking. The convergence time is polynomial in the number of birds as long as the number of flocks remains bounded. This new result relies on two key ingredients: exploiting the convex geometry of embedded averaging systems; and deriving new bounds on the s-energy of disconnected agreement systems. We also apply our techniques to bound the relaxation time of certain pattern-formation robotic systems investigated by Sugihara and Suzuki.


title: Gas and Cosmic-Ray Properties in the MBM 53, 54, and 55 Molecular Clouds and the Pegasus Loop as Revealed by HI Line Profiles, Dust, and Gamma-Ray Data

abstract: In studying the interstellar medium (ISM) and Galactic cosmic rays (CRs), uncertainty of the interstellar gas density has always been an issue. To overcome this difficulty, we used a component decomposition of the 21-cm HI line emission and used the resulting gas maps in an analysis of $\gamma$-ray data obtained by the Fermi Large Area Telescope (LAT) for the MBM~53, 54, and 55 molecular clouds and the Pegasus loop. We decomposed the ISM gas into intermediate-velocity clouds, narrow-line and optically thick HI, broad-line and optically thin HI, CO-bright H2, and CO-dark H2 using detailed correlations with the HI line profiles from the HI4PI survey, the Planck dust-emission model, and the Fermi-LAT $\gamma$-ray data. We found the fractions of optical depth correction to the HI column density and CO-dark H2 to be nearly equal. We fitted the CR spectra directly measured at/near the Earth and the measured $\gamma$-ray emissivity spectrum simultaneously. We obtained a spectral break in the interstellar proton spectrum at ${\sim}$7~GeV, and found the $\gamma$-ray emissivity normalization agrees with the AMS-02 proton spectrum within 10\%, relaxing the tension with the CR spectra previously claimed.


title: Polarized Color Image Denoising using Pocoformer

abstract: Polarized color photography provides both visual textures and object surficial information in one single snapshot. However, the use of the directional polarizing filter array causes extremely lower photon count and SNR compared to conventional color imaging. Thus, the feature essentially leads to unpleasant noisy images and destroys polarization analysis performance. It is a challenge for traditional image processing pipelines owing to the fact that the physical constraints exerted implicitly in the channels are excessively complicated. To address this issue, we propose a learning-based approach to simultaneously restore clean signals and precise polarization information. A real-world polarized color image dataset of paired raw short-exposed noisy and long-exposed reference images are captured to support the learning-based pipeline. Moreover, we embrace the development of vision Transformer and propose a hybrid transformer model for the Polarized Color image denoising, namely PoCoformer, for a better restoration performance. Abundant experiments demonstrate the effectiveness of proposed method and key factors that affect results are analyzed.


title: Updating Only Encoders Prevents Catastrophic Forgetting of End-to-End ASR Models

abstract: In this paper, we present an incremental domain adaptation technique to prevent catastrophic forgetting for an end-to-end automatic speech recognition (ASR) model. Conventional approaches require extra parameters of the same size as the model for optimization, and it is difficult to apply these approaches to end-to-end ASR models because they have a huge amount of parameters. To solve this problem, we first investigate which parts of end-to-end ASR models contribute to high accuracy in the target domain while preventing catastrophic forgetting. We conduct experiments on incremental domain adaptation from the LibriSpeech dataset to the AMI meeting corpus with two popular end-to-end ASR models and found that adapting only the linear layers of their encoders can prevent catastrophic forgetting. Then, on the basis of this finding, we develop an element-wise parameter selection focused on specific layers to further reduce the number of fine-tuning parameters. Experimental results show that our approach consistently prevents catastrophic forgetting compared to parameter selection from the whole model.


title: On the fault-tolerance threshold for surface codes with general noise

abstract: Fault-tolerant quantum computing based on surface codes has emerged as a popular route to large-scale quantum computers capable of accurate computation even in the presence of noise. Its popularity is, in part, because the fault-tolerance or accuracy threshold for surface codes is believed to be less stringent than competing schemes. This threshold is the noise level below which computational accuracy can be increased by increasing physical resources for noise removal, and is an important engineering target for realising quantum devices. The current conclusions about surface code thresholds are, however, drawn largely from studies of probabilistic noise. While a natural assumption, current devices experience noise beyond such a model, raising the question of whether conventional statements about the thresholds apply. Here, we attempt to extend past proof techniques to derive the fault-tolerance threshold for surface codes subjected to general noise with no particular structure. Surprisingly, we found no nontrivial threshold, i.e., there is no guarantee the surface code prescription works for general noise. While this is not a proof that the scheme fails, we argue that current proof techniques are likely unable to provide an answer. A genuinely new idea is needed, to reaffirm the feasibility of surface code quantum computing.


title: Interaction Energies on Noisy Intermediate-Scale Quantum Computers

abstract: The computation of interaction energies on noisy intermediate-scale quantum (NISQ) computers appears to be challenging with straightforward application of existing quantum algorithms. For example, use of the standard supermolecular method with the variational quantum eigensolver (VQE) would require extremely precise resolution of the total energies of the fragments to provide for accurate subtraction to the interaction energy. Here we present a symmetry-adapted perturbation theory (SAPT) method that may provide interaction energies with high quantum resource efficiency. Of particular note, we present a quantum extended random-phase approximation (ERPA) treatment of the SAPT second-order induction and dispersion terms, including exchange counterparts. Together with previous work on first-order terms, this provides a recipe for complete SAPT(VQE) interaction energies up to second order. The SAPT interaction energy terms are computed as first-level observables with no subtraction of monomer energies invoked, and the only quantum observations needed are the the VQE one- and two-particle density matrices. We find empirically that SAPT(VQE) can provide accurate interaction energies even with coarsely optimized, low circuit depth wavefunctions from the quantum computer, simulated through ideal statevectors. The errors on the total interaction energy are orders of magnitude lower than the corresponding VQE total energy errors of the monomer wavefunctions.


title: Ranking Constraint Relaxations for Mixed Integer Programs Using a Machine Learning Approach

abstract: Solving large-scale Mixed Integer Programs (MIP) can be difficult without advanced algorithms such as decomposition based techniques. Even if a decomposition technique might be appropriate, there are still many possible decompositions for any large MIP and it may not be obvious which will be the most effective. This paper presents a comprehensive analysis of the predictive capabilities of a Machine Learning ranking (ML) function for predicting the quality of Mixed Integer Programming (MIP) decompositions created via constraint relaxation. In this analysis, the role of instance similarity and ML prediction quality is explored, as well as the benchmarking of a ML ranking function against existing heuristic functions. For this analysis, a new dataset consisting of over 40000 unique decompositions sampled from across 24 instances from the MIPLIB2017 library has been established. These decompostions have been created by both a greedy relaxation algorithm as well as a population based multi-objective algorithm, which has previously been shown to produce high quality decompositions. In this paper, we demonstrate that a ML ranking function is able to provide state-of-the-art predictions when benchmarked against existing heuristic ranking functions. Additionally, we demonstrate that by only considering a small set of features related to the relaxed constraints in each decomposition, a ML ranking function is still able to be competitive with heuristic techniques. Such a finding is promising for future constraint relaxation approaches, as these features can be used to guide decomposition creation. Finally, we highlight where a ML ranking function would be beneficial in a decomposition creation framework.


title: Pile of Law: Learning Responsible Data Filtering from the Law and a 256GB Open-Source Legal Dataset

abstract: One concern with the rise of large language models lies with their potential for significant harm, particularly from pretraining on biased, obscene, copyrighted, and private information. Emerging ethical approaches have attempted to filter pretraining material, but such approaches have been ad hoc and failed to take context into account. We offer an approach to filtering grounded in law, which has directly addressed the tradeoffs in filtering material. First, we gather and make available the Pile of Law, a 256GB (and growing) dataset of open-source English-language legal and administrative data, covering court opinions, contracts, administrative rules, and legislative records. Pretraining on the Pile of Law may help with legal tasks that have the promise to improve access to justice. Second, we distill the legal norms that governments have developed to constrain the inclusion of toxic or private content into actionable lessons for researchers and discuss how our dataset reflects these norms. Third, we show how the Pile of Law offers researchers the opportunity to learn such filtering rules directly from the data, providing an exciting new research direction in model-based processing.


title: VL-CheckList: Evaluating Pre-trained Vision-Language Models with Objects, Attributes and Relations

abstract: Vision-Language Pretraining (VLP) models have recently successfully facilitated many cross-modal downstream tasks. Most existing works evaluated their systems by comparing the fine-tuned downstream task performance. However, only average downstream task accuracy provides little information about the pros and cons of each VLP method, let alone provides insights on how the community can improve the systems in the future. Inspired by the CheckList for testing natural language processing, we exploit VL-CheckList, a novel framework to understand the capabilities of VLP models. The proposed method divides the image-texting ability of a VLP model into three categories: objects, attributes, and relations, and uses a novel taxonomy to further break down these three aspects. We conduct comprehensive studies to analyze seven recently popular VLP models via the proposed framework. Results confirm the effectiveness of the proposed method by revealing fine-grained differences among the compared models that were not visible from downstream task-only evaluation. Further results show promising research direction in building better VLP models. Our data and code are available at: https://github.com/om-ai-lab/VL-CheckList.