title: SOLAR: A Highly Optimized Data Loading Framework for Distributed Training of CNN-based Scientific Surrogates

abstract: CNN-based surrogates have become prevalent in scientific applications to replace conventional time-consuming physical approaches. Although these surrogates can yield satisfactory results with significantly lower computation costs over small training datasets, our benchmarking results show that data-loading overhead becomes the major performance bottleneck when training surrogates with large datasets. In practice, surrogates are usually trained with high-resolution scientific data, which can easily reach the terabyte scale. Several state-of-the-art data loaders are proposed to improve the loading throughput in general CNN training; however, they are sub-optimal when applied to the surrogate training. In this work, we propose SOLAR, a surrogate data loader, that can ultimately increase loading throughput during the training. It leverages our three key observations during the benchmarking and contains three novel designs. Specifically, SOLAR first generates a pre-determined shuffled index list and accordingly optimizes the global access order and the buffer eviction scheme to maximize the data reuse and the buffer hit rate. It then proposes a tradeoff between lightweight computational imbalance and heavyweight loading workload imbalance to speed up the overall training. It finally optimizes its data access pattern with HDF5 to achieve a better parallel I/O throughput. Our evaluation with three scientific surrogates and 32 GPUs illustrates that SOLAR can achieve up to 24.4X speedup over PyTorch Data Loader and 3.52X speedup over state-of-the-art data loaders.


title: Iterative algorithms for partitioned neural network approximation to partial differential equations

abstract: To enhance solution accuracy and training efficiency in neural network approximation to partial differential equations, partitioned neural networks can be used as a solution surrogate instead of a single large and deep neural network defined on the whole problem domain. In such a partitioned neural network approach, suitable interface conditions or subdomain boundary conditions are combined to obtain a convergent approximate solution. However, there has been no rigorous study on the convergence and parallel computing enhancement on the partitioned neural network approach. In this paper, iterative algorithms are proposed to address these issues. Our algorithms are based on classical additive Schwarz domain decomposition methods. Numerical results are included to show the performance of the proposed iterative algorithms.


title: Waveform Boundary Detection for Partially Spoofed Audio

abstract: The present paper proposes a waveform boundary detection system for audio spoofing attacks containing partially manipulated segments. Partially spoofed/fake audio, where part of the utterance is replaced, either with synthetic or natural audio clips, has recently been reported as one scenario of audio deepfakes. As deepfakes can be a threat to social security, the detection of such spoofing audio is essential. Accordingly, we propose to address the problem with a deep learning-based frame-level detection system that can detect partially spoofed audio and locate the manipulated pieces. Our proposed method is trained and evaluated on data provided by the ADD2022 Challenge. We evaluate our detection model concerning various acoustic features and network configurations. As a result, our detection system achieves an equal error rate (EER) of 6.58% on the ADD2022 challenge test set, which is the best performance in partially spoofed audio detection systems that can locate manipulated clips.


title: Transfer Learning with Kernel Methods

abstract: Transfer learning refers to the process of adapting a model trained on a source task to a target task. While kernel methods are conceptually and computationally simple machine learning models that are competitive on a variety of tasks, it has been unclear how to perform transfer learning for kernel methods. In this work, we propose a transfer learning framework for kernel methods by projecting and translating the source model to the target task. We demonstrate the effectiveness of our framework in applications to image classification and virtual drug screening. In particular, we show that transferring modern kernels trained on large-scale image datasets can result in substantial performance increase as compared to using the same kernel trained directly on the target task. In addition, we show that transfer-learned kernels allow a more accurate prediction of the effect of drugs on cancer cell lines. For both applications, we identify simple scaling laws that characterize the performance of transfer-learned kernels as a function of the number of target examples. We explain this phenomenon in a simplified linear setting, where we are able to derive the exact scaling laws. By providing a simple and effective transfer learning framework for kernel methods, our work enables kernel methods trained on large datasets to be easily adapted to a variety of downstream target tasks.


title: Fault diagnosis for three-phase PWM rectifier based on deep feedforward network with transient synthetic features

abstract: Three-phase PWM rectifiers are adopted extensively in industry because of their excellent properties and potential advantages. However, while the IGBT has an open-circuit fault, the system does not crash suddenly, the performance will be reduced for instance voltages fluctuation and current harmonics. A fault diagnosis method based on deep feedforward network with transient synthetic features is proposed to reduce the dependence on the fault mathematical models in this paper, which mainly uses the transient phase current to train the deep feedforward network classifier. Firstly, the features of fault phase current are analyzed in this paper. Secondly, the historical fault data after feature synthesis is employed to train the deep feedforward network classifier, and the average fault diagnosis accuracy can reach 97.85% for transient synthetic fault data, the classifier trained by the transient synthetic features obtained more than 1% gain in performance compared with original transient features. Finally, the online fault diagnosis experiments show that the method can accurately locate the fault IGBTs, and the final diagnosis result is determined by multiple groups results, which has the ability to increase the accuracy and reliability of the diagnosis results. (c) 2020 ISA. Published by Elsevier Ltd. All rights reserved.


title: Full-Duplex Communication for ISAC: Joint Beamforming and Power Optimization

abstract: Beamforming design has been widely investigated for integrated sensing and communication (ISAC) systems with full-duplex (FD) sensing and half-duplex (HD) communication. To achieve higher spectral efficiency, in this paper, we extend existing ISAC beamforming design by considering the FD capability for both radar and communication. Specifically, we consider an ISAC system, where the BS performs target detection and communicates with multiple downlink users and uplink users reusing the same time and frequency resources. We jointly optimize the downlink dual-functional transmit signal and the uplink receive beamformers at the BS and the transmit power at the uplink users. The problems are formulated under two criteria: power consumption minimization and sum rate maximization. The downlink and uplink transmissions are tightly coupled due to both the desired target echo and the undesired interference received at the BS, making the problems challenging. To handle these issues in both cases, we first determine the optimal receive beamformers, which are derived in closed forms with respect to the BS transmit beamforming and the user transmit power, for radar target detection and uplink communications, respectively. Subsequently, we invoke these results to obtain equivalent optimization problems and propose efficient iterative algorithms to solve them by using the techniques of rank relaxation and successive convex approximation (SCA), where the adopted relaxation is proven to be tight. In addition, we consider a special case under the power minimization criterion and propose an alternative low complexity design. Numerical results demonstrate that the optimized FD communication-based ISAC brings tremendous improvements in terms of both power efficiency and spectral efficiency compared to the conventional ISAC with HD communication.


title: Survey on Source-coding technique

abstract: Shannon separation theorem lays the foundation for traditional image compression and transmission schemes, which consist of JPEG type image compression methods and the usual channel coding schemes such as Turbo and LDPC codes. One of the advantages of the separate design is that each of the two components, channel coding and source coding can be handled independently without considering the other, which is the base of decades-long technologies.


title: Ultra-high energy cosmic neutrinos from gamma-ray bursts

abstract: Based on recent proposal to associate IceCube TeV and PeV neutrino events with gamma-ray bursts~(GRBs) by considering the Lorentz violation of neutrinos, we provide a new estimate on the GRB neutrino flux and such result is much bigger than previous results by the IceCube Collaboration. Among these 24 neutrino ``shower" events above 60~TeV, 12 events are associated with GRBs. Such result is comparable with the prediction from GRB fireball models. Analysis of track events provide consistent result with the shower events to associate high energy cosmic neutrinos with GRBs under the same Lorentz violation features of neutrinos. We also make a background estimation and reveal GRBs as a significant source for the ultra-high energy IceCube neutrino events. Our work supports the Lorentz violation and $CPT$-violation of neutrinos, indicating new physics beyond relativity.


title: Robust Classification of Digitally Modulated Signals Using Capsule Networks and Cyclic Cumulant Features

abstract: The paper studies the problem of robust classification of digitally modulated signals using capsule networks and cyclic cumulant (CC) features extracted by cyclostationary signal processing (CSP). Two distinct datasets that contain similar classes of digitally modulated signals but that have been generated independently are used in the study, which reveals that capsule networks trained using CCs achieve high classification accuracy while also outperforming other deep learning-based approaches in terms of classification accuracy as well as generalization abilities.


title: Detection of (Hidden) Emotions from Videos using Muscles Movements and Face Manifold Embedding

abstract: We provide a new non-invasive, easy-to-scale for large amounts of subjects and a remotely accessible method for (hidden) emotion detection from videos of human faces. Our approach combines face manifold detection for accurate location of the face in the video with local face manifold embedding to create a common domain for the measurements of muscle micro-movements that is invariant to the movement of the subject in the video. In the next step, we employ the Digital Image Speckle Correlation (DISC) and the optical flow algorithm to compute the pattern of micro-movements in the face. The corresponding vector field is mapped back to the original space and superimposed on the original frames of the videos. Hence, the resulting videos include additional information about the direction of the movement of the muscles in the face. We take the publicly available CK++ dataset of visible emotions and add to it videos of the same format but with hidden emotions. We process all the videos using our micro-movement detection and use the results to train a state-of-the-art network for emotions classification from videos -- Frame Attention Network (FAN). Although the original FAN model achieves very high out-of-sample performance on the original CK++ videos, it does not perform so well on hidden emotions videos. The performance improves significantly when the model is trained and tested on videos with the vector fields of muscle movements. Intuitively, the corresponding arrows serve as edges in the image that are easily captured by the convolutions filters in the FAN network.


title: Clustering-Based Approaches for Symbolic Knowledge Extraction

abstract: Opaque models belonging to the machine learning world are ever more exploited in the most different application areas. These models, acting as black boxes (BB) from the human perspective, cannot be entirely trusted if the application is critical unless there exists a method to extract symbolic and human-readable knowledge out of them. In this paper we analyse a recurrent design adopted by symbolic knowledge extractors for BB regressors - that is, the creation of rules associated with hypercubic input space regions. We argue that this kind of partitioning may lead to suboptimal solutions when the data set at hand is high-dimensional or does not satisfy symmetric constraints. We then propose a (deep) clustering-based approach to be performed before symbolic knowledge extraction to achieve better performance with data sets of any kind.


title: Efficient AlphaFold2 Training using Parallel Evoformer and Branch Parallelism

abstract: The accuracy of AlphaFold2, a frontier end-to-end structure prediction system, is already close to that of the experimental determination techniques. Due to the complex model architecture and large memory consumption, it requires lots of computational resources and time to train AlphaFold2 from scratch. Efficient AlphaFold2 training could accelerate the development of life science. In this paper, we propose a Parallel Evoformer and Branch Parallelism to speed up the training of AlphaFold2. We conduct sufficient experiments on UniFold implemented in PyTorch and HelixFold implemented in PaddlePaddle, and Branch Parallelism can improve the training performance by 38.67% and 36.93%, respectively. We also demonstrate that the accuracy of Parallel Evoformer could be on par with AlphaFold2 on the CASP14 and CAMEO datasets. The source code is available on https://github.com/PaddlePaddle/PaddleFleetX


title: The Age and Erosion Rate of Young Sedimentary Rock on Mars

abstract: The Medusae Fossae Formation (MFF) is an enigmatic sedimentary unit near the equator of Mars, with an uncertain formation process and absolute age. Due to the heavily wind-eroded surface, it is difficult to determine the absolute model age of the MFF using a one-parameter model based on the crater size-frequency distribution function with existing crater count data. We create a new two-parameter model that estimates both age and a constant erosion rate ($\beta$) by treating cratering as a random Poisson process. Our study uses new crater count data collected from Context Camera imagery for both the MFF and other young equatorial sedimentary rock. Based on our new model, the Central MFF formed $>$1.5 Gyr ago and had low erosion rates ($<$650 nm yr$^{-1}$), whereas the East MFF, Far East MFF, and Zephyria Planum most likely formed $<$1.5 Gyr ago and had higher erosion rates ($>$740 nm $^{-1}$). The top of Aeolis Mons (informally known as Mount Sharp) in Gale Crater and Eastern Candor have relatively young ages and low erosion rates. Based on the estimated erosion rates (since fast erosion permits metastable shallow ice), we also identify several sites, including Zephyria Planum, as plausible locations for shallow subsurface equatorial water ice that is detectable by gamma-ray spectroscopy or neutron spectroscopy. In addition to confirming $<$1.5 Gyr sedimentary rock formations on Mars, and distinguishing older and younger MFF sites, we find that fast-eroding locations have younger ages and MFF locations with slower erosion have older best-fit ages.


title: Optimization of convolutional neural networks for background suppression in the PandaX-III experiment

abstract: The tracks recorded by a gaseous detector provide a possibility for charged particle identification. For searching the neutrinoless double beta decay events of 136Xe in the PandaX-III experiment, we optimized the convolutional neural network based on the Monte Carlo simulation data to improve the signal-background discrimination power. EfficientNet is chosen as the baseline model and the optimization is performed by tuning the hyperparameters. In particular, the maximum discrimination power is achieved by optimizing the channel number of the top convolutional layer. In comparison with our previous work, the significance of discrimination has been improved by about 70%.


title: Evaluation Metrics for Symbolic Knowledge Extracted from Machine Learning Black Boxes: A Discussion Paper

abstract: As opaque decision systems are being increasingly adopted in almost any application field, issues about their lack of transparency and human readability are a concrete concern for end-users. Amongst existing proposals to associate human-interpretable knowledge with accurate predictions provided by opaque models, there are rule extraction techniques, capable of extracting symbolic knowledge out of an opaque model. However, how to assess the level of readability of the extracted knowledge quantitatively is still an open issue. Finding such a metric would be the key, for instance, to enable automatic comparison between a set of different knowledge representations, paving the way for the development of parameter autotuning algorithms for knowledge extractors. In this paper we discuss the need for such a metric as well as the criticalities of readability assessment and evaluation, taking into account the most common knowledge representations while highlighting the most puzzling issues.


title: ARDIR: Improving Robustness using Knowledge Distillation of Internal Representation

abstract: Adversarial training is the most promising method for learning robust models against adversarial examples. A recent study has shown that knowledge distillation between the same architectures is effective in improving the performance of adversarial training. Exploiting knowledge distillation is a new approach to improve adversarial training and has attracted much attention. However, its performance is still insufficient. Therefore, we propose Adversarial Robust Distillation with Internal Representation~(ARDIR) to utilize knowledge distillation even more effectively. In addition to the output of the teacher model, ARDIR uses the internal representation of the teacher model as a label for adversarial training. This enables the student model to be trained with richer, more informative labels. As a result, ARDIR can learn more robust student models. We show that ARDIR outperforms previous methods in our experiments.


title: Angular upsampling in diffusion MRI using contextual HemiHex sub-sampling in q-space

abstract: Artificial Intelligence (Deep Learning(DL)/ Machine Learning(ML)) techniques are widely being used to address and overcome all kinds of ill-posed problems in medical imaging which was or in fact is seemingly impossible. Reducing gradient directions but harnessing high angular resolution(HAR) diffusion data in MR that retains clinical features is an important and challenging problem in the field. While the DL/ML approaches are promising, it is important to incorporate relevant context for the data to ensure that maximum prior information is provided for the AI model to infer the posterior. In this paper, we introduce HemiHex (HH) subsampling to suggestively address training data sampling on q-space geometry, followed by a nearest neighbor regression training on the HH-samples to finally upsample the dMRI data. Earlier studies has tried to use regression for up-sampling dMRI data but yields performance issues as it fails to provide structured geometrical measures for inference. Our proposed approach is a geometrically optimized regression technique which infers the unknown q-space thus addressing the limitations in the earlier studies.


title: Adversarial Policies Beat Superhuman Go AIs

abstract: We attack the state-of-the-art Go-playing AI system KataGo by training adversarial policies against it, achieving a >97% win rate against KataGo running at superhuman settings. Our adversaries do not win by playing Go well. Instead, they trick KataGo into making serious blunders. Our attack transfers zero-shot to other superhuman Go-playing AIs, and is comprehensible to the extent that human experts can implement it without algorithmic assistance to consistently beat superhuman AIs. The core vulnerability uncovered by our attack persists even in KataGo agents adversarially trained to defend against our attack. Our results demonstrate that even superhuman AI systems may harbor surprising failure modes. Example games are available https://goattack.far.ai/.


title: Boundless baryons: how diffuse gas contributes to anisotropic tSZ signal around simulated Three Hundred clusters

abstract: Upcoming advances in galaxy surveys and cosmic microwave background data will enable measurements of the anisotropic distribution of diffuse gas in filaments and superclusters at redshift $z=1$ and beyond, observed through the thermal Sunyaev-Zel'dovich (tSZ) effect. These measurements will help distinguish between different astrophysical feedback models, account for baryons that appear to be 'missing' from the cosmic census, and present opportunities for using locally-anisotropic tSZ statistics as cosmological probes. This study seeks to guide such future measurements by analysing whether diffuse intergalactic gas is a major contributor to anisotropic tSZ signal in The Three Hundred Gizmo-Simba hydrodynamic simulations. We apply multiple different halo boundary and temperature criteria to divide concentrated from diffuse gas at $z=1$, then create mock Compton-$y$ maps for the separated components. The maps from 98 simulation snapshots are centred on massive galaxy clusters, oriented by the most prominent galaxy filament axis, and stacked. Results vary significantly depending on the definition used for diffuse gas, indicating that assumptions should be clearly defined when claiming observations of the warm-hot intergalactic medium. In all cases, the diffuse gas is important, contributing 25-60% of the tSZ signal in the far field ($>4 h^{-1}$ comoving Mpc) from the stacked clusters. The gas 1-2 virial radii from halo centres is especially key. Oriented stacking and environmental selections help to amplify the signal from the warm-hot intergalactic medium, which is aligned but less concentrated along the filament axis than the hot halo gas.


title: Why Is It Hate Speech? Masked Rationale Prediction for Explainable Hate Speech Detection

abstract: In a hate speech detection model, we should consider two critical aspects in addition to detection performance-bias and explainability. Hate speech cannot be identified based solely on the presence of specific words: the model should be able to reason like humans and be explainable. To improve the performance concerning the two aspects, we propose Masked Rationale Prediction (MRP) as an intermediate task. MRP is a task to predict the masked human rationales-snippets of a sentence that are grounds for human judgment-by referring to surrounding tokens combined with their unmasked rationales. As the model learns its reasoning ability based on rationales by MRP, it performs hate speech detection robustly in terms of bias and explainability. The proposed method generally achieves state-of-the-art performance in various metrics, demonstrating its effectiveness for hate speech detection.


title: Nonlocal optical conductivity of Fermi surface nesting materials

abstract: We investigate the nonlocal optical conductivity of Fermi surface nesting materials which support charge density waves or spin density waves. The nonlocal optical conductivity contains information of correlations in electron fluids which could not be accessed by standard optical probes. Half metal emerges from doping a charge density wave and similarly spin-valley half metal emerges from doping a spin density wave. Based on the parabolic band approximation, we find the Drude peak is shifted to higher frequency and splits into two peaks in the nonlocal optical conductivity. We attribute this to the two Fermi velocities in the half-metal or spin-valley half metal states.


title: Pairing cellular and synaptic dynamics into building blocks of rhythmic neural circuits

abstract: The purpose of this paper is trifold -- to serve as an instructive resource and a reference catalog for biologically plausible modeling with i) conductance-based models, coupled with ii) strength-varying slow synapse models, culminating in iii) two canonical pair-wise rhythm-generating networks. We document the properties of basic network components: cell models and synaptic models, which are prerequisites for proper network assembly. Using the slow-fast decomposition we present a detailed analysis of the cellular dynamics including a discussion of the most relevant bifurcations. Several approaches to model synaptic coupling are also discussed, and a new logistic model of slow synapses is introduced. Finally, we describe and examine two types of bicellular rhythm-generating networks: i) half-center oscillators ii) excitatory-inhibitory pairs and elucidate a key principle -- the network hysteresis underlying the stable onset of emergent slow bursting in these neural building blocks. These two cell networks are a basis for more complicated neural circuits of rhythmogensis and feature in our models of swim central pattern generators.


title: Batch Active Learning from the Perspective of Sparse Approximation

abstract: Active learning enables efficient model training by leveraging interactions between machine learning agents and human annotators. We study and propose a novel framework that formulates batch active learning from the sparse approximation's perspective. Our active learning method aims to find an informative subset from the unlabeled data pool such that the corresponding training loss function approximates its full data pool counterpart. We realize the framework as sparsity-constrained discontinuous optimization problems, which explicitly balance uncertainty and representation for large-scale applications and could be solved by greedy or proximal iterative hard thresholding algorithms. The proposed method can adapt to various settings, including both Bayesian and non-Bayesian neural networks. Numerical experiments show that our work achieves competitive performance across different settings with lower computational complexity.


title: Discrete Factorial Representations as an Abstraction for Goal Conditioned Reinforcement Learning

abstract: Goal-conditioned reinforcement learning (RL) is a promising direction for training agents that are capable of solving multiple tasks and reach a diverse set of objectives. How to \textit{specify} and \textit{ground} these goals in such a way that we can both reliably reach goals during training as well as generalize to new goals during evaluation remains an open area of research. Defining goals in the space of noisy and high-dimensional sensory inputs poses a challenge for training goal-conditioned agents, or even for generalization to novel goals. We propose to address this by learning factorial representations of goals and processing the resulting representation via a discretization bottleneck, for coarser goal specification, through an approach we call DGRL. We show that applying a discretizing bottleneck can improve performance in goal-conditioned RL setups, by experimentally evaluating this method on tasks ranging from maze environments to complex robotic navigation and manipulation. Additionally, we prove a theorem lower-bounding the expected return on out-of-distribution goals, while still allowing for specifying goals with expressive combinatorial structure.


title: Identities for the k-generalized Fibonacci sequence with negative indices and its zero-multiplicity

abstract: In this paper, we prove identities for members of the k-generalized Fibonacci sequence with negative indices and we apply these identities to deduce an exact formula for its zero-multiplicity.


title: Robust Direct Learning for Causal Data Fusion

abstract: In the era of big data, the explosive growth of multi-source heterogeneous data offers many exciting challenges and opportunities for improving the inference of conditional average treatment effects. In this paper, we investigate homogeneous and heterogeneous causal data fusion problems under a general setting that allows for the presence of source-specific covariates. We provide a direct learning framework for integrating multi-source data that separates the treatment effect from other nuisance functions, and achieves double robustness against certain misspecification. To improve estimation precision and stability, we propose a causal information-aware weighting function motivated by theoretical insights from the semiparametric efficiency theory; it assigns larger weights to samples containing more causal information with high interpretability. We introduce a two-step algorithm, the weighted multi-source direct learner, based on constructing a pseudo-outcome and regressing it on covariates under a weighted least square criterion; it offers us a powerful tool for causal data fusion, enjoying the advantages of easy implementation, double robustness and model flexibility. In simulation studies, we demonstrate the effectiveness of our proposed methods in both homogeneous and heterogeneous causal data fusion scenarios.


title: FADO: Feedback-Aware Double COntrolling Network for Emotional Support Conversation

abstract: Emotional Support Conversation (ESConv) aims to reduce help-seekers'emotional distress with the supportive strategy and response. It is essential for the supporter to select an appropriate strategy with the feedback of the help-seeker (e.g., emotion change during dialog turns, etc) in ESConv. However, previous methods mainly focus on the dialog history to select the strategy and ignore the help-seeker's feedback, leading to the wrong and user-irrelevant strategy prediction. In addition, these approaches only model the context-to-strategy flow and pay less attention to the strategy-to-context flow that can focus on the strategy-related context for generating the strategy-constrain response. In this paper, we propose a Feedback-Aware Double COntrolling Network (FADO) to make a strategy schedule and generate the supportive response. The core module in FADO consists of a dual-level feedback strategy selector and a double control reader. Specifically, the dual-level feedback strategy selector leverages the turn-level and conversation-level feedback to encourage or penalize strategies. The double control reader constructs the novel strategy-to-context flow for generating the strategy-constrain response. Furthermore, a strategy dictionary is designed to enrich the semantic information of the strategy and improve the quality of strategy-constrain response. Experimental results on ESConv show that the proposed FADO has achieved the state-of-the-art performance in terms of both strategy selection and response generation. Our code is available at https://github.com/Thedatababbler/FADO.


title: Differentiable Model Selection for Ensemble Learning

abstract: Model selection is a strategy aimed at creating accurate and robust models. A key challenge in designing these algorithms is identifying the optimal model for classifying any particular input sample. This paper addresses this challenge and proposes a novel framework for differentiable model selection integrating machine learning and combinatorial optimization. The framework is tailored for ensemble learning, a strategy that combines the outputs of individually pre-trained models, and learns to select appropriate ensemble members for a particular input sample by transforming the ensemble learning task into a differentiable selection program trained end-to-end within the ensemble learning model. Tested on various tasks, the proposed framework demonstrates its versatility and effectiveness, outperforming conventional and advanced consensus rules across a variety of settings and learning tasks.


title: Structure-preserving techniques in accelerator physics

abstract: To a very good approximation, particularly for hadron machines, charged-particle trajectories in accelerators obey Hamiltonian mechanics. During routine storage times of eight hours or more, such particles execute some $10^{8}$ revolutions about the machine, $10^{10}$ oscillations about the design orbit, and $10^{13}$ passages through various bending and focusing elements. Prior to building, or modifying, such a machine, we seek to identify accurately the long-term behavior and stability of particle orbits over such large numbers of interactions. This demanding computational effort does not yield easily to traditional methods of symplectic numerical integration, including both explicit Yoshida-type and implicit Runge-Kutta or Gaussian methods. As an alternative, one may compute an approximate one-turn map and then iterate that map. We describe some of the essential considerations and techniques for constructing such maps to high order and for realistic magnetic field models. Particular attention is given to preserving the symplectic condition characteristic of Hamiltonian mechanics.


title: Observation of oscillating $g$-factor anisotropy arising from strong crystal lattice anisotropy in GaAs spin-3/2 hole quantum point contacts

abstract: Many modern spin-based devices rely on the spin-orbit interaction, which is highly sensitive to the host semiconductor heterostructure and varies substantially depending on crystal direction, crystal asymmetry (Dresselhaus), and quantum confinement asymmetry (Rashba). One-dimensional quantum point contacts are a powerful tool to probe both energy and directional dependence of spin-orbit interaction through the effect on the hole $g$-factor. In this work we investigate the role of cubic crystal asymmetry in driving an oscillation in the in-plane hole $g$-factor anisotropy when the quantum point contact is rotated with respect to the crystal axes, and we are able to separate contributions to the Zeeman Hamiltonian arising from Rashba and cubic crystal asymmetry spin-orbit interactions. The in-plane $g$-factor is found to be extremely sensitive to the orientation of the quantum point contact, changing by a factor of $5$ when rotated by $45^{\circ}$. This exceptionally strong crystal lattice anisotropy of the in-plane Zeeman splitting cannot be explained within axially symmetric theoretical models. Theoretical modelling based on the combined Luttinger, Rashba and Dresselhaus Hamiltonians that we use here reveals new spin-orbit contributions to the in-plane hole $g$-factor and provides an excellent agreement with our experimental data.


title: The X-shaped radio galaxy J0725+5835 is associated with an AGN pair

abstract: X-shaped radio galaxies (XRGs) are those that exhibit two pairs of unaligned radio lobes (main radio lobes and "wings"), one of the promising models for the peculiar morphology is jet re-orientation. To clarify it, we conducted the European VLBI Network (EVN) 5 GHz observation of an XRG J0725+5835, which resembles the archetypal binary AGNs 0402+379 in radio morphology but it is larger in angular size. In our observation, two milliarcsec (mas) scale radio components with non-thermal radio emission are detected, each of them coincides with an optical counterpart with similar photometric redshift and (optical and infrared) magnitude, corresponding to dual active nuclei. Furthermore, with the improved VLA images, we find a bridge between the two radio cores and a jet bending in the region surrounding the companion galaxy, which further supports the interplay between the main and companion galaxies. In addition, we also report the discovery of an arcsec-scale jet in the companion. Given the projected separation of $\sim100$ kpc between the main and companion galaxies, XRG J0725+5835 is likely associated with a dual jetted-AGN system. In both EVN and VLA observations, we find signatures that the jet is changing its direction, which is likely responsible for the X-shaped morphology. On the origin of jet re-orientation, several scenarios are discussed.


title: CARE: Causality Reasoning for Empathetic Responses by Conditional Graph Generation

abstract: Recent approaches to empathetic response generation incorporate emotion causalities to enhance comprehension of both the user's feelings and experiences. However, these approaches suffer from two critical issues. First, they only consider causalities between the user's emotion and the user's experiences, and ignore those between the user's experiences. Second, they neglect interdependence among causalities and reason them independently. To solve the above problems, we expect to reason all plausible causalities interdependently and simultaneously, given the user's emotion, dialogue history, and future dialogue content. Then, we infuse these causalities into response generation for empathetic responses. Specifically, we design a new model, i.e., the Conditional Variational Graph Auto-Encoder (CVGAE), for the causality reasoning, and adopt a multi-source attention mechanism in the decoder for the causality infusion. We name the whole framework as CARE, abbreviated for CAusality Reasoning for Empathetic conversation. Experimental results indicate that our method achieves state-of-the-art performance.


title: Feature-Informed Data Assimilation -- Definitions and Illustrative Examples

abstract: We introduce a mathematical formulation of feature-informed data assimilation (FIDA). In FIDA, the information about feature events, such as shock waves, level curves, wavefronts and peak value, in dynamical systems are used for the estimation of state variables and unknown parameters. The observation operator in FIDA is a set-valued functional, which is fundamentally different from the observation operators in conventional data assimilation. Demonstrated in three example, FIDA problems introduced in this note exist in a wide spectrum of applications in science and engineering.


title: Modeling of three-dimensional betatron oscillation and radiation reaction in plasma accelerators

abstract: Betatron oscillation is a commonly known phenomenon in laser or beam driven plasma wakefield accelerators. In the conventional model, the plasma wake provides a linear focusing force to a relativistic electron, and the electron oscillates in one transverse direction with the betatron frequency proportional to $1/\sqrt{\gamma}$, where $\gamma$ is the Lorentz factor of the electron. In this work, we extend this model to three-dimensional by considering the oscillation in two transverse and one longitudinal directions. The long-term equations, with motion in the betatron time scale averaged out, are obtained and compared with the original equations by numerical methods. In addition to the longitudinal and transverse damping due to radiation reaction which has been found before, we show phenomena including the longitudinal phase drift, betatron phase shift and betatron polarization change based on our long-term equations. This work can be highly valuable for future plasma based high-energy accelerators and colliders.


title: Spin-polarization anisotropy included by mechanical bending in tungsten diselenide nanoribbons and tunable excitonic states

abstract: A WSe$_2$ monolayer shows many interesting properties due to its spin-orbit coupling induced spin splitting in bands around the Fermi level and the spin-valley configuration. The orientation of the spin polarization in the relevant bands is crucial for the nature of exciton states and the optical valley selectivity. In this work, we studied the WSe$_2$ nanoribbons under different mechanical bending curvatures and electron/hole doping with density functional theory and their optical absorption and excitonic states with many-body perturbation GW and BSE (Bethe-Salpeter equation) methods. We found that the WSe$_2$ nanoribbons can exhibit an enhanced SOC effect and a spatially varying spin polarization in bands around the Fermi level under bending. The spin-polarization can show an anisotropy (or asymmetry) in those nearly degenerate bands, leading to a controllable magnetism via bending and electron/hole doping to the nanoribbons, suggesting a potential application in compact and controllable magnetic nanodevices and spintronics. The optical absorption spectrum of the nanoribbon presents a large tunability with bending within the near infrared region of about 0.4 to 1.5 eV, showing an enhanced absorption at a large bending condition. The exciton states generally show mixed or various spin configuration in the electron and hole pairs that are controlled by bending, potentially useful for applications in spin-based quantum information processes.


title: Hadwiger's Conjecture with Certain Forbidden Induced Subgraphs

abstract: We prove that $\{\overline{K_3}, H\}$-free graphs are not counterexamples to Hadwiger's Conjecture, where $H$ is any one of 33 graphs on seven, eight, or nine vertices, or $H=K_8$. This improves on past results of Plummer-Stiebitz-Toft, Kriesell, and Bosse. The proofs are mostly computer-assisted.


title: Zero-Density Theorems for Families of Dirichlet $L$-functions

abstract: In this paper, we prove some zero density theorems for certain families of Dirichlet $L$-functions. More specifically, the subjects of our interest are the collections of Dirichlet $L$-functions associated with characters to moduli from certain sparse sets and of certain fixed orders.


title: Learning Task-Aware Effective Brain Connectivity for fMRI Analysis with Graph Neural Networks

abstract: Functional magnetic resonance imaging (fMRI) has become one of the most common imaging modalities for brain function analysis. Recently, graph neural networks (GNN) have been adopted for fMRI analysis with superior performance. Unfortunately, traditional functional brain networks are mainly constructed based on similarities among region of interests (ROI), which are noisy and agnostic to the downstream prediction tasks and can lead to inferior results for GNN-based models. To better adapt GNNs for fMRI analysis, we propose TBDS, an end-to-end framework based on \underline{T}ask-aware \underline{B}rain connectivity \underline{D}AG (short for Directed Acyclic Graph) \underline{S}tructure generation for fMRI analysis. The key component of TBDS is the brain network generator which adopts a DAG learning approach to transform the raw time-series into task-aware brain connectivities. Besides, we design an additional contrastive regularization to inject task-specific knowledge during the brain network generation process. Comprehensive experiments on two fMRI datasets, namely Adolescent Brain Cognitive Development (ABCD) and Philadelphia Neuroimaging Cohort (PNC) datasets demonstrate the efficacy of TBDS. In addition, the generated brain networks also highlight the prediction-related brain regions and thus provide unique interpretations of the prediction results. Our implementation will be published to https://github.com/yueyu1030/TBDS upon acceptance.


title: Training Vision-Language Models with Less Bimodal Supervision

abstract: Standard practice in pretraining multimodal models, such as vision-language models, is to rely on pairs of aligned inputs from both modalities, for example, aligned image-text pairs. However, such pairs can be difficult to obtain in low-resource settings and for some modality pairs (e.g., structured tables and images). In this work, we investigate the extent to which we can reduce the reliance on such parallel data, which we term \emph{bimodal supervision}, and use models that are pretrained on each modality independently. We experiment with a high-performing vision-language model, and analyze the effect of bimodal supervision on three vision-language tasks. We find that on simpler tasks, such as VQAv2 and GQA, one can eliminate bimodal supervision completely, suffering only a minor loss in performance. Conversely, for NLVR2, which requires more complex reasoning, training without bimodal supervision leads to random performance. Nevertheless, using only 5\% of the bimodal data (142K images along with their captions), or leveraging weak supervision in the form of a list of machine-generated labels for each image, leads to only a moderate degradation compared to using 3M image-text pairs: 74\%$\rightarrow$$\sim$70\%. Our code is available at https://github.com/eladsegal/less-bimodal-sup.


title: Gate-tunable heavy fermions in a moir\'e Kondo lattice

abstract: The Kondo lattice, describing a matrix of local magnetic moments coupled via spin-exchange interactions to itinerant conduction electrons, is a prototype of strongly correlated quantum matter. Traditionally, Kondo lattices are realized in intermetallic compounds containing lanthanide or actinide. The complex electronic structure and limited tunability of both the electron density and exchange interactions in these bulk materials pose significant challenges to study Kondo lattice physics. Here, we report the realization of a synthetic Kondo lattice in AB-stacked MoTe2/WSe2 moir\'e bilayers, where the MoTe2 layer is tuned to a Mott insulating state, supporting a triangular moir\'e lattice of local moments, and the WSe2 layer is doped with itinerant conduction carriers. We observe heavy fermions with a large Fermi surface below the Kondo temperature. We also observe destruction of the heavy fermions by an external magnetic field with an abrupt decrease of the Fermi surface size and quasiparticle mass. We further demonstrate widely and continuously gate-tunable Kondo temperatures through either the itinerant carrier density or Kondo interaction. Our study opens the possibility of in-situ access to the rich phase diagram of the Kondo lattice with exotic quantum criticalities in a single device based on semiconductor moir\'e materials


title: Extreme electron acceleration with fixed radiation energy

abstract: We examine the extreme situation of radiation from an electron that is asymptotically accelerated to the speed of light, resulting in finite emission energy. The analytic solution explicitly demonstrates the difference between radiation power loss and kinetic power loss (null).


title: Interpolated polynomial multiple zeta values of fixed weight, depth, and height

abstract: We define the interpolated polynomial multiple zeta values as a generalization of all of multiple zeta values, multiple zeta-star values, interpolated multiple zeta values, symmetric multiple zeta values, and polynomial multiple zeta values. We then compute the generating function of the sum of interpolated polynomial multiple zeta values of fixed weight, depth, and height.


title: Two Low-complexity Efficient Beamformers for IRS-and-UAV-aided Directional Modulation Networks

abstract: As the excellent tools for aiding communication,intelligent reflecting surface (IRS) and unmanned aerial vehicle (UAV) can extend the coverage area, remove blind area, and achieve a dramatic rate improvement. In this paper, we improve the secrecy rate (SR) performance at directional modulation (DM) networks using IRS and UAV in combination. To fully explore the benefits of IRS and UAV, two efficient methods are proposed to enhance SR performance. The first approach computes the confidential message (CM) beamforming vector by maximizing the SR, and the signal-to-leakage-noise ratio (SLNR) method is used to optimize the IRS phase shift matrix, which is called Max-SR-SLNR. Here, Eve is maximally interfered by transmitting artificial noise (AN) along the direct path and null-space projection (NSP) on the remaining two channels. To reduce the computational complexity, the CM, AN beamforming and IRS phase shift design are independently designed in the following methods. The CM beamforming vector is constructed based on maximum ratio transmission (MRT) criteria along the channel from Alice-to-IRS, and phase shift matrix of IRS is directly given by phase alignment (PA) method. This method is called MRT-NSP-PA. Simulation results show that the SR performance of the Max-SR-SLNR method outperforms the MRT-NSP-PA method in the cases of small-scale and medium-scale IRSs, and the latter approaches the former in performance as IRS tends to lager-scale.


title: Strongly minimal reducts of ACVF

abstract: Let $\mathbb K=(K,+,\cdot,v,\Gamma)$ be a valued algebraically closed field of characteristic and $(G,\oplus)$ be a $\mathcal K$-interpretable group that is either locally isomorphic to $(K,+)$ or to $(K,\cdot)$. Then if $\mathcal G=(G,\oplus,\ldots)$ is a strongly minimal non locally modular structure intepretable in $\mathbb K$, it interprets a field. We also present an strategy for proving the same without the assumption of having a definable group operation.


title: Stacking designs: designing multi-fidelity computer experiments with target predictive accuracy

abstract: In an era where scientific experiments can be very costly, multi-fidelity emulators provide a useful tool for cost-efficient predictive scientific computing. For scientific applications, the experimenter is often limited by a tight computational budget, and thus wishes to (i) maximize predictive power of the multi-fidelity emulator via a careful design of experiments, and (ii) ensure this model achieves a desired error tolerance with some notion of confidence. Existing design methods, however, do not jointly tackle objectives (i) and (ii). We propose a novel stacking design approach that addresses both goals. A multi-level reproducing kernel Hilbert space (RKHS) interpolator is first introduced to build the emulator, under which our stacking design provides a sequential approach for designing multi-fidelity runs such that a desired prediction error of $\epsilon > 0$ is met under regularity assumptions. We then prove a novel cost complexity theorem that, under this multi-level interpolator, establishes a bound on the computation cost (for training data simulation) needed to achieve a prediction bound of $\epsilon$. This result provides novel insights on conditions under which the proposed multi-fidelity approach improves upon a conventional RKHS interpolator which relies on a single fidelity level. Finally, we demonstrate the effectiveness of stacking designs in a suite of simulation experiments and an application to finite element analysis.


title: Adversarial Training with Complementary Labels: On the Benefit of Gradually Informative Attacks

abstract: Adversarial training (AT) with imperfect supervision is significant but receives limited attention. To push AT towards more practical scenarios, we explore a brand new yet challenging setting, i.e., AT with complementary labels (CLs), which specify a class that a data sample does not belong to. However, the direct combination of AT with existing methods for CLs results in consistent failure, but not on a simple baseline of two-stage training. In this paper, we further explore the phenomenon and identify the underlying challenges of AT with CLs as intractable adversarial optimization and low-quality adversarial examples. To address the above problems, we propose a new learning strategy using gradually informative attacks, which consists of two critical components: 1) Warm-up Attack (Warm-up) gently raises the adversarial perturbation budgets to ease the adversarial optimization with CLs; 2) Pseudo-Label Attack (PLA) incorporates the progressively informative model predictions into a corrected complementary loss. Extensive experiments are conducted to demonstrate the effectiveness of our method on a range of benchmarked datasets. The code is publicly available at: https://github.com/RoyalSkye/ATCL.


title: Asymptotically multiplicative quantum invariants

abstract: The Euler characteristic and the volume are two best-known multiplicative invariants of manifolds under finite covers. On the other hand, quantum invariants of 3-manifolds are not multiplicative. We show that a perturbative power series, introduced by Dimofte and the first author and shown to be a topological invariant of cusped hyperbolic 3-manifolds by Storzer--Wheeler and the first author, and conjectured to agree with the asymptotics of the Kashaev invariant to all orders in perturbation theory, is asymptotically multiplicative under cyclic covers. Moreover, its coefficients are determined by polynomials constructed out of twisted Neumann--Zagier data. This gives a new $t$-deformation of the perturbative quantum invariants, different than the $x$-deformation obtained by deforming the geometric representation. We illustrate our results with several hyperbolic knots.


title: Photometric properties and stellar parameters of the rapidly rotating magnetic early-B star HD 345439

abstract: We first present the multicolor photometry results of the rapidly rotating magnetic star HD 345439 using the Nanshan One-meter Wide-field Telescope. From the photometric observations, we derive a rotational period of 0.7699\pm0.0014 day. The light curves of HD 345439 are dominated by the double asymmetric S-wave feature that arises from the magnetic clouds. Pulsating behaviors are not observed in Sector 41 of the Transiting Exoplanet Survey Satellite. No evidence is found of the occurrence of centrifugal breakout events neither in the residual flux nor in the systematic variations at the extremum of the light curve. Based on the hypothesis of the Rigidly Rotating Magnetosphere model, we restrict the magnetic obliquity angle {$\beta$} and the rotational inclination angle $i$ so that they satisfy the approximate relation {$\beta + i \approx 105^{\circ}$}. The colour excess, extinction, and luminosity are determined to be $E_{(B-V)}=0.745\pm0.016\,$mag, $A_{V}=2.31\pm0.05\,$mag, and $\rm log\,(L/L_{\odot})=3.82\pm0.1 $dex, respectively. Furthermore, we derive the effective temperature as $T$$\rm _{eff}=22\pm1 $kK and the surface gravity as log$g=4.00\pm0.22$. The mass$ M=7.24_{-1.24}^{+1.75}\rm M_{\odot}$, radius$ R=4.44_{-1.93}^{+2.68}\rm R_{\odot}$, and age$\rm \tau_{age}=23.62\,_{-21.97}^{+4.24} $Myr are estimated from the Hertzsprung--Russell Diagram


title: RF-CHORD: Towards Deployable RFID Localization System for Logistics Network

abstract: RFID localization is considered the key enabler of automating the process of inventory tracking and management for high-performance logistic network. A practical and deployable RFID localization system needs to meet reliability, throughput, and range requirements. This paper presents RF-Chord, the first RFID localization system that simultaneously meets all three requirements. RF-Chord features a one-shot multisine-constructed wideband design that can process RF signal with a 200 MHz bandwidth in real-time to facilitate one-shot localization at scale. In addition, multiple SINR enhancement techniques are designed for range extension. On top of that, a kernel-layer-based near-field localization framework and a multipath-suppression algorithm are proposed to reduce the 99% long-tail errors. Our empirical results show that RF-Chord can localize more than 180 tags 6 m away from a reader within 1 second and with 99% long-tail error of 0.786 m, achieving a 0% miss reading rate and ~0.01% cross-reading rate in the warehouse and fresh food delivery store deployment.


title: ActGraph: Prioritization of Test Cases Based on Deep Neural Network Activation Graph

abstract: Widespread applications of deep neural networks (DNNs) benefit from DNN testing to guarantee their quality. In the DNN testing, numerous test cases are fed into the model to explore potential vulnerabilities, but they require expensive manual cost to check the label. Therefore, test case prioritization is proposed to solve the problem of labeling cost, e.g., activation-based and mutation-based prioritization methods. However, most of them suffer from limited scenarios (i.e. high confidence adversarial or false positive cases) and high time complexity. To address these challenges, we propose the concept of the activation graph from the perspective of the spatial relationship of neurons. We observe that the activation graph of cases that triggers the models' misbehavior significantly differs from that of normal cases. Motivated by it, we design a test case prioritization method based on the activation graph, ActGraph, by extracting the high-order node features of the activation graph for prioritization. ActGraph explains the difference between the test cases to solve the problem of scenario limitation. Without mutation operations, ActGraph is easy to implement, leading to lower time complexity. Extensive experiments on three datasets and four models demonstrate that ActGraph has the following key characteristics. (i) Effectiveness and generalizability: ActGraph shows competitive performance in all of the natural, adversarial and mixed scenarios, especially in RAUC-100 improvement (~1.40). (ii) Efficiency: ActGraph does not use complex mutation operations and runs in less time (~1/50) than the state-of-the-art method.


title: Single atom in a superoscillatory optical trap

abstract: Optical tweezers have become essential tools to manipulate atoms or molecules at a single particle level. However, using standard diffracted-limited optical systems, the transverse size of the trap is lower bounded by the optical wavelength, limiting the application range of optical tweezers. Here we report trapping of single ultracold atom in an optical trap that can be continuously tuned from a standard Airy focus to a subwavelength hotspot smaller than the usual Abbe's diffraction limit. The hotspot was generated using the effect of superoscillations, by the precise interference of multiple free-space coherent waves. We argue that superoscillatory trapping and continuous potential tuning offer not only a way to generate compact and tenable ensembles of trapped atoms for quantum simulators but will also be useful in single molecule quantum chemistry and the study of cooperative atom-photon interaction within subwavelength arrays of quantum emitters.


title: Infrared thermotransmittance-based temperature field measurements in semitransparent media

abstract: Temperature field contactless measurements in or at the surfaces of semitransparent media are a scientific challenge, as classical thermography techniques based on proper material emission cannot be used. In this work, an alternative method using infrared thermotransmittance for contactless imaging temperatures is proposed. To overcome the weakness of the measured signal, a lock-in acquisition chain is developed, and an imaging demodulation technique is used to retrieve the phase and amplitude of the thermotransmitted signal. These measurements, combined with an analytical model, enable the estimation of the thermal diffusivity and conductivity of an infrared semitransparent insulator (wafer of borofloat 33 glass) as well as the monochromatic thermotransmittance coefficient at 3.3 um. The obtained temperature fields are in good agreement with the model, and a detection limit of $\pm 2^{\circ}$ C is estimated with this method. The results of this work open new opportunities in the development of advanced thermal metrology for semitransparent media.


title: On non-commutative Iwasawa theory and derivatives of Euler systems

abstract: We describe the relative $K_0$-groups of orders in finite dimensional separable algebras over the fraction fields of Dedekind domains of characteristic zero in terms of the theory of reduced determinant functors introduced in [20]. We then use this approach to formulate, for each odd prime $p$, a main conjecture of non-commutative $p$-adic Iwasawa theory for $\mathbb{G}_m$ over arbitrary number fields. This conjecture predicts a precise relation between a canonical Rubin-Stark non-commutative Euler system that we define and the compactly supported $p$-adic cohomology of $\mathbb{Z}_p$ and simultaneously extends both the higher rank (commutative) main conjecture for $\mathbb{G}_m$ studied by Kurihara and the present authors and the formalism of main conjectures in non-commutative Iwasawa theory due to Ritter and Weiss and to Coates, Fukaya, Kato, Sujatha and Venjakob. Our approach also suggests a precise conjectural `higher derivative formula' for the Rubin-Stark non-commutative Euler system that extends the classical Gross-Stark Conjecture to the setting of Galois extensions of arbitrary number fields. We present strong evidence in support of both of these conjectures in the setting of arbitrary Galois CM extensions of totally real fields. In addition, in the general case, we show that the conjectures can be combined to establish a new strategy for obtaining evidence in support of the equivariant Tamagawa Number Conjecture for $\mathbb{G}_m$ over arbitrary Galois extensions.


title: HFN: Heterogeneous Feature Network for Multivariate Time Series Anomaly Detection

abstract: Network or physical attacks on industrial equipment or computer systems may cause massive losses. Therefore, a quick and accurate anomaly detection (AD) based on monitoring data, especially the multivariate time-series (MTS) data, is of great significance. As the key step of anomaly detection for MTS data, learning the relations among different variables has been explored by many approaches. However, most of the existing approaches do not consider the heterogeneity between variables, that is, different types of variables (continuous numerical variables, discrete categorical variables or hybrid variables) may have different and distinctive edge distributions. In this paper, we propose a novel semi-supervised anomaly detection framework based on a heterogeneous feature network (HFN) for MTS, learning heterogeneous structure information from a mass of unlabeled time-series data to improve the accuracy of anomaly detection, and using attention coefficient to provide an explanation for the detected anomalies. Specifically, we first combine the embedding similarity subgraph generated by sensor embedding and feature value similarity subgraph generated by sensor values to construct a time-series heterogeneous graph, which fully utilizes the rich heterogeneous mutual information among variables. Then, a prediction model containing nodes and channel attentions is jointly optimized to obtain better time-series representations. This approach fuses the state-of-the-art technologies of heterogeneous graph structure learning (HGSL) and representation learning. The experiments on four sensor datasets from real-world applications demonstrate that our approach detects the anomalies more accurately than those baseline approaches, thus providing a basis for the rapid positioning of anomalies.


title: Tidal Deformability of Neutron Stars in Unimodular Gravity

abstract: Unimodular gravity is a modified theory with respect to general relativity by an extra condition that the determinant of the metric is fixed. Especially, if the energy-momentum tensor is not imposed to be conserved separately, a new geometric structure appears with potentially observational signatures. In this paper, we study tidal deformability of compact star in the unimodular gravity under the assumption of non-conserved energy-momentum tensor. Both the electric-type and magnetic-type quadrupole tidal Love numbers are calculated for neutron stars with polytrope model. It is found that the electric-type tidal Love numbers are monotonically increasing, but the magnetic-type ones are decreasing, with the increase of the non-conservation parameter. Compared with the observational data from detected gravitational-wave events, a small negative non-conservation parameter is favored.


title: Microscopic formulation of the interacting boson model for reflection asymmetric nuclei

abstract: Reflection asymmetric, octupole shapes in nuclei are a prominent aspect of nuclear structure, and have been recurrently studied over the decades. Recent experiments using radioactive-ion beams have provided evidence for stable octupole shapes. A variety of nuclear models have been employed for the related theoretical analyses. We review recent studies on the nuclear octupole shapes and collective excitations within the interacting boson model. A special focus is placed on the microscopic formulation of this model by using the mean-field method that is based on the framework of nuclear density functional theory. As an illustrative example, a stable octupole deformation, and a shape phase transition as a function of nucleon number that involves both quadrupole and octupole degrees of freedom are shown to occur in light actinides. Systematic spectroscopic studies indicate enhancement of the octupole collectivity in a wide mass region. Couplings between the octupole and additional degrees of freedom are incorporated in a microscopic manner in the boson system, and shown to play a crucial role in the description of the related intriguing nuclear structure phenomena such as the shape coexistence.


title: Complex decoherence-free interactions between giant atoms

abstract: Giant atoms provide a promising platform for engineering decoherence-free interactions which is a major task in modern quantum technologies. Here we study systematically how to implement complex decoherence-free interactions among giant atoms resorting to periodic coupling modulations and suitable arrangements of coupling points. We demonstrate that the phase of the modulation, which is tunable in experiments, can be encoded into the decoherence-free interactions, and thus enables phase-dependent dynamics when the giant atoms constitute an effective closed loop. Moreover, we consider the influence of non-Markovian retardation effect arising from large separations of the coupling points and study its dependence on the modulation parameters.


title: Ab initio no-core shell model description of $^{10-14}$C isotopes

abstract: We present a systematic study of the $^{10-14}\text{C}$ isotopes within the \textit{ab initio} no-core shell model theory. We apply four different realistic nucleon-nucleon (NN) interactions: (i) the charge-dependent Bonn 2000 (CDB2K) potential (ii) the inside non-local outside Yukawa (INOY) potential (iii) the next-to-next-to-next-to-leading order (N$^3$LO) potential, and (iv) the optimized next-to-next-to-leading order (N$^2$LO$_{opt}$) potential. We report the low-lying energy spectra of both positive and negative parity states for the $^{10-14}\text{C}$ isotopes and investigate the level structures. We also calculate electromagnetic properties such as transition strengths, quadrupole and magnetic moments. The dependence of point-proton radii on the harmonic oscillator frequency and basis space is shown. We present calculations of the translation invariant one-body density matrix in the no-core shell model and discuss isotopic trends in the density distribution. The maximum basis space reached is $10 \hbar \Omega$ for $^{10}\text{C}$ and $8 \hbar \Omega$ for $^{11-14}\text{C}$, with a maximum M-scheme dimension of $1.3 \times 10^{9}$ for $^{10}\text{C}$. We found that while the INOY interaction gives the best description of the ground state energies, the N$^3$LO interaction best reproduces the point-proton radii.


title: One-body dynamical correlation function of Lieb-Liniger model at finite temperature

abstract: The dynamical correlated properties of one-dimensional (1D) Bose gases provide profound understanding of novel physics emergent from collective excitations, for instance, the breakdown of off-diagonal long-range order, and the establishment of Tomonaga-Luttinger liquid (TLL) theory. However, due to the non-perturbative nature of 1D many-body systems, the exact evaluation of correlation functions is notoriously difficult. Here by means of form factor approach based on algebraic Bethe ansatz and numerics, we present a thorough study on the one-body dynamical correlation function (1BDCF) of the Lieb-Liniger model at finite temperature. The influence of thermal fluctuation and dynamical interaction on the behavior of 1BDCF has been demonstrated and analyzed from various perspectives, including the spectral distribution, the line-shape of 1BDCF, and the static correlations etc. The static correlation properties, i.e. the momentum distribution and one body density matrix are shown in good agreement with the TLL prediction.


title: Using Shell Models to Investigate Clumping in the WN4 Star HD 50896

abstract: The spectra of Wolf-Rayet (WR) stars exhibit strong, broad emission lines that originate in the wind. These winds are radiatively driven and are susceptible to hydrodynamic instabilities that result in the formation of clumps. When modelling spectra of WR stars the volume-filling factor (VFF) approach is usually employed to treat clumpy winds. However, it is based on the assumption that the entire wind mass resides in optically thin clumps, which is not necessarily justifiable in dense winds. To test the validity of the VFF approach we use a previously described method of treating clumping, the ``Shell'' approach, to study line and continuum formation in the dense wind of the WN4 star, HD 50896. Our models indicate that fully intact spherical shells are in tension with observed spectra; a persistent ``dip'' in emission lines occurs at line centre. Removing this dip requires our models to use ``broken'' shells -- shells that are highly decoherent laterally. This insinuates that the wind of HD 50896, and by extension the winds of other WR stars, are comprised of small laterally confined and radially compressed clumps -- clumps smaller than the Sobolev length. We discuss some of the conditions necessary for the VFF approach to be valid.


title: New Generalized Geometric Difference Sequence Spaces

abstract: In this current study, the most apparent aspect is to submit a new geometric sequence space. We investigate its topological properties , inclusion relations, Geometric statistical convergence and Geometric property of Orlicz function and . Moreover, we also check its dual properties.


title: Binary sequence set optimization for CDMA applications via mixed-integer quadratic programming

abstract: Finding sets of binary sequences with low auto- and cross-correlation properties is a hard combinatorial optimization problem with numerous applications, including multiple-input-multiple-output (MIMO) radar and global navigation satellite systems (GNSS). The sum of squared correlations, sometimes referred to as the integrated sidelobe level (ISL), is a quartic function in the variables and is a commonly-used metric of sequence set quality. In this paper, we show that the ISL minimization problem may be formulated as a mixed-integer quadratic program (MIQP). We then present a block coordinate descent (BCD) algorithm that iteratively optimizes over subsets of variables. The subset optimization subproblems are also MIQPs which may be handled more efficiently using specialized solvers than using exhaustive search; this allows us to perform BCD over larger variable subsets than previously possible. Our approach was used to find sets of four binary sequences of lengths up to 1023 with better ISL performance than Gold codes and sequence sets found using existing BCD methods.


title: Strategies for Optimizing End-to-End Artificial Intelligence Pipelines on Intel Xeon Processors

abstract: End-to-end (E2E) artificial intelligence (AI) pipelines are composed of several stages including data preprocessing, data ingestion, defining and training the model, hyperparameter optimization, deployment, inference, postprocessing, followed by downstream analyses. To obtain efficient E2E workflow, it is required to optimize almost all the stages of pipeline. Intel Xeon processors come with large memory capacities, bundled with AI acceleration (e.g., Intel Deep Learning Boost), well suited to run multiple instances of training and inference pipelines in parallel and has low total cost of ownership (TCO). To showcase the performance on Xeon processors, we applied comprehensive optimization strategies coupled with software and hardware acceleration on variety of E2E pipelines in the areas of Computer Vision, NLP, Recommendation systems, etc. We were able to achieve a performance improvement, ranging from 1.8x to 81.7x across different E2E pipelines. In this paper, we will be highlighting the optimization strategies adopted by us to achieve this performance on Intel Xeon processors with a set of eight different E2E pipelines.


title: Well-posedness and strong attractors for a beam model with degenerate nonlocal strong damping

abstract: This paper is devoted to initial-boundary value problem of an extensible beam equation with degenerate nonlocal energy damping in $\Omega\subset\mathbb{R}^n$: $u_{tt}-\kappa\Delta u+\Delta^2u-\gamma(\Vert \Delta u\Vert^2+\Vert u_t\Vert^2)^q\Delta u_t+f(u)=0$. We prove the global existence and uniqueness of weak solutions, which gives a positive answer to an open question in [24]. Moreover, we establish the existence of a strong attractor for the corresponding weak solution semigroup, where the ``strong" means that the compactness and attractiveness of the attractor are in the topology of a stronger space $\mathcal{H}_{\frac{1}{q}}$.


title: Self-supervised Character-to-Character Distillation for Text Recognition

abstract: When handling complicated text images (e.g., irregular structures, low resolution, heavy occlusion, and uneven illumination), existing supervised text recognition methods are data-hungry. Although these methods employ large-scale synthetic text images to reduce the dependence on annotated real images, the domain gap still limits the recognition performance. Therefore, exploring the robust text feature representations on unlabeled real images by self-supervised learning is a good solution. However, existing self-supervised text recognition methods conduct sequence-to-sequence representation learning by roughly splitting the visual features along the horizontal axis, which limits the flexibility of the augmentations, as large geometric-based augmentations may lead to sequence-to-sequence feature inconsistency. Motivated by this, we propose a novel self-supervised Character-to-Character Distillation method, CCD, which enables versatile augmentations to facilitate general text representation learning. Specifically, we delineate the character structures of unlabeled real images by designing a self-supervised character segmentation module. Following this, CCD easily enriches the diversity of local characters while keeping their pairwise alignment under flexible augmentations, using the transformation matrix between two augmented views from images. Experiments demonstrate that CCD achieves state-of-the-art results, with average performance gains of 1.38% in text recognition, 1.7% in text segmentation, 0.24 dB (PSNR) and 0.0321 (SSIM) in text super-resolution. Code is available at https://github.com/TongkunGuan/CCD.


title: Composable Coresets for Constrained Determinant Maximization and Beyond

abstract: We study the task of determinant maximization under partition constraint, in the context of large data sets. Given a point set $V\subset \mathbb{R}^d$ that is partitioned into $s$ groups $V_1,..., V_s$, and integers $k_1,...,k_s$ where $k=\sum_i k_i$, the goal is to pick $k_i$ points from group $i$ such that the overall determinant of the picked $k$ points is maximized. Determinant Maximization and its constrained variants have gained a lot of interest for modeling diversityand have found applications in the context of fairness and data summarization. We study the design of composable coresets for the constrained determinant maximization problem. Composable coresets are small subsets of the data that (approximately) preserve optimal solutions to optimization tasks and enable efficient solutions in several other large data models including the distributed and the streaming settings. In this work, we consider two regimes. For the case of $k>d$, we show a peeling algorithm that gives us a composable coreset of size $kd$ with an approximation factor of $d^{O(d)}$. We complement our results by showing that this approximation factor is tight. For the case of $k\leq d$, we show that a simple modification of the previous algorithms results in an optimal coreset verified by our lower bounds. Our results apply to all strongly Rayleigh distribution and several other experimental design problems. In addition, we show coreset construction algorithms under the more general laminar matroid constraints.


title: Generalized Euclidean Operator Radius

abstract: In this paper, we introduce the $f-$operator radius of Hilbert space operators as a generalization of the Euclidean operator radius and the $q-$operator radius. Properties of the newly defined radius are discussed, emphasizing how it extends some known results in the literature.


title: Distinguishable Cash, Bosonic Bitcoin, and Fermionic Non-fungible Token

abstract: Modern technology has brought novel types of wealth. In contrast to hard cashes, digital currencies do not have a physical form. They exist in electronic forms only. Yet, it has not been clear what impacts their ongoing growth will make, if any, on wealth distribution. Here we propose to identify all forms of contemporary wealth into two classes: 'distinguishable' or 'identical'. Traditional tangible moneys are all distinguishable. Financial assets and cryptocurrencies, such as bank deposits and Bitcoin, are boson-like, while non-fungible tokens are fermion-like. We derive their ownership-based distributions in a unified manner. Each class follows essentially the Poisson or the geometric distribution. We contrast their distinct features such as Gini coefficients. Further, aggregating different kinds of wealth corresponds to a weighted convolution where the number of banks matters and Bitcoin follows Bose-Einstein distribution. Our proposal opens a new avenue to understand the deepened inequality in modern economy, which is based on the statistical physics property of wealth rather than the individual ability of owners. We call for verifications with real data.

categories: econ.GN cond-mat.stat-mech hep-th q-fin.EC


title: The Generalized Elastic Net for least squares regression with network-aligned signal and correlated design

abstract: We propose a novel $\ell_1+\ell_2$-penalty, which we refer to as the Generalized Elastic Net, for regression problems where the feature vectors are indexed by vertices of a given graph and the true signal is believed to be smooth or piecewise constant with respect to this graph. Under the assumption of correlated Gaussian design, we derive upper bounds for the prediction and estimation errors, which are graph-dependent and consist of a parametric rate for the unpenalized portion of the regression vector and another term that depends on our network alignment assumption. We also provide a coordinate descent procedure based on the Lagrange dual objective to compute this estimator for large-scale problems. Finally, we compare our proposed estimator to existing regularized estimators on a number of real and synthetic datasets and discuss its potential limitations.


title: Neutral Atmospheric Density Measurement Using Insight-HXMT Data by Earth Occultation Technique

abstract: The Earth occultation technique has broad applications in both astronomy and atmospheric density measurements. We construct the background model during the occultation of the Crab Nebula observed by the Insight-Hard X-ray Modulation Telescope (Insight-HXMT) at energies between 6 keV and 100 keV. We propose a Bayesian atmospheric density retrieval method based on the Earth occultation technique, combining Poisson and Gaussian statistics. By modeling the atmospheric attenuation of X-ray photons during the occultation, we simultaneously retrieved the neutral densities of the atmosphere at different altitude ranges. Our method considers the correlation of densities between neighboring atmospheric layers and reduces the potential systematic bias to which previous work may be subject. Previous analyses based on light curve fitting or spectral fitting also lost some spectral or temporal information of the data. In contrast to previous work, the occultation data observed by the three telescopes onboard Insight-HXMT is fully used in our analysis, further reducing the statistical error in density retrieval. We apply our method to cross-check the (semi-)empirical atmospheric models, using 115 sets of occultation data of the Crab Nebula observed by Insight-HXMT. We find that the retrieved neutral density is ~10%, ~20%, and ~25% less than the values of the widely used atmospheric model NRLMSISE-00, in the altitude range of 55--80 km, 80--90 km, and 90--100 km, respectively. We also show that the newly released atmospheric model NRLMSIS 2.0 is generally consistent with our density measurements.


title: FRSUM: Towards Faithful Abstractive Summarization via Enhancing Factual Robustness

abstract: Despite being able to generate fluent and grammatical text, current Seq2Seq summarization models still suffering from the unfaithful generation problem. In this paper, we study the faithfulness of existing systems from a new perspective of factual robustness which is the ability to correctly generate factual information over adversarial unfaithful information. We first measure a model's factual robustness by its success rate to defend against adversarial attacks when generating factual information. The factual robustness analysis on a wide range of current systems shows its good consistency with human judgments on faithfulness. Inspired by these findings, we propose to improve the faithfulness of a model by enhancing its factual robustness. Specifically, we propose a novel training strategy, namely FRSUM, which teaches the model to defend against both explicit adversarial samples and implicit factual adversarial perturbations. Extensive automatic and human evaluation results show that FRSUM consistently improves the faithfulness of various Seq2Seq models, such as T5, BART.


title: CONDAQA: A Contrastive Reading Comprehension Dataset for Reasoning about Negation

abstract: The full power of human language-based communication cannot be realized without negation. All human languages have some form of negation. Despite this, negation remains a challenging phenomenon for current natural language understanding systems. To facilitate the future development of models that can process negation effectively, we present CONDAQA, the first English reading comprehension dataset which requires reasoning about the implications of negated statements in paragraphs. We collect paragraphs with diverse negation cues, then have crowdworkers ask questions about the implications of the negated statement in the passage. We also have workers make three kinds of edits to the passage -- paraphrasing the negated statement, changing the scope of the negation, and reversing the negation -- resulting in clusters of question-answer pairs that are difficult for models to answer with spurious shortcuts. CONDAQA features 14,182 question-answer pairs with over 200 unique negation cues and is challenging for current state-of-the-art models. The best performing model on CONDAQA (UnifiedQA-v2-3b) achieves only 42% on our consistency metric, well below human performance which is 81%. We release our dataset, along with fully-finetuned, few-shot, and zero-shot evaluations, to facilitate the development of future NLP methods that work on negated language.


title: Bayesian Parameter Inference for Partially Observed SDEs driven by Fractional Brownian Motion

abstract: In this paper we consider Bayesian parameter inference for partially observed fractional Brownian motion (fBM) models. The approach we follow is to time-discretize the hidden process and then to design Markov chain Monte Carlo (MCMC) algorithms to sample from the posterior density on the parameters given data. We rely on a novel representation of the time discretization, which seeks to sample from an approximation of the posterior and then corrects via importance sampling; the approximation reduces the time (in terms of total observation time T) by O(T). This method is extended by using a multilevel MCMC method which can reduce the computational cost to achieve a given mean square error (MSE) versus using a single time discretization. Our methods are illustrated on simulated and real data.


title: A structure-preserving parametric finite element method for geometric flows with anisotropic surface energy

abstract: We propose and analyze structure-preserving parametric finite element methods (SP-PFEM) for evolution of a closed curve under different geometric flows with arbitrary anisotropic surface energy $\gamma(\boldsymbol{n})$ for $\boldsymbol{n}\in \mathbb{S}^1$ representing the outward unit normal vector. By introducing a novel surface energy matrix $\boldsymbol{G}_k(\boldsymbol{n})$ depending on $\gamma(\boldsymbol{n})$ and the Cahn-Hoffman $\boldsymbol{\xi}$-vector as well as a nonnegative stabilizing function $k(\boldsymbol{n}):\ \mathbb{S}^1\to \mathbb{R}$, which is a sum of a symmetric positive definite matrix and an anti-symmetric matrix, we obtain a new geometric partial differential equation and its corresponding variational formulation for the evolution of a closed curve under anisotropic surface diffusion. Based on the new weak formulation, we propose a parametric finite element method for the anisotropic surface diffusion and show that it is area conservation and energy dissipation under a very mild condition on $\gamma(\boldsymbol{n})$. The SP-PFEM is then extended to simulate evolution of a close curve under other anisotropic geometric flows including anisotropic curvature flow and area-conserved anisotropic curvature flow. Extensive numerical results are reported to demonstrate the efficiency and unconditional energy stability as well as good mesh quality property of the proposed SP-PFEM for simulating anisotropic geometric flows.


title: Constructing MRD codes by switching

abstract: MRD codes are maximum codes in the rank-distance metric space on $m$-by-$n$ matrices over the finite field of order $q$. They are diameter perfect and have the cardinality $q^{m(n-d+1)}$ if $m\ge n$. We define switching in MRD codes as replacing special MRD subcodes by other subcodes with the same parameters. We consider constructions of MRD codes admitting such switching, including punctured twisted Gabidulin codes and direct-product codes. Using switching, we construct a huge class of MRD codes whose cardinality grows doubly exponentially in $m$ if the other parameters ($n$, $q$, the code distance) are fixed. Moreover, we construct MRD codes with different affine ranks and aperiodic MRD codes. Keywords: MRD codes, rank distance, bilinear forms graph, switching, diameter perfect codes


title: Ground state degeneracy on torus in a family of $\mathbb{Z}_N$ toric code

abstract: Topologically ordered phases in $2+1$ dimensions are generally characterized by three mutually-related features: fractionalized (anyonic) excitations, topological entanglement entropy, and robust ground state degeneracy that does not require symmetry protection or spontaneous symmetry breaking. Such degeneracy is known as topological degeneracy and usually can be seen under the periodic boundary condition regardless of the choice of the system size $L_1$ and $L_2$ in each direction. In this work we introduce a family of extensions of the Kitaev toric code to $N$ level spins ($N\geq2$). The model realizes topologically ordered phases or symmetry-protected topological phases depending on parameters in the model. The most remarkable feature of the topologically ordered phases is that the ground state may be unique, depending on $L_1$ and $L_2$, despite that the translation symmetry of the model remains unbroken. Nonetheless, the topological entanglement entropy takes the nontrivial value. We argue that this behavior originates from the nontrivial action of translations permuting anyon species.

categories: cond-mat.other cond-mat.stat-mech cond-mat.str-el quant-ph


title: Shadow of black hole surrounded by magnetized plasma: Axion-plasmon cloud

abstract: By exploiting the extreme environment of the black hole (BH) as a potential place for axion-photon interaction, we use an axion-producing model of the magnetized plasma to study the shadow of an asymptotically flat rotating BH immersed into an axion-plasmon cloud. By aiming to reveal footprints of axion in the dark shadow of BH, we in this paper explore the influence of the fixed axion-plasmon background on the motion of incident photons around the rotating BH. Under some free parameter settings, we find that axion-plasmon cloud around rotating BH affects the shape and size of the shadow in such a way that its role is distinguishable from non-magnetized plasma and standard vacuum solutions. By being limited to high rotation BH, we show that the size of the BH shadow increases as the axion-plasmon coupling gets strong. Interestingly, our analysis indicates that as the mass of axion gets heavier, it can leave a subtle imprint of itself on the shadow. Conversely, in the non-rotating limit (Schwarzschild), by recovering the spherical symmetry of the shadow shape of BH, its size decreases. In coordination with the trend of change in shadow size, the investigation of the energy emission from the BH surrounded by the magnetized plasma shows that the maximal energy emission rate from the rotating BH in the presence of axion-plasmon cloud increases compared to the non-magnetized plasma and the vacuum solutions. Subsequently, by relaxing the rotation, the axion-plasmon cloud causes a decrease in the energy emission rate from the BH.


title: Recognizing Nested Entities from Flat Supervision: A New NER Subtask, Feasibility and Challenges

abstract: Many recent named entity recognition (NER) studies criticize flat NER for its non-overlapping assumption, and switch to investigating nested NER. However, existing nested NER models heavily rely on training data annotated with nested entities, while labeling such data is costly. This study proposes a new subtask, nested-from-flat NER, which corresponds to a realistic application scenario: given data annotated with flat entities only, one may still desire the trained model capable of recognizing nested entities. To address this task, we train span-based models and deliberately ignore the spans nested inside labeled entities, since these spans are possibly unlabeled entities. With nested entities removed from the training data, our model achieves 54.8%, 54.2% and 41.1% F1 scores on the subset of spans within entities on ACE 2004, ACE 2005 and GENIA, respectively. This suggests the effectiveness of our approach and the feasibility of the task. In addition, the model's performance on flat entities is entirely unaffected. We further manually annotate the nested entities in the test set of CoNLL 2003, creating a nested-from-flat NER benchmark. Analysis results show that the main challenges stem from the data and annotation inconsistencies between the flat and nested entities.


title: Electroencephalography and mild cognitive impairment research: A scoping review and bibliometric analysis (ScoRBA)

abstract: Background: Mild cognitive impairment (MCI) is often considered a precursor to Alzheimer's disease (AD) due to the high rate of progression from MCI to AD. Sensitive neural biomarkers may provide a tool for an accurate MCI diagnosis, enabling earlier and perhaps more effective treatment. Despite the availability of numerous neuroscience techniques, electroencephalography (EEG) is the most popular and frequently used tool among researchers due to its low cost and superior temporal resolution. Objective: We conducted a scoping review of EEG and MCI between 2012 and 2022 to track the progression of research in this field. Methods: In contrast to previous scoping reviews, the data charting was aided by co-occurrence analysis using VOSviewer, while data reporting adopted a Patterns, Advances, Gaps, Evidence of Practice, and Research Recommendations (PAGER) framework to increase the quality of the results. Results: Event-related potentials (ERPs) and EEG, epilepsy, quantitative EEG (QEEG), and EEG-based machine learning were the research themes addressed by 2310 peer-reviewed articles on EEG and MCI. Conclusion: Our review identified the main research themes in EEG and MCI with high-accuracy detection of seizure and MCI performed using ERP/EEG, QEEG and EEG-based machine learning frameworks.


title: Exploring Structure-Wise Uncertainty for 3D Medical Image Segmentation

abstract: When applying a Deep Learning model to medical images, it is crucial to estimate the model uncertainty. Voxel-wise uncertainty is a useful visual marker for human experts and could be used to improve the model's voxel-wise output, such as segmentation. Moreover, uncertainty provides a solid foundation for out-of-distribution (OOD) detection, improving the model performance on the image-wise level. However, one of the frequent tasks in medical imaging is the segmentation of distinct, local structures such as tumors or lesions. Here, the structure-wise uncertainty allows more precise operations than image-wise and more semantic-aware than voxel-wise. The way to produce uncertainty for individual structures remains poorly explored. We propose a framework to measure the structure-wise uncertainty and evaluate the impact of OOD data on the model performance. Thus, we identify the best UE method to improve the segmentation quality. The proposed framework is tested on three datasets with the tumor segmentation task: LIDC-IDRI, LiTS, and a private one with multiple brain metastases cases.


title: Crossing the transcendental divide: from translation surfaces to algebraic curves

abstract: We study constructing an algebraic curve from a Riemann surface given via a translation surface, which is a collection of finitely many polygons in the plane with sides identified by translation. We use the theory of discrete Riemann surfaces to give an algorithm for approximating the Jacobian variety of a translation surface whose polygon can be decomposed into squares. We first implement the algorithm in the case of $L$ shaped polygons where the algebraic curve is already known. The algorithm is also implemented in any genus for specific examples of Jenkins-Strebel representatives, a dense family of translation surfaces that, until now, lived squarely on the analytic side of the transcendental divide between Riemann surfaces and algebraic curves. Using Riemann theta functions, we give numerical experiments and resulting conjectures up to genus 5.


title: Nonvanishing of $L$-function of some Hecke characters on cyclotomic fields

abstract: In this paper, we show nonvanishing of some Hecke characters on cyclotomic fields. The main ingredient of this paper is a computation of eigenfunctions and the action of Weil representation at some primes including the primes above $2$. As an application, we show that for each isogeny factor of the Jacobian of the $p$-th Fermat curve where $2$ is a quadratic residue modulo $p$, there are infinitely many twists whose analytic rank is zero. Also, for a certain hyperelliptic curve over the $11$-th cyclotomic field whose Jacobian has complex multiplication, there are infinitely many twists whose analytic rank is zero.


title: Empowering Data Centers for Next Generation Trusted Computing

abstract: Modern data centers have grown beyond CPU nodes to provide domain-specific accelerators such as GPUs and FPGAs to their customers. From a security standpoint, cloud customers want to protect their data. They are willing to pay additional costs for trusted execution environments such as enclaves provided by Intel SGX and AMD SEV. Unfortunately, the customers have to make a critical choice -- either use domain-specific accelerators for speed or use CPU-based confidential computing solutions. To bridge this gap, we aim to enable data-center scale confidential computing that expands across CPUs and accelerators. We argue that having wide-scale TEE-support for accelerators presents a technically easier solution, but is far away from being a reality. Instead, our hybrid design provides enclaved execution guarantees for computation distributed over multiple CPU nodes and devices with/without TEE support. Our solution scales gracefully in two dimensions -- it can handle a large number of heterogeneous nodes and it can accommodate TEE-enabled devices as and when they are available in the future. We observe marginal overheads of $0.42$--$8\%$ on real-world AI data center workloads that are independent of the number of nodes in the data center. We add custom TEE support to two accelerators (AI and storage) and integrate it into our solution, thus demonstrating that it can cater to future TEE devices.


title: Combined space-time reduced-order model with 3D deep convolution for extrapolating fluid dynamics

abstract: There is a critical need for efficient and reliable active flow control strategies to reduce drag and noise in aerospace and marine engineering applications. While traditional full-order models based on the Navier-Stokes equations are not feasible, advanced model reduction techniques can be inefficient for active control tasks, especially with strong non-linearity and convection-dominated phenomena. Using convolutional recurrent autoencoder network architectures, deep learning-based reduced-order models have been recently shown to be effective while performing several orders of magnitude faster than full-order simulations. However, these models encounter significant challenges outside the training data, limiting their effectiveness for active control and optimization tasks. In this study, we aim to improve the extrapolation capability by modifying network architecture and integrating coupled space-time physics as an implicit bias. Reduced-order models via deep learning generally employ decoupling in spatial and temporal dimensions, which can introduce modeling and approximation errors. To alleviate these errors, we propose a novel technique for learning coupled spatial-temporal correlation using a 3D convolution network. We assess the proposed technique against a standard encoder-propagator-decoder model and demonstrate a superior extrapolation performance. To demonstrate the effectiveness of 3D convolution network, we consider a benchmark problem of the flow past a circular cylinder at laminar flow conditions and use the spatio-temporal snapshots from the full-order simulations. Our proposed 3D convolution architecture accurately captures the velocity and pressure fields for varying Reynolds numbers. Compared to the standard encoder-propagator-decoder network, the spatio-temporal-based 3D convolution network improves the prediction range of Reynolds numbers outside of the training data.