title: Influence of Utterance and Speaker Characteristics on the Classification of Children with Cleft Lip and Palate

abstract: Recent findings show that pre-trained wav2vec 2.0 models are reliable feature extractors for various speaker characteristics classification tasks. We show that latent representations extracted at different layers of a pre-trained wav2vec 2.0 system can be used as features for binary classification to distinguish between children with Cleft Lip and Palate (CLP) and a healthy control group. The results indicate that the distinction between CLP and healthy voices, especially with latent representations from the lower and middle encoder layers, reaches an accuracy of 100%. We test the classifier to find influencing factors for classification using unseen out-of-domain healthy and pathologic corpora with varying characteristics: age, spoken content, and acoustic conditions. Cross-pathology and cross-healthy tests reveal that the trained classifiers are unreliable if there is a mismatch between training and out-of-domain test data in, e.g., age, spoken content, or acoustic conditions.


title: Numerical simulations of confined Brownian-yet-non-Gaussian motion

abstract: Brownian motion is a central scientific paradigm. Recently, due to increasing efforts and interests towards miniaturization and small-scale physics or biology, the effects of confinement on such a motion have become a key topic of investigation. Essentially, when confined near a wall, a particle moves much slower than in the bulk due to friction at the boundaries. The mobility is therefore locally hindered and space-dependent, which in turn leads to the apparition of so-called multiplicative noises, and associated non-Gaussianities which remain difficult to resolve at all times. Here, we exploit simple, optimized and efficient numerical simulations to address Brownian motion in confinement in a broadrange and quantitative way. To do so, we integrate the overdamped Langevin equation governing the thermal dynamics of a negatively-buoyant single spherical colloid within a viscous fluid confined by two rigid walls, including surface charges. From the produced large set of long random trajectories, we perform a complete statistical analysis and extract all the key quantities, such as the probability distributions in displacements and their main moments. In particular, we propose a novel method to compute high-order cumulants by reducing convergence problems, and employ it to efficiently characterize the inherent non-Gaussianity of the confined process.


title: Grafting Vision Transformers

abstract: Vision Transformers (ViTs) have recently become the state-of-the-art across many computer vision tasks. In contrast to convolutional networks (CNNs), ViTs enable global information sharing even within shallow layers of a network, i.e., among high-resolution features. However, this perk was later overlooked with the success of pyramid architectures such as Swin Transformer, which show better performance-complexity trade-offs. In this paper, we present a simple and efficient add-on component (termed GrafT) that considers global dependencies and multi-scale information throughout the network, in both high- and low-resolution features alike. It has the flexibility of branching out at arbitrary depths and shares most of the parameters and computations of the backbone. GrafT shows consistent gains over various well-known models which includes both hybrid and pure Transformer types, both homogeneous and pyramid structures, and various self-attention methods. In particular, it largely benefits mobile-size models by providing high-level semantics. On the ImageNet-1k dataset, GrafT delivers +3.9%, +1.4%, and +1.9% top-1 accuracy improvement to DeiT-T, Swin-T, and MobileViT-XXS, respectively. Our code and models will be made available.


title: RoChBert: Towards Robust BERT Fine-tuning for Chinese

abstract: Despite of the superb performance on a wide range of tasks, pre-trained language models (e.g., BERT) have been proved vulnerable to adversarial texts. In this paper, we present RoChBERT, a framework to build more Robust BERT-based models by utilizing a more comprehensive adversarial graph to fuse Chinese phonetic and glyph features into pre-trained representations during fine-tuning. Inspired by curriculum learning, we further propose to augment the training dataset with adversarial texts in combination with intermediate samples. Extensive experiments demonstrate that RoChBERT outperforms previous methods in significant ways: (i) robust -- RoChBERT greatly improves the model robustness without sacrificing accuracy on benign texts. Specifically, the defense lowers the success rates of unlimited and limited attacks by 59.43% and 39.33% respectively, while remaining accuracy of 93.30%; (ii) flexible -- RoChBERT can easily extend to various language models to solve different downstream tasks with excellent performance; and (iii) efficient -- RoChBERT can be directly applied to the fine-tuning stage without pre-training language model from scratch, and the proposed data augmentation method is also low-cost.


title: Experimental study of the isospin transport with 40,48 Ca+ 40,48 Ca reactions at 35 MeV/nucleon

abstract: We investigate the isospin transport with 40,48 Ca+ 40,48 Ca reactions at 35 MeV/nucleon, measured with the coupling of the VAMOS high acceptance spectrometer and the INDRA charged particle multidetector. Using the quasi-projectile remnant measured with VAMOS and carefully selected light-charged-particles measured in coincidence with INDRA, a reconstruction method is applied to estimate the excited quasi-projectile (QP) on an event-by-event basis. The isospin diffusion is investigated using the isospin transport ratio with the asymmetry $\delta$ = (N -- Z)/A of the projectile as an isospin-sensitive observable and the total transverse energy of Z $\le$ 2 nuclei for experimental centrality sorting. The experimental isospin transport ratios present, for both the reconstructed QP and its remnant, a clear evolution towards isospin equilibration with increasing dissipation of the collision while the full equilibration is not reached. A smoother evolution with less discrepancies between the two mixed systems in the case of the reconstructed QP is also observed. The isospin migration is investigated using the neutron-to-proton ratio of the light-charged-clusters and the velocity of the QP remnant as a sorting parameter. More particularly, we focused on an angular region centered around the mid-rapidity of the reaction so as to characterize the low-density neck emissions. A systematic neutron-enrichment is observed and interpreted as a consequence of isospin migration, more particularly for the symmetric systems which present no isospin gradient between the projectile and the target. We also noticed that the ^{2}H and ^{4}He particles exhibit very close multiplicities independently of the sorting variable for the symmetric systems.


title: Local Media and the Shaping of Social Norms: Evidence from the Ebola outbreak

abstract: Media around the world is disseminated at the national level as well as at the local level. While the capacity of media to shape preferences and behavior has been widely recognized, less is known about the differential impacts of local media. Local media may have particularly important effects on social norms due to the provision of locally relevant information that becomes common knowledge in a community. I examine this possibility in a high-stakes context: the Ebola epidemic in Guinea. I exploit quasi-random variation in access to distinct media outlets and the timing of a public-health campaign on community radio. I find that 13% of Ebola cases would have been prevented if places with access to neighboring community radio stations had instead their own. This is driven by radio stations' locality, not ethno-linguistic boundaries, and by coordination in social behaviors sanctioned locally.


title: NeRFPlayer: A Streamable Dynamic Scene Representation with Decomposed Neural Radiance Fields

abstract: Visually exploring in a real-world 4D spatiotemporal space freely in VR has been a long-term quest. The task is especially appealing when only a few or even single RGB cameras are used for capturing the dynamic scene. To this end, we present an efficient framework capable of fast reconstruction, compact modeling, and streamable rendering. First, we propose to decompose the 4D spatiotemporal space according to temporal characteristics. Points in the 4D space are associated with probabilities of belonging to three categories: static, deforming, and new areas. Each area is represented and regularized by a separate neural field. Second, we propose a hybrid representations based feature streaming scheme for efficiently modeling the neural fields. Our approach, coined NeRFPlayer, is evaluated on dynamic scenes captured by single hand-held cameras and multi-camera arrays, achieving comparable or superior rendering performance in terms of quality and speed comparable to recent state-of-the-art methods, achieving reconstruction in 10 seconds per frame and interactive rendering.


title: Matching entropy based disparity estimation from light field

abstract: A major challenge for matching-based depth estimation is to prevent mismatches in occlusion and smooth regions. An effective matching window satisfying three characteristics: texture richness, disparity consistency and anti-occlusion should be able to prevent mismatches to some extent. According to these characteristics, we propose matching entropy in the spatial domain of light field to measure the amount of correct information in a matching window, which provides the criterion for matching window selection. Based on matching entropy regularization, we establish an optimization model for depth estimation with a matching cost fidelity term. To find the optimum, we propose a two-step adaptive matching algorithm. First, the region type is adaptively determined to identify occluding, occluded, smooth and textured regions. Then, the matching entropy criterion is used to adaptively select the size and shape of matching windows, as well as the visible viewpoints. The two-step process can reduce mismatches and redundant calculations by selecting effective matching windows. The experimental results on synthetic and real data show that the proposed method can effectively improve the accuracy of depth estimation in occlusion and smooth regions and has strong robustness for different noise levels. Therefore, high-precision depth estimation from 4D light field data is achieved.


title: IB-U-Nets: Improving medical image segmentation tasks with 3D Inductive Biased kernels

abstract: Despite the success of convolutional neural networks for 3D medical-image segmentation, the architectures currently used are still not robust enough to the protocols of different scanners, and the variety of image properties they produce. Moreover, access to large-scale datasets with annotated regions of interest is scarce, and obtaining good results is thus difficult. To overcome these challenges, we introduce IB-U-Nets, a novel architecture with inductive bias, inspired by the visual processing in vertebrates. With the 3D U-Net as the base, we add two 3D residual components to the second encoder blocks. They provide an inductive bias, helping U-Nets to segment anatomical structures from 3D images with increased robustness and accuracy. We compared IB-U-Nets with state-of-the-art 3D U-Nets on multiple modalities and organs, such as the prostate and spleen, using the same training and testing pipeline, including data processing, augmentation and cross-validation. Our results demonstrate the superior robustness and accuracy of IB-U-Nets, especially on small datasets, as is typically the case in medical-image analysis. IB-U-Nets source code and models are publicly available.


title: LBF:Learnable Bilateral Filter For Point Cloud Denoising

abstract: Bilateral filter (BF) is a fast, lightweight and effective tool for image denoising and well extended to point cloud denoising. However, it often involves continual yet manual parameter adjustment; this inconvenience discounts the efficiency and user experience to obtain satisfied denoising results. We propose LBF, an end-to-end learnable bilateral filtering network for point cloud denoising; to our knowledge, this is the first time. Unlike the conventional BF and its variants that receive the same parameters for a whole point cloud, LBF learns adaptive parameters for each point according its geometric characteristic (e.g., corner, edge, plane), avoiding remnant noise, wrongly-removed geometric details, and distorted shapes. Besides the learnable paradigm of BF, we have two cores to facilitate LBF. First, different from the local BF, LBF possesses a global-scale feature perception ability by exploiting multi-scale patches of each point. Second, LBF formulates a geometry-aware bi-directional projection loss, leading the denoising results to being faithful to their underlying surfaces. Users can apply our LBF without any laborious parameter tuning to achieve the optimal denoising results. Experiments show clear improvements of LBF over its competitors on both synthetic and real-scanned datasets.


title: Signal Inpainting from Fourier Magnitudes

abstract: Signal inpainting is the task of restoring degraded or missing samples in a signal. In this paper we address signal inpainting when Fourier magnitudes are observed. We propose a mathematical formulation of the problem that highlights its connection with phase retrieval, and we introduce two methods for solving it. First, we derive an alternating minimization scheme, which shares similarities with the Gerchberg-Saxton algorithm, a classical phase retrieval method. Second, we propose a convex relaxation of the problem, which is inspired by recent approaches that reformulate phase retrieval into a semidefinite program. We assess the potential of these methods for the task of inpainting gaps in speech signals. Our methods exhibit both a high probability of recovering the original signals and robustness to magnitude noise.


title: Design of Liquid Impregnated Surface with Stable Lubricant layer in Mixed Water/Oil Environment for Low Hydrate Adhesion

abstract: Clathrate hydrate is a naturally occurring ice-like solid which forms in water phase under suitable temperature and pressure conditions, in the presence of one or more hydrophobic molecules. It also forms inside the oil and gas pipes leading to higher pumping cost, flow blockage and even catastrophic accidents. Engineered surfaces with low hydrate adhesion can provide an effective solution to this problem. Liquid impregnated surfaces is one such example of engineered surfaces which has already shown tremendous potential in reducing the nucleation and adhesion of solids. Here we report the design and synthesis of liquid impregnated surfaces with extremely low hydrate adhesion under the mixed environment of oil and water. The most challenging aspect of designing these surfaces was to stabilize a lubricant layer simultaneously under the water and oil. A detailed methodology to make such lubricant stable surfaces from theoretical perspective was described and experimentally validated for lubricant stability. Experimental measurements on such surfaces showed extremely low hydrate accumulation and one order of magnitude or more reduction in hydrate adhesion force.


title: Monomial Rota-Baxter operators of nonzero weight on $F[x,y]$ coming from averaging operators

abstract: The intensive study of Rota-Baxter operators on the polynomial algebra $F[x]$ has been started with the work of S.H. Zheng, L. Guo, and M. Rosenkranz (2015). We deal with the case of two variables and monomial Rota-Baxter operators of nonzero weight. The family of such operators arisen from homomorphic averaging operators on $F[x,y]$ is described.


title: Stanceosaurus: Classifying Stance Towards Multilingual Misinformation

abstract: We present Stanceosaurus, a new corpus of 28,033 tweets in English, Hindi, and Arabic annotated with stance towards 251 misinformation claims. As far as we are aware, it is the largest corpus annotated with stance towards misinformation claims. The claims in Stanceosaurus originate from 15 fact-checking sources that cover diverse geographical regions and cultures. Unlike existing stance datasets, we introduce a more fine-grained 5-class labeling strategy with additional subcategories to distinguish implicit stance. Pre-trained transformer-based stance classifiers that are fine-tuned on our corpus show good generalization on unseen claims and regional claims from countries outside the training data. Cross-lingual experiments demonstrate Stanceosaurus' capability of training multi-lingual models, achieving 53.1 F1 on Hindi and 50.4 F1 on Arabic without any target-language fine-tuning. Finally, we show how a domain adaptation method can be used to improve performance on Stanceosaurus using additional RumourEval-2019 data. We make Stanceosaurus publicly available to the research community and hope it will encourage further work on misinformation identification across languages and cultures.


title: Introduction of deep level impurities, S, Se, and Zn, into Si wafers for high-temperature operation of a Si qubit

abstract: To realize high-temperature operation of Si qubits, deep impurity levels with large confinement energy, which are hardly thermally excited, have been introduced into Si wafers. Group II impurity Zn and group VI impurities S and Se, which are known to form deep levels, were introduced into the Si substrates by ion implantation. These samples were analyzed for concentration-depth profiles, energy level depths, and absence of defects. To introduce deep impurities into thin channels such as 50-nm-thick Si, we found impurity introduction conditions so that the concentration depth profiles have maximum value at less than 50 nm from the Si surface. Then, the formation of the deep levels and absence of defects were experimentally examined. By using the conditions to introduce deep impurities into Si wafer obtained from the experiments, single-electron transport at room temperature, high-temperature operation of qubit, and room-temperature quantum magnetic sensors are promising.


title: Generalized Laplacian Positional Encoding for Graph Representation Learning

abstract: Graph neural networks (GNNs) are the primary tool for processing graph-structured data. Unfortunately, the most commonly used GNNs, called Message Passing Neural Networks (MPNNs) suffer from several fundamental limitations. To overcome these limitations, recent works have adapted the idea of positional encodings to graph data. This paper draws inspiration from the recent success of Laplacian-based positional encoding and defines a novel family of positional encoding schemes for graphs. We accomplish this by generalizing the optimization problem that defines the Laplace embedding to more general dissimilarity functions rather than the 2-norm used in the original formulation. This family of positional encodings is then instantiated by considering p-norms. We discuss a method for calculating these positional encoding schemes, implement it in PyTorch and demonstrate how the resulting positional encoding captures different properties of the graph. Furthermore, we demonstrate that this novel family of positional encodings can improve the expressive power of MPNNs. Lastly, we present preliminary experimental results.


title: Brain Modeling for Control: A Review

abstract: Neurostimulation technologies have seen a recent surge in interest from the neuroscience and controls communities alike due to their proven potential to treat conditions such as Parkinson's Disease, and depression. The provided stimulation can be of different types, such as electric, and optogenetic, and is generally applied to a specific region of the brain in order to drive the local and/or global dynamics to a desired state of (in)activity. However, an underlying theoretical understanding of the efficacy of neurostimulation is still lacking. From a control-theoretic perspective, it is important to understand how each stimulus modality interacts with the complex brain network in order to assess the controllability of the system and develop neurophysiologically relevant computational models that can be used to design the stimulation profile in a closed-loop manner. In this paper, we review the computational modeling studies of (i) deep brain stimulation, (ii) transcranial magnetic stimulation, (iii) direct current stimulation, (iv) transcranial electrical stimulation, and (v) optogenetics as five of the most popular neurostimulation technologies in research and clinical settings. For each technology, we split the reviewed studies into (a)theory-driven biophysical models capturing the low-level physics of the interactions between the stimulation source and neuronal tissue, (b) data-driven stimulus-response models which capture the end-to-end effects of stimulation on various biomarkers of interest and (c) data-driven dynamical system models that extract the precise dynamics of the brain's response to neurostimulation from neural data. While our focus is particularly on the latter category due to their greater utility in control design, we review key works in the former two categories as the basis and context in which dynamical system models have been and will be developed.


title: Modular Model Reduction of Interconnected Systems: A Robust Performance Analysis Perspective

abstract: Many complex engineering systems consist of multiple subsystems that are developed by different teams of engineers. To analyse, simulate and control such complex systems, accurate yet computationally efficient models are required. Modular model reduction, in which the subsystem models are reduced individually, is a practical and an efficient method to obtain accurate reduced-order models of such complex systems. However, when subsystems are reduced individually, without taking their interconnections into account, the effect on stability and accuracy of the resulting reduced-order interconnected system is difficult to predict. In this work, a mathematical relation between the accuracy of reduced-order linear-time invariant subsystem models and (stability and accuracy of) resulting reduced-order interconnected linear time-invariant model is introduced. This result can subsequently be used in two ways. Firstly, it can be used to translate accuracy characteristics of the reduced-order subsystem models directly to accuracy properties of the interconnected reduced-order model. Secondly, it can also be used to translate specifications on the interconnected system model accuracy to accuracy requirements on subsystem models that can be used for fit-for-purpose reduction of the subsystem models. These applications of the proposed analysis framework for modular model reduction are demonstrated on an illustrative structural dynamics example.


title: Equally spaced points are optimal for Brownian Bridge kernel interpolation

abstract: In this paper we show how ideas from spline theory can be used to construct a local basis for the space of translates of a general iterated Brownian Bridge kernel $k_{\beta,\varepsilon}$ for $\beta\in\mathbb{N}$, $\varepsilon\geq 0$. In the simple case $\beta=1$, we derive an explicit formula for the corresponding Lagrange basis, which allows us to solve interpolation problems without inverting any linear system. We use this basis to prove that interpolation with $k_{1,\varepsilon}$ is uniformly stable, i.e., the Lebesgue constant is bounded independently of the number an location of the interpolation points, and that equally spaced points are the unique minimizers of the associated power function, and are thus error optimal. In this derivation, we investigate the role of the shape parameter $\varepsilon>0$, and discuss its effect on these error and stability bounds. Some of the ideas discussed in this paper could be extended to more general Green kernels.


title: Exploring the Effects of Channel Sparsity on Neural Network Pruning for Acoustic Scene Classification

abstract: Acoustic Scene Classification (ASC) algorithms are usually expected to be deployed in resource-constrained systems. Existing works reduce the complexity of ASC algorithms by pruning some components, e.g. pruning channels in neural network. In practice, neural networks are often trained with sparsification such that unimportant channels can be found and further pruned. However, little efforts have been made to explore the the impact of channel sparsity on neural network pruning. To fully utilize the benefits of pruning for ASC, and to make sure the model performs consistently, we need a more profound comprehension of channel sparsification and its effects. This paper examines the internal weights acquired by convolutional neural networks that will undergone pruning. The study discusses how these weights can be utilized to create a novel metric, Weight Skewness (WS), for quantifying the sparsity of channels. We also provide a new approach to compare the performance of different pruning methods, which balances the trade-off between accuracy and complexity. The experiment results demonstrate that 1) applying higher channel sparsity to models can achieve greater compression rates while maintaining acceptable levels of accuracy; 2) the selection of pruning method has little influence on result 1); 3) MobileNets exhibit more significant benefits from channel sparsification than VGGNets and ResNets.


title: DPVIm: Differentially Private Variational Inference Improved

abstract: Differentially private (DP) release of multidimensional statistics typically considers an aggregate sensitivity, e.g. the vector norm of a high-dimensional vector. However, different dimensions of that vector might have widely different magnitudes and therefore DP perturbation disproportionately affects the signal across dimensions. We observe this problem in the gradient release of the DP-SGD algorithm when using it for variational inference (VI), where it manifests in poor convergence as well as high variance in outputs for certain variational parameters, and make the following contributions: (i) We mathematically isolate the cause for the difference in magnitudes between gradient parts corresponding to different variational parameters. Using this as prior knowledge we establish a link between the gradients of the variational parameters, and propose an efficient while simple fix for the problem to obtain a less noisy gradient estimator, which we call $\textit{aligned}$ gradients. This approach allows us to obtain the updates for the covariance parameter of a Gaussian posterior approximation without a privacy cost. We compare this to alternative approaches for scaling the gradients using analytically derived preconditioning, e.g. natural gradients. (ii) We suggest using iterate averaging over the DP parameter traces recovered during the training, to reduce the DP-induced noise in parameter estimates at no additional cost in privacy. Finally, (iii) to accurately capture the additional uncertainty DP introduces to the model parameters, we infer the DP-induced noise from the parameter traces and include that in the learned posteriors to make them $\textit{noise aware}$. We demonstrate the efficacy of our proposed improvements through various experiments on real data.


title: Parallel Self-Avoiding Walks for a Low-Autocorrelation Binary Sequences Problem

abstract: A low-autocorrelation binary sequences problem with a high figure of merit factor represents a formidable computational challenge. An efficient parallel computing algorithm is required to reach the new best-known solutions for this problem. Therefore, we developed the $\mathit{sokol}_{\mathit{skew}}$ solver for the skew-symmetric search space. The developed solver takes the advantage of parallel computing on graphics processing units. The solver organized the search process as a sequence of parallel and contiguous self-avoiding walks and achieved a speedup factor of 387 compared with $\mathit{lssOrel}$, its predecessor. The $\mathit{sokol}_{\mathit{skew}}$ solver belongs to stochastic solvers and can not guarantee the optimality of solutions. To mitigate this problem, we established the predictive model of stopping conditions according to the small instances for which the optimal skew-symmetric solutions are known. With its help and 99% probability, the $\mathit{sokol}_{\mathit{skew}}$ solver found all the known and seven new best-known skew-symmetric sequences for odd instances from $L=121$ to $L=223$. For larger instances, the solver can not reach 99% probability within our limitations, but it still found several new best-known binary sequences. We also analyzed the trend of the best merit factor values, and it shows that as sequence size increases, the value of the merit factor also increases, and this trend is flatter for larger instances.


title: The Largest Unsolved QAP Instance Tai256c Can Be Converted into A 256-dimensional Simple BQOP with A Single Cardinality Constraint

abstract: Tai256c is the largest unsolved quadratic assignment problem (QAP) instance in QAPLIB; a 1.48\% gap remains between the best known feasible objective value and lower bound of the unknown optimal value. This paper shows that the instance can be converted into a 256 dimensional binary quadratic optimization problem (BQOP) with a single cardinality constraint which requires the sum of the binary variables to be 92. The converted BQOP is much simpler than the original QAP tai256c and it also inherits some of the symmetry properties. However, it is still very difficult to solve. We present an efficient branch and bound method for improving the lower bound effectively. A new lower bound with 1.36\% gap is also provided.


title: Period VITS: Variational Inference with Explicit Pitch Modeling for End-to-end Emotional Speech Synthesis

abstract: Several fully end-to-end text-to-speech (TTS) models have been proposed that have shown better performance compared to cascade models (i.e., training acoustic and vocoder models separately). However, they often generate unstable pitch contour with audible artifacts when the dataset contains emotional attributes, i.e., large diversity of pronunciation and prosody. To address this problem, we propose Period VITS, a novel end-to-end TTS model that incorporates an explicit periodicity generator. In the proposed method, we introduce a frame pitch predictor that predicts prosodic features, such as pitch and voicing flags, from the input text. From these features, the proposed periodicity generator produces a sample-level sinusoidal source that enables the waveform decoder to accurately reproduce the pitch. Finally, the entire model is jointly optimized in an end-to-end manner with variational inference and adversarial objectives. As a result, the decoder becomes capable of generating more stable, expressive, and natural output waveforms. The experimental results showed that the proposed model significantly outperforms baseline models in terms of naturalness, with improved pitch stability in the generated samples.


title: System Network Analytics: Evolution and Stable Rules of a State Series

abstract: System Evolution Analytics on a system that evolves is a challenge because it makes a State Series SS = {S1, S2... SN} (i.e., a set of states ordered by time) with several inter-connected entities changing over time. We present stability characteristics of interesting evolution rules occurring in multiple states. We defined an evolution rule with its stability as the fraction of states in which the rule is interesting. Extensively, we defined stable rule as the evolution rule having stability that exceeds a given threshold minimum stability (minStab). We also defined persistence metric, a quantitative measure of persistent entity-connections. We explain this with an approach and algorithm for System Network Analytics (SysNet-Analytics), which uses minStab to retrieve Network Evolution Rules (NERs) and Stable NERs (SNERs). The retrieved information is used to calculate a proposed System Network Persistence (SNP) metric. This work is automated as a SysNet-Analytics Tool to demonstrate application on real world systems including: software system, natural-language system, retail market system, and IMDb system. We quantified stability and persistence of entity-connections in a system state series. This results in evolution information, which helps in system evolution analytics based on knowledge discovery and data mining.


title: Some algebraic identity and its relations to Stirling numbers of the second kind

abstract: In this short note we provide some algebraic identity with a proof exploiting its probabilistic interpretation. We show several consequences of the identity, in particular we obtain a new representation of a Stirling number of second kind, $$ S(n,d)={1\over d!} \sum_{1\leq j_1<j_2<\ldots<j_{d-1}< n} 1\cdot2^{j_{d-1}-j_{d-2}}\cdots d^{j_1}$$ for integers $n\geq d$. Relating this to other known formula for $S(n,d)$ we also obtain $$ \sum_{1\leq j_1\leq j_2\leq \cdots\leq j_{n-d}\leq d} j_1j_2\ldots,j_{n-d} =d! \sum_{1\leq j_1<j_2<\ldots<j_{d-1}< n} 1\cdot2^{j_{d-1}-j_{d-2}}\cdots d^{j_1}.$$ As a side effect, we have new proof of a known result stating that for any integer $d\in\mathbb{N}$ and any $x\in\mathbb{R}$ equality $$\sum_{r=0}^d (-1)^r{d\choose r}(x-r)^d=d!$$ holds. This is a special case of the presented identity.


title: Conditional Lipschitz shadowing for ordinary differential equations

abstract: We introduce the notion of conditional Lipschitz shadowing, which does not aim to shadow every pseudo-orbit, but only those which belong to a certain prescribed set. We establish two types of sufficient conditions under which certain non\-auto\-nomous ordinary differential equations have such a property. The first criterion applies to a semilinear differential equation provided that its linear part is hyperbolic and the nonlinearity is small in a neighborhood of the prescribed set. The second criterion requires that the logarithmic norm of the derivative of the right-hand side with respect to the state variable is uniformly negative in a neighborhood of the prescribed set. The results are applicable to important classes of model equations including the logistic equation, whose conditional shadowing has recently been studied. Several examples are constructed showing that the obtained conditions are optimal.


title: Magnetorheological Axisymmetric Actuator with Permanent Magnet

abstract: This study examines the concept of axisymmetric actuator based on the magnetorheological membrane, electromagnet and permanent magnet. The construction of the actuator enables its application in wide range of practical devices like pumping, loudspeaker or varying-stiffness button. This work will highlight its working principle especially the influence of permanent magnet. Furthermore, the model of devices will be defined relaying on the Hammerstein model. To show the properties of the actuator and to perform the model identification, the set of experiments was run taking into account static and dynamic working conditions.


title: Newton Raphson Emulation Network for Highly Efficient Computation of Numerous Implied Volatilities

abstract: In finance, implied volatility is an important indicator that reflects the market situation immediately. Many practitioners estimate volatility using iteration methods, such as the Newton--Raphson (NR) method. However, if numerous implied volatilities must be computed frequently, the iteration methods easily reach the processing speed limit. Therefore, we emulate the NR method as a network using PyTorch, a well-known deep learning package, and optimize the network further using TensorRT, a package for optimizing deep learning models. Comparing the optimized emulation method with the NR function in SciPy, a popular implementation of the NR method, we demonstrate that the emulation network is up to 1,000 times faster than the benchmark function.


title: Characterization of two SiPM arrays from Hamamatsu and Onsemi for liquid argon detector

abstract: Silicon photomultiplier (SiPM), a new type of photosensor, is considered a substitute for traditional photomultiplier tube (PMT) in the next generation of dark matter and neutrino detectors, especially in noble gas detectors like liquid argon. However, the design of compact SiPM arrays and their cryogenic electronics that can work in liquid argon is barely developed. Thus, two candidate SiPM arrays from Hamamatsu and Onsemi were selected to verify the feasibility and effectiveness of the design. In this work, we successfully developed a cryogenic electronics read-out system that connects and works with 1-inch 4$\times$4 SiPM arrays at 87~K. The power dissipation of amplifiers is less than 10 $\mu$W/mm$^2$. Furthermore, multiply significant characteristics of both types of SiPM arrays were measured at liquid argon temperature, such as dark count rate (DCR), breakdown voltage (V${_{bd}}$), single photoelectron (SPE) performance, signal to noise ratio (SNR) and correlated signal probability.


title: Diversity enables the jump towards cooperation for the Traveler's Dilemma

abstract: Social dilemmas are situations in which collective welfare is at odds with individual gain. One widely studied example, due to the conflict it poses between human behaviour and game theoretic reasoning, is the Traveler's Dilemma. The dilemma relies on the players' incentive to undercut their opponent at the expense of losing a collective high payoff. Such individual incentive leads players to a systematic mutual undercutting until the lowest possible payoff is reached, which is the game's unique Nash equilibrium. However, if players were satisfied with a high payoff -- that is not necessarily higher than their opponent's -- they would both be better off individually and collectively. Here, we explain how it is possible to converge to this cooperative high payoff equilibrium. Our analysis focuses on decomposing the dilemma into a local and a global game. We show that players need to escape the local maximisation and jump to the global game, in order to reach the cooperative equilibrium. Using a dynamic approach, based on evolutionary game theory and learning theory models, we find that diversity, understood as the presence of suboptimal strategies, is the general mechanism that enables the jump towards cooperation.


title: Contextual Learning in Fourier Complex Field for VHR Remote Sensing Images

abstract: Very high-resolution (VHR) remote sensing (RS) image classification is the fundamental task for RS image analysis and understanding. Recently, transformer-based models demonstrated outstanding potential for learning high-order contextual relationships from natural images with general resolution (224x224 pixels) and achieved remarkable results on general image classification tasks. However, the complexity of the naive transformer grows quadratically with the increase in image size, which prevents transformer-based models from VHR RS image (500x500 pixels) classification and other computationally expensive downstream tasks. To this end, we propose to decompose the expensive self-attention (SA) into real and imaginary parts via discrete Fourier transform (DFT) and therefore propose an efficient complex self-attention (CSA) mechanism. Benefiting from the conjugated symmetric property of DFT, CSA is capable to model the high-order contextual information with less than half computations of naive SA. To overcome the gradient explosion in Fourier complex field, we replace the Softmax function with the carefully designed Logmax function to normalize the attention map of CSA and stabilize the gradient propagation. By stacking various layers of CSA blocks, we propose the Fourier Complex Transformer (FCT) model to learn global contextual information from VHR aerial images following the hierarchical manners. Universal experiments conducted on commonly used RS classification data sets demonstrate the effectiveness and efficiency of FCT, especially on very high-resolution RS images.


title: A Deep Dive into VirusTotal: Characterizing and Clustering a Massive File Feed

abstract: Online scanners analyze user-submitted files with a large number of security tools and provide access to the analysis results. As the most popular online scanner, VirusTotal (VT) is often used for determining if samples are malicious, labeling samples with their family, hunting for new threats, and collecting malware samples. We analyze 328M VT reports for 235M samples collected for one year through the VT file feed. We use the reports to characterize the VT file feed in depth and compare it with the telemetry of a large security vendor. We answer questions such as How diverse is the feed? Does it allow building malware datasets for different filetypes? How fresh are the samples it provides? What is the distribution of malware families it sees? Does that distribution really represent malware on user devices? We then explore how to perform threat hunting at scale by investigating scalable approaches that can produce high purity clusters on the 235M feed samples. We investigate three clustering approaches: hierarchical agglomerative clustering (HAC), a more scalable HAC variant for TLSH digests (HAC-T), and a simple feature value grouping (FVG). Our results show that HAC-T and FVG using selected features produce high precision clusters on ground truth datasets. However, only FVG scales to the daily influx of samples in the feed. Moreover, FVG takes 15 hours to cluster the whole dataset of 235M samples. Finally, we use the produced clusters for threat hunting, namely for detecting 190K samples thought to be benign (i.e., with zero detections) that may really be malicious because they belong to 29K clusters where most samples are detected as malicious.


title: Systematic study for two-dimensional $Z_2$ topological phase transitions at high-symmetry points in all layer groups

abstract: We construct a general theory of $Z_2$ topological phase transitions in two-dimensional systems with time-reversal symmetry. We investigate the possibilities of $Z_2$ topological phase transitions at band inversions at all high-symmetry points in $k$-space in all the 80 layer groups. We exclude the layer groups with inversion symmetry because the $Z_2$ topological phase transition is known to be associated with band inversions with an exchange of parities. Among the other layer groups, we find 21 layer groups with insulator-to-insulator transitions with band inversion, and this problem is finally reduced to five point groups $C_3, C_4, C_6, S_4$, and $C_{3h}$. We show how the change of the $Z_2$ topological invariant at a band inversion is entirely determined by the irreps of occupied and unoccupied bands at the high-symmetry point. For example, in the case of $C_3$, we show that the $Z_2$ topological invariants change whenever the band inversion occurs between two Kramers pairs whose $C_3$ eigenvalues are $\{e^{\pi i / 3}, e^{-\pi i / 3}\}$ and $\{-1, -1\}$. These results are not included in the theory of symmetry-based indicators or topological quantum chemistry.


title: Lightweight and High-Fidelity End-to-End Text-to-Speech with Multi-Band Generation and Inverse Short-Time Fourier Transform

abstract: We propose a lightweight end-to-end text-to-speech model using multi-band generation and inverse short-time Fourier transform. Our model is based on VITS, a high-quality end-to-end text-to-speech model, but adopts two changes for more efficient inference: 1) the most computationally expensive component is partially replaced with a simple inverse short-time Fourier transform, and 2) multi-band generation, with fixed or trainable synthesis filters, is used to generate waveforms. Unlike conventional lightweight models, which employ optimization or knowledge distillation separately to train two cascaded components, our method enjoys the full benefits of end-to-end optimization. Experimental results show that our model synthesized speech as natural as that synthesized by VITS, while achieving a real-time factor of 0.066 on an Intel Core i7 CPU, 4.1 times faster than VITS. Moreover, a smaller version of the model significantly outperformed a lightweight baseline model with respect to both naturalness and inference speed. Code and audio samples are available from https://github.com/MasayaKawamura/MB-iSTFT-VITS.


title: BEBERT: Efficient and Robust Binary Ensemble BERT

abstract: Pre-trained BERT models have achieved impressive accuracy on natural language processing (NLP) tasks. However, their excessive amount of parameters hinders them from efficient deployment on edge devices. Binarization of the BERT models can significantly alleviate this issue but comes with a severe accuracy drop compared with their full-precision counterparts. In this paper, we propose an efficient and robust binary ensemble BERT (BEBERT) to bridge the accuracy gap. To the best of our knowledge, this is the first work employing ensemble techniques on binary BERTs, yielding BEBERT, which achieves superior accuracy while retaining computational efficiency. Furthermore, we remove the knowledge distillation procedures during ensemble to speed up the training process without compromising accuracy. Experimental results on the GLUE benchmark show that the proposed BEBERT significantly outperforms the existing binary BERT models in accuracy and robustness with a 2x speedup on training time. Moreover, our BEBERT has only a negligible accuracy loss of 0.3% compared to the full-precision baseline while saving 15x and 13x in FLOPs and model size, respectively. In addition, BEBERT also outperforms other compressed BERTs in accuracy by up to 6.7%.


title: FedVMR: A New Federated Learning method for Video Moment Retrieval

abstract: Despite the great success achieved, existing video moment retrieval (VMR) methods are developed under the assumption that data are centralizedly stored. However, in real-world applications, due to the inherent nature of data generation and privacy concerns, data are often distributed on different silos, bringing huge challenges to effective large-scale training. In this work, we try to overcome above limitation by leveraging the recent success of federated learning. As the first that is explored in VMR field, the new task is defined as video moment retrieval with distributed data. Then, a novel federated learning method named FedVMR is proposed to facilitate large-scale and secure training of VMR models in decentralized environment. Experiments on benchmark datasets demonstrate its effectiveness. This work is the very first attempt to enable safe and efficient VMR training in decentralized scene, which is hoped to pave the way for further study in the related research field.


title: End-to-end Ensemble-based Feature Selection for Paralinguistics Tasks

abstract: The events of recent years have highlighted the importance of telemedicine solutions which could potentially allow remote treatment and diagnosis. Relatedly, Computational Paralinguistics, a unique subfield of Speech Processing, aims to extract information about the speaker and form an important part of telemedicine applications. In this work, we focus on two paralinguistic problems: mask detection and breathing state prediction. Solutions developed for these tasks could be invaluable and have the potential to help monitor and limit the spread of a virus like COVID-19. The current state-of-the-art methods proposed for these tasks are ensembles based on deep neural networks like ResNets in conjunction with feature engineering. Although these ensembles can achieve high accuracy, they also have a large footprint and require substantial computational power reducing portability to devices with limited resources. These drawbacks also mean that the previously proposed solutions are infeasible to be used in a telemedicine system due to their size and speed. On the other hand, employing lighter feature-engineered systems can be laborious and add further complexity making them difficult to create a deployable system quickly. This work proposes an ensemble-based automatic feature selection method to enable the development of fast and memory-efficient systems. In particular, we propose an output-gradient-based method to discover essential features using large, well-performing ensembles before training a smaller one. In our experiments, we observed considerable (25-32%) reductions in inference times using neural network ensembles based on output-gradient-based features. Our method offers a simple way to increase the speed of the system and enable real-time usage while maintaining competitive results with larger-footprint ensemble using all spectral features.


title: Sustainable learning, cognitive gains, and improved attitudes in College Algebra flipped classrooms

abstract: The objective of this article is to investigate the effect of active-learning pedagogy on learners' academic achievement and their attitude toward mathematics using both quantitative and qualitative methods. We cultivated sustainable learning in mathematics education for college freshmen ($n = 55$) by exposing them to both the conventional teaching method (CTM) and flipped classroom pedagogy (FCP). By splitting them into control and experimental groups alternately ($n_1 = 24$, $n_2 = 31$) and by selecting the four most challenging topics in college algebra, we measured their cognitive gains quantitatively via a sequence of pre- and post-tests. Both groups improved academically over time across all these four topics with statistically very significant outcomes $(p < 0.001)$. Although they were not always statistically significant ($p > 0.05$) in some topics, the post-test results suggest that generally, the FCP trumps the CTM in cognitive gains, except for the first topic on factorization, where the opposite is true with a very statistically significant mean difference $(p < 0.001)$. By examining non-cognitive gains qualitatively, we analyzed the students' feedback on the FCP and their responses to a perception inventory. The finding suggests a favorable response toward the FCP with primary improvements in the attitudes toward mathematics and increased levels of cooperation among students. Since these students are so happy to have control of their own learning, they were more relaxed, motivated, confident, active, and responsible in learning under the FCP. We are confident that although this study is relatively small in scale, it will yield incremental and long-lasting effects not only for the learners themselves but also for other role-takers in education sectors who aspire in nurturing sustainable long-life learning and achieving sustainable development goals successfully.


title: A discrete discontinuity between the two phases of gravity

abstract: When tetrad (metric) fields are not invertible, the standard canonical formulation of gravity cannot be adopted as it is. Here we develop a Hamiltonian theory of gravity for non-invertible tetrad. In contrast to Einstein gravity, this phase is found to exhibit three local degrees of freedom. This reflects a discrete discontinuity in the limit of a vanishing tetrad determinant. For the particular case of vanishing lapse, the Hamiltonian constraint disappears from the classical theory upon fixing the torsional gauge-freedom. Any state functional invariant under the internal gauge rotations and spatial diffeomorphisms is a formal solution of the associated quantum theory. The formulation here provides a Hamiltonian basis to analyze gravity theory around a physical singularity, which corresponds to a zero of the tetrad determinant in curved spacetime.


title: Anomalous loss behavior in a single-component Fermi gas close to a $p$-Wave Feshbach resonance

abstract: We theoretically investigate three-body losses in a single-component Fermi gas near a $p$-wave Feshbach resonance in the interacting, non-unitary regime. We extend the cascade model introduced by Waseem \textit{et al.} [M. Waseem, J. Yoshida, T. Saito, and T. Mukaiyama, Phys. Rev. A \textbf{99}, 052704 (2019)] to describe the elastic and inelastic collision processes. We find that the loss behavior exhibits a $n^3$ and an anomalous $n^2$ density dependence for a ratio of elastic-to-inelastic collision rate larger and smaller than 1, respectively. The corresponding evolutions of the energy distribution show collisional cooling or evolution toward low-energetic non-thermalized steady states, respectively. These findings are particularly relevant for understanding atom loss and energetic evolution of ultracold gases of fermionic lithium atoms in their ground state.


title: Dysfluencies Seldom Come Alone -- Detection as a Multi-Label Problem

abstract: Specially adapted speech recognition models are necessary to handle stuttered speech. For these to be used in a targeted manner, stuttered speech must be reliably detected. Recent works have treated stuttering as a multi-class classification problem or viewed detecting each dysfluency type as an isolated task; that does not capture the nature of stuttering, where one dysfluency seldom comes alone, i.e., co-occurs with others. This work explores an approach based on a modified wav2vec 2.0 system for end-to-end stuttering detection and classification as a multi-label problem. The method is evaluated on combinations of three datasets containing English and German stuttered speech, yielding state-of-the-art results for stuttering detection on the SEP-28k-Extended dataset. Experimental results provide evidence for the transferability of features and the generalizability of the method across datasets and languages.


title: Ultrafast modulations in stellar, solar and galactic spectra: Dark Matter and numerical ghosts, stellar flares and SETI

abstract: From new results presented in the literature we discuss the hypothesis that the ultrafast periodic spectral modulations at $f_S \simeq 0.607$ THz found in the spectra of $236$ stars of the Sloan Digital Sky Survey (SDSS) [1] were due to oscillations induced by dark matter (DM) cores in their centers [2] behaving as oscillating boson stars [3,4]. Two additional frequencies in the redshift-corrected SDSS galactic spectra were found [5], $ f_{1,G} \simeq 9.5$ THz, the beating between $f_S$ and a spurious frequency, $f_{2,G} \simeq 8.9$ THz, introduced during the data analysis [6]. The indication that $f_S$ can be real is its detection in a real solar spectrum but not in the Kurucz's artificial solar spectrum [6,7,8]. Then, independent SETI observations of four of these stars could not confirm with high confidence, but not completely exclude, the presence of $f_S$ in their power spectra [9] while the radio SETI deep-learning analysis with artificial intelligence confirmed indirectly $f_S$ detecting a narrowband Doppler drifting of radio signals in two of these stars over a sample of $7$ with a high S/N [10]. Numerical simulations suggest that the drifting can be due to frequency and phase modulation in time of the observed frequencies at $1.3-1.7$ GHz with $f_S$. This would imply a DM upper mass limit $m_a \lesssim 2.4 \times 10^{3}~ \mathrm{\mu eV}$ [2] which also agrees with the results from the gamma ray burst GRB221009A [11,12,13], laser interferometry [14], suggesting new physics for the muon g-2 anomaly [15].

categories: astro-ph.GA astro-ph.HE astro-ph.SR gr-qc hep-ph


title: Low-loss silicon nitride photonic ICs for single-photon applications

abstract: Low-loss photonic integrated circuits (PICs) are the key elements in future quantum technologies, nonlinear photonics and neural networks. The low-loss photonic circuits technology targeting C-band application is well established across multi-project wafer (MPW) fabs, whereas near-infrared (NIR) PICs suitable for the state-of-the-art single-photon sources are still underdeveloped. Here, we report the labs-scale process optimization and optical characterization of low-loss tunable photonic integrated circuits for single-photon applications. We demonstrate the lowest propagation losses to the date (as low as 0.55 dB/cm at 925 nm wavelength) in single-mode silicon nitride submicron waveguides (220x550 nm). This performance is achieved due to advanced e-beam lithography and inductively coupled plasma reactive ion etching steps which yields waveguides vertical sidewalls with down to 0.85 nm sidewall roughness. These results provide a chip-scale low-loss PIC platform that could be even further improved with high quality SiO2 cladding, chemical-mechanical polishing and multistep annealing for extra-strict single-photon applications.


title: Understanding Adverse Biological Effect Predictions Using Knowledge Graphs

abstract: Extrapolation of adverse biological (toxic) effects of chemicals is an important contribution to expand available hazard data in (eco)toxicology without the use of animals in laboratory experiments. In this work, we extrapolate effects based on a knowledge graph (KG) consisting of the most relevant effect data as domain-specific background knowledge. An effect prediction model, with and without background knowledge, was used to predict mean adverse biological effect concentration of chemicals as a prototypical type of stressors. The background knowledge improves the model prediction performance by up to 40\% in terms of $R^2$ (\ie coefficient of determination). We use the KG and KG embeddings to provide quantitative and qualitative insights into the predictions. These insights are expected to improve the confidence in effect prediction. Larger scale implementation of such extrapolation models should be expected to support hazard and risk assessment, by simplifying and reducing testing needs.


title: Differentially Private CutMix for Split Learning with Vision Transformer

abstract: Recently, vision transformer (ViT) has started to outpace the conventional CNN in computer vision tasks. Considering privacy-preserving distributed learning with ViT, federated learning (FL) communicates models, which becomes ill-suited due to ViT' s large model size and computing costs. Split learning (SL) detours this by communicating smashed data at a cut-layer, yet suffers from data privacy leakage and large communication costs caused by high similarity between ViT' s smashed data and input data. Motivated by this problem, we propose DP-CutMixSL, a differentially private (DP) SL framework by developing DP patch-level randomized CutMix (DP-CutMix), a novel privacy-preserving inter-client interpolation scheme that replaces randomly selected patches in smashed data. By experiment, we show that DP-CutMixSL not only boosts privacy guarantees and communication efficiency, but also achieves higher accuracy than its Vanilla SL counterpart. Theoretically, we analyze that DP-CutMix amplifies R\'enyi DP (RDP), which is upper-bounded by its Vanilla Mixup counterpart.


title: NNSVS: A Neural Network-Based Singing Voice Synthesis Toolkit

abstract: This paper describes the design of NNSVS, an open-source software for neural network-based singing voice synthesis research. NNSVS is inspired by Sinsy, an open-source pioneer in singing voice synthesis research, and provides many additional features such as multi-stream models, autoregressive fundamental frequency models, and neural vocoders. Furthermore, NNSVS provides extensive documentation and numerous scripts to build complete singing voice synthesis systems. Experimental results demonstrate that our best system significantly outperforms our reproduction of Sinsy and other baseline systems. The toolkit is available at https://github.com/nnsvs/nnsvs.


title: Spectrograms Are Sequences of Patches

abstract: Self-supervised pre-training models have been used successfully in several machine learning domains. However, only a tiny amount of work is related to music. In our work, we treat a spectrogram of music as a series of patches and design a self-supervised model that captures the features of these sequential patches: Patchifier, which makes good use of self-supervised learning methods from both NLP and CV domains. We do not use labeled data for the pre-training process, only a subset of the MTAT dataset containing 16k music clips. After pre-training, we apply the model to several downstream tasks. Our model achieves a considerably acceptable result compared to other audio representation models. Meanwhile, our work demonstrates that it makes sense to consider audio as a series of patch segments.


title: Constraints on heavy decaying dark matter from 570 days of LHAASO observations

abstract: The Kilometer Square Array~(KM2A) of the Large High Altitude Air Shower Observatory (LHAASO) aims at surveying the northern gamma-ray sky at energies above 10 TeV with unprecedented sensitivity. Gamma-ray observations have long been one of the most powerful tools for dark matter searches, as e.g., high-energy gamma-rays could be produced by the decays of heavy dark matter particles. In this letter, we present the first dark matter analysis with LHAASO-KM2A, using the first 340~days of data from 1/2-KM2A and 230~days of data from 3/4-KM2A. Several regions of interest are used to search for a signal and account for the residual cosmic-ray background after gamma/hadron separation. We find no excess of dark matter signals, and thus place some of the strongest gamma-ray constraints on the lifetime of heavy dark matter particles with mass between 10^5 and 10^9~GeV. Our results with LHAASO are robust, and have important implications for dark matter interpretations of the diffuse astrophysical high-energy neutrino emission.


title: Virtual Thompson's group

abstract: For virtual knot theory, the virtual braid group was defined by generalizing the braid group. It was proved that any virtual link can be obtained by the closure of a virtual braid. On the other hand, due to work by Jones et al., it is known that any (oriented) link is constructed from an element of Thompson's group $F$. In this paper, we define the ``virtual version'' of Thompson's group $F$ and prove that any virtual link is constructed from an element of the group.


title: Fast multivariate polynomials in R: the mvp package

abstract: In this short article I introduce the mvp package, which provides some functionality for handling multivariate polynomials. The package uses the C++ Standard Template Library's map class to store and retrieve elements; it conforms to disordR discipline for coefficients. The package is available on CRAN at https://CRAN.R-project.org/package=mvp.


title: Classification of Willmore surfaces with vanishing Gaussian curvature

abstract: We classify simply-connected, complete Willmore surfaces with vanishing Gaussian curvature. We also study the Willmore cones and give a classification. As an application, we give a Bernstein-type theorem.


title: The resolved scaling relations in DustPedia: Zooming in on the local Universe

abstract: We perform a homogeneous analysis of an unprecedented set of spatially resolved scaling relations (SRs) between ISM components and other properties in the range of scales 0.3-3.4 kpc. We also study some ratios: dust-to-stellar, dust-to-gas, and dust-to-metal. We use a sample of 18 large, spiral, face-on DustPedia galaxies. All the SRs are moderate/strong correlations except the dust-HI SR that does not exist or is weak for most galaxies. The SRs do not have a universal form but each galaxy is characterized by distinct correlations, affected by local processes and galaxy peculiarities. The SRs hold starting from 0.3 kpc, and if a breaking down scale exists it is < 0.3 kpc. By evaluating all galaxies at 3.4 kpc, differences due to peculiarities of individual galaxies are cancelled out and the corresponding SRs are consistent with those of whole galaxies. By comparing subgalactic and global scales, the most striking result emerges from the SRs involving ISM components: the dust-total gas SR is a good correlation at all scales, while the dust-H2 and dust-HI SRs are good correlations at subkpc/kpc and total scales, respectively. For the other explored SRs, there is a good agreement between small and global scales and this may support the picture where the main physical processes regulating the properties and evolution of galaxies occur locally. Our results are consistent with the hypothesis of self-regulation of the SF process. The analysis of subgalactic ratios shows that they are consistent with those derived for whole galaxies, from low to high z, supporting the idea that also these ratios could be set by local processes. Our results highlight the heterogeneity of galaxy properties and the importance of resolved studies on local galaxies in the context of galaxy evolution. They also provide observational constraints to theoretical models and updated references for high-z studies.


title: Cohomology of the Morava stabilizer group through the duality resolution at $n=p=2$

abstract: We compute the continuous cohomology of the Morava stabilizer group with coefficients in Morava $E$-theory, $H^*(\mathbb{G}_2, E_t)$, at $p=2$, for $0\leq t < 12$, using the Algebraic Duality Spectral Sequence. Furthermore, in that same range, we compute the $d_3$-differentials in the homotopy fixed point spectral sequence for the $K(2)$-local sphere spectrum. These cohomology groups and differentials play a central role in $K(2)$-local stable homotopy theory.


title: Electronic State of T'-Pr$_{1.3-x}$La$_{0.7}$Ce$_x$CuO$_4$ ($x = 0.10$) Studied by Compton Scattering

abstract: We have performed Compton scattering measurements on as-grown and reduced single crystals of the electron-doped T'-cuprate Pr1.3-xLa0.7CexCuO4 (x = 0.10) to investigate the effect of reduction annealing on the electronic state. The obtained results have revealed that the numbers of electrons in the O2p orbital in the Zhang-Rice singlet band, the Cu3dx2-y2 orbital, and the Cu3d3z2-r2 orbital are increased by reduction annealing. The increase in the number of Cu3d3z2-r2 electrons suggests the existence of Cu3d3z2-r2 holes in the as-grown single crystal. This is spectroscopic evidence of local hole doping into the Cu3d3z2-r2 orbital around the excess oxygen, as suggested by transport measurements [T. Adachi et al., J. Phys. Soc. Jpn. 82, 063713 (2013)].


title: Towards Generalized Few-Shot Open-Set Object Detection

abstract: Open-set object detection (OSOD) aims to detect the known categories and reject unknown objects in a dynamic world, which has achieved significant attention. However, previous approaches only consider this problem in data-abundant conditions, while neglecting the few-shot scenes. In this paper, we seek a solution for the generalized few-shot open-set object detection (G-FOOD), which aims to avoid detecting unknown classes as known classes with a high confidence score while maintaining the performance of few-shot detection. The main challenge for this task is that few training samples induce the model to overfit on the known classes, resulting in a poor open-set performance. We propose a new G-FOOD algorithm to tackle this issue, named \underline{F}ew-sh\underline{O}t \underline{O}pen-set \underline{D}etector (FOOD), which contains a novel class weight sparsification classifier (CWSC) and a novel unknown decoupling learner (UDL). To prevent over-fitting, CWSC randomly sparses parts of the normalized weights for the logit prediction of all classes, and then decreases the co-adaptability between the class and its neighbors. Alongside, UDL decouples training the unknown class and enables the model to form a compact unknown decision boundary. Thus, the unknown objects can be identified with a confidence probability without any threshold, prototype, or generation. We compare our method with several state-of-the-art OSOD methods in few-shot scenes and observe that our method improves the F-score of unknown classes by 4.80\%-9.08\% across all shots in VOC-COCO dataset settings \footnote[1]{The source code is available at \url{https://github.com/binyisu/food}}.


title: Universal Adversarial Directions

abstract: Despite their great success in image recognition tasks, deep neural networks (DNNs) have been observed to be susceptible to universal adversarial perturbations (UAPs) which perturb all input samples with a single perturbation vector. However, UAPs often struggle in transferring across DNN architectures and lead to challenging optimization problems. In this work, we study the transferability of UAPs by analyzing equilibrium in the universal adversarial example game between the classifier and UAP adversary players. We show that under mild assumptions the universal adversarial example game lacks a pure Nash equilibrium, indicating UAPs' suboptimal transferability across DNN classifiers. To address this issue, we propose Universal Adversarial Directions (UADs) which only fix a universal direction for adversarial perturbations and allow the perturbations' magnitude to be chosen freely across samples. We prove that the UAD adversarial example game can possess a Nash equilibrium with a pure UAD strategy, implying the potential transferability of UADs. We also connect the UAD optimization problem to the well-known principal component analysis (PCA) and develop an efficient PCA-based algorithm for optimizing UADs. We evaluate UADs over multiple benchmark image datasets. Our numerical results show the superior transferability of UADs over standard gradient-based UAPs.


title: Spatially Random Disorder in Unitary Fermion System in $(4-\epsilon)$-Dimensions and Effective Action at Finite Temperature

abstract: Non-relativistic conformal field theory is significant to understand various aspects of an ultra-cold system. In this paper, we study a non-relativistic system of two-component fermions interacting with a complex boson with Yukawa-like interactions near $d=4$-spatial dimensions in the presence of a quenched disorder. The homogeneous theory flows to an interacting fixed point describing a unitary fermion system. In the presence of the disorder, we find that the system has an interesting phase structure in the space of the coupling constants and exhibits an interacting disorder fixed point in $\epsilon$-expansion. The correlation function obeys Lifshitz scaling behaviour at the disorder fixed point with the anisotropic exponent being $z=2+\gamma_E$. We also study the disorder system at finite temperature and compute the leading contribution to the 1PI effective action.


title: Benchmarking performance of object detection under image distortions in an uncontrolled environment

abstract: The robustness of object detection algorithms plays a prominent role in real-world applications, especially in uncontrolled environments due to distortions during image acquisition. It has been proven that the performance of object detection methods suffers from in-capture distortions. In this study, we present a performance evaluation framework for the state-of-the-art object detection methods using a dedicated dataset containing images with various distortions at different levels of severity. Furthermore, we propose an original strategy of image distortion generation applied to the MS-COCO dataset that combines some local and global distortions to reach much better performances. We have shown that training using the proposed dataset improves the robustness of object detection by 31.5\%. Finally, we provide a custom dataset including natural images distorted from MS-COCO to perform a more reliable evaluation of the robustness against common distortions. The database and the generation source codes of the different distortions are made publicly available


title: Thermal Infrared Image Inpainting via Edge-Aware Guidance

abstract: Image inpainting has achieved fundamental advances with deep learning. However, almost all existing inpainting methods aim to process natural images, while few target Thermal Infrared (TIR) images, which have widespread applications. When applied to TIR images, conventional inpainting methods usually generate distorted or blurry content. In this paper, we propose a novel task -- Thermal Infrared Image Inpainting, which aims to reconstruct missing regions of TIR images. Crucially, we propose a novel deep-learning-based model TIR-Fill. We adopt the edge generator to complete the canny edges of broken TIR images. The completed edges are projected to the normalization weights and biases to enhance edge awareness of the model. In addition, a refinement network based on gated convolution is employed to improve TIR image consistency. The experiments demonstrate that our method outperforms state-of-the-art image inpainting approaches on FLIR thermal dataset.


title: Information Design in Allocation with Costly Verification

abstract: A principal who values an object allocates it to one or more agents. Agents learn private information (signals) from an information designer about the allocation payoff to the principal. Monetary transfer is not available but the principal can costly verify agents' private signals. The information designer can influence the agents' signal distributions, based upon which the principal maximizes the allocation surplus. An agent's utility is simply the probability of obtaining the good. With a single agent, we characterize (i) the agent-optimal information, (ii) the principal-worst information, and (iii) the principal-optimal information. Even though the objectives of the principal and the agent are not directly comparable, we find that any agent-optimal information is principal-worst. Moreover, there exists a robust mechanism that achieves the principal's payoff under (ii), which is therefore an optimal robust mechanism. Many of our results extend to the multiple-agent case; if not, we provide counterexamples.


title: Online Learning Models for Vehicle Usage Prediction During COVID-19

abstract: Today, there is an ongoing transition to more sustainable transportation, for which an essential part is the switch from combustion engine vehicles to battery electric vehicles (BEVs). BEVs have many advantages from a sustainability perspective, but issues such as limited driving range and long recharge times slow down the transition from combustion engines. One way to mitigate these issues is by performing battery thermal preconditioning, which increases the energy efficiency of the battery. However, to optimally perform battery thermal preconditioning, the vehicle usage pattern needs to be known, i.e., how and when the vehicle will be used. This study attempts to predict the departure time and distance of the first drive each day using online machine learning models. The online machine learning models are trained and evaluated on historical driving data collected from a fleet of BEVs during the COVID-19 pandemic. Additionally, the prediction models are extended to quantify the uncertainty of their predictions, which can be used to decide whether the prediction should be used or dismissed. Based on our results, the best-performing prediction models yield an aggregated mean absolute error of 2.75 hours when predicting departure time and 13.37 km when predicting trip distance.


title: Evaluating the Impact of Loss Function Variation in Deep Learning for Classification

abstract: The loss function is arguably among the most important hyperparameters for a neural network. Many loss functions have been designed to date, making a correct choice nontrivial. However, elaborate justifications regarding the choice of the loss function are not made in related work. This is, as we see it, an indication of a dogmatic mindset in the deep learning community which lacks empirical foundation. In this work, we consider deep neural networks in a supervised classification setting and analyze the impact the choice of loss function has onto the training result. While certain loss functions perform suboptimally, our work empirically shows that under-represented losses such as the KL Divergence can outperform the State-of-the-Art choices significantly, highlighting the need to include the loss function as a tuned hyperparameter rather than a fixed choice.


title: From finite population optimal stopping to mean field optimal stopping

abstract: This paper analyzes the convergence of the finite population optimal stopping problem towards the corresponding mean field limit. Building on the viscosity solution characterization of the mean field optimal stopping problem of our previous papers [Talbi, Touzi & Zhang 2021 & 2022], we prove the convergence of the value functions by adapting the Barles-Souganidis [1991] monotone scheme method to our context. We next characterize the optimal stopping policies of the mean field problem by the accumulation points of the finite population optimal stopping strategies. In particular, if the limiting problem has a unique optimal stopping policy, then the finite population optimal stopping strategies do converge towards this solution. As a by-product of our analysis, we provide an extension of the standard propagation of chaos to the context of stopped McKean-Vlasov diffusions.


title: Enhanced heralded single-photon source with a photon-number-resolving parallel superconducting nanowire single-photon detector

abstract: Heralded single-photon sources (HSPS) intrinsically suffer from multiphoton emission, leading to a trade-off between the source's quality and the heralding rate. A solution to this problem is to use photon-number-resolving (PNR) detectors to filter out the heralding events where more than one photon pair is created. Here, we demonstrate the use of a high-efficiency PNR superconducting nanowire single-photon detector (SNSPD) as a heralding detector for a HSPS. By filtering out higher-order heralding detections, we can reduce the $g^{(2)}(0)$ of the heralded single photon by $(26.6 \pm 0.2)\,\%$, or alternatively, for a fixed pump power, increasing the heralding rate by a factor of $1.363 \pm 0.004$ for a fixed $g^{(2)}(0)$. Additionally, we use the detector to directly measure the photon-number distribution of a thermal mode and calculate the unheralded $g^{(2)}(0)$. We show the possibility to perform $g^{(2)}(0)$ measurements with only one PNR detector, with the results in agreement with those obtained by more common-place techniques which use multiple threshold detectors. Our work shows that efficient PNR SNSPDs can significantly improve the performance of HSPSs and can precisely characterize them, making these detectors a useful tool for a wide range of optical quantum information protocols.


title: Development of a rule-based lemmatization algorithm through Finite State Machine for Uzbek language

abstract: Lemmatization is one of the core concepts in natural language processing, thus creating a lemmatization tool is an important task. This paper discusses the construction of a lemmatization algorithm for the Uzbek language. The main purpose of the work is to remove affixes of words in the Uzbek language by means of the finite state machine and to identify a lemma (a word that can be found in the dictionary) of the word. The process of removing affixes uses a database of affixes and part of speech knowledge. This lemmatization consists of the general rules and a part of speech data of the Uzbek language, affixes, classification of affixes, removing affixes on the basis of the finite state machine for each class, as well as a definition of this word lemma.


title: Design of Protograph LDPC-Coded MIMO-VLC Systems with Generalized Spatial Modulation

abstract: This paper investigates the bit-interleaved coded generalized spatial modulation (BICGSM) with iterative decoding (BICGSM-ID) for multiple-input multiple-output (MIMO) visible light communications (VLC). In the BICGSM-ID scheme, the information bits conveyed by the signal-domain (SiD) symbols and the spatial-domain (SpD) light emitting diode (LED)-index patterns are coded by a protograph low-density parity-check (P-LDPC) code. Specifically, we propose a signal-domain symbol expanding and re-allocating (SSER) method for constructing a type of novel generalized spatial modulation (GSM) constellations, referred to as SSERGSM constellations, so as to boost the performance of the BICGSM-ID MIMO-VLC systems. Moreover, by applying a modified PEXIT (MPEXIT) algorithm, we further design a family of rate-compatible P-LDPC codes, referred to as enhanced accumulate-repeat-accumulate (EARA) codes, which possess both excellent decoding thresholds and linear-minimum-distance-growth property. Both analysis and simulation results illustrate that the proposed SSERGSM constellations and P-LDPC codes can remarkably improve the convergence and decoding performance of MIMO-VLC systems. Therefore, the proposed P-LDPC-coded SSERGSM-mapped BICGSM-ID configuration is envisioned as a promising transmission solution to satisfy the high-throughput requirement of MIMO-VLC applications.


title: On Classification of $\mathbb{Q}$-Fano 3-folds of Gorenstein index 2. III

abstract: We classified prime $\mathbb{Q}$-Fano $3$-folds $X$ with only $1/2(1,1,1)$-singularities and with $h^{0}(-K_{X})\geq 4$ a long time ago. The classification was undertaken by blowing up each $X$ at one $1/2(1,1,1)$-singularity and constructing a Sarkisov link. The purpose of this paper is to reveal the geometries behind the Sarkisov links for $X$ in 5 classes. The main result asserts that any $X$ in the 5 classes can be embedded as linear sections into bigger dimensional $\mathbb{Q}$-Fano varieties called key varieties, where the key varieties are constructed by extending partially the Sarkisov link in higher dimensions.


title: Charge fluctuation and charge-resolved entanglement in a monitored quantum circuit with $U(1)$ symmetry

abstract: We study a (1+1)-dimensional quantum circuit consisting of Haar-random unitary gates and projective measurements that conserve a total $U(1)$ charge and thus have $U(1)$ symmetry. In addition to a measurement-induced entanglement transition between a volume-law and an area-law entangled phase, we find a phase transition between two phases characterized by bipartite charge fluctuation growing with the subsystem size or staying constant. At this charge-fluctuation transition, steady-state quantities obtained by evolving an initial state with a definitive total charge exhibit critical scaling behaviors akin to Tomonaga-Luttinger-liquid theory for equilibrium critical quantum systems with $U(1)$ symmetry, such as logarithmic scaling of bipartite charge fluctuation, power-law decay of charge correlation functions, and logarithmic scaling of charge-resolved entanglement whose coefficient becomes a universal quadratic function in a flux parameter. These critical features, however, do not persist below the transition in contrast to a recent prediction based on replica field theory and mapping to a classical statistical mechanical model.


title: A consistent mixed-dimensional coupling approach for 1D Cosserat beams and 2D solid surfaces

abstract: The present article proposes a novel computational method for coupling 1D fibers with the 2D surface of a 3D solid. The fibers are modeled as 1D Cosserat continua (beams) with six local degrees of freedom, three positional and three rotational ones. A kinematically consistent 1D-2D coupling scheme for this problem type is proposed considering the positional and rotational degrees of freedom along the beams. The positional degrees of freedom are coupled by enforcing a constant normal distance between a point on the beam centerline and a corresponding point on the solid surface. This strategy requires a consistent description of the solid surface normal vector field to guarantee fundamental mechanical properties such as conservation of angular momentum. Coupling of the rotational degrees of freedom of the beams and a suitable rotation tensor representative for the local orientation within a Boltzmann continuum has been considered in a previous contribution. In the present work, this coupling approach will be extended by constructing rotation tensors that are representative for local surface orientations. Several numerical examples demonstrate the consistency, robustness and accuracy of the proposed method. To showcase its applicability to multi-physics systems of practical relevance, the fluid-structure interaction example of a vascular stent is presented.


title: UzbekStemmer: Development of a Rule-Based Stemming Algorithm for Uzbek Language

abstract: In this paper we present a rule-based stemming algorithm for the Uzbek language. Uzbek is an agglutinative language, so many words are formed by adding suffixes, and the number of suffixes is also large. For this reason, it is difficult to find a stem of words. The methodology is proposed for doing the stemming of the Uzbek words with an affix stripping approach whereas not including any database of the normal word forms of the Uzbek language. Word affixes are classified into fifteen classes and designed as finite state machines (FSMs) for each class according to morphological rules. We created fifteen FSMs and linked them together to create the Basic FSM. A lexicon of affixes in XML format was created and a stemming application for Uzbek words has been developed based on the FSMs.


title: Hybrid multi-fluid-particle simulations of the cosmic neutrino background

abstract: Simulation of the cosmic clustering of massive neutrinos is a daunting task, due both to their large velocity dispersion and to their weak clustering power becoming swamped by Poisson shot noise. We present a new approach, the multi-fluid hybrid-neutrino simulation, which partitions the neutrino population into multiple flows, each of which is characterised by its initial momentum and treated as a separate fluid. These fluid flows respond initially linearly to nonlinear perturbations in the cold matter, but slowest flows are later converted to a particle realisation should their clustering power exceed some threshold. After outlining the multi-fluid description of neutrinos, we study the conversion of the individual flows into particles, in order to quantify transient errors, as well as to determine a set of criteria for particle conversion. Assembling our results into a total neutrino power spectrum, we demonstrate that our multi-fluid hybrid-neutrino simulation is convergent to $<3\%$ if conversion happens at $z=19$ and agrees with more expensive simulations in the literature for neutrino fractions as high as $\Omega_\nu h^2 = 0.005$. Moreover, our hybrid-neutrino approach retains fine-grained information about the neutrinos' momentum distribution. However, the momentum resolution is currently limited by free-streaming transients excited by missing information in the neutrino particle initialisation procedure, which restricts the particle conversion to z $\gtrsim 19$ if percent-level resolution is desired.


title: LoTSS Jellyfish Galaxies IV: Enhanced Star Formation on the Leading Half of Cluster Galaxies and Gas Compression in IC3949

abstract: With MaNGA integral field spectroscopy, we present a resolved analysis of star formation for 29 jellyfish galaxies in nearby clusters, identified from radio continuum imaging taken by the Low Frequency Array. Simulations predict enhanced star formation on the "leading half" of galaxies undergoing ram pressure stripping, and in this work we report observational evidence for this elevated star formation. The dividing line (through the galaxy center) that maximizes this star formation enhancement is systematically tied to the observed direction of the ram pressure stripped tail, suggesting a physical connection between ram pressure and this star formation enhancement. We also present a case study on the distribution of molecular gas in one jellyfish galaxy from our sample, IC3949, using ALMA CO J=1-0, HCN J=1-0, and HCO$^+$ J=1-0 observations from the ALMaQUEST survey. The $\mathrm{H_2}$ depletion time (as traced by CO) in IC3949 ranges from $\sim\!1\,\mathrm{Gyr}$ in the outskirts of the molecular gas disk to $\sim\!11\,\mathrm{Gyr}$ near the galaxy center. IC3949 shows a clear region of enhanced star formation on the leading half of the galaxy where the average depletion time is $\sim\!2.7\,\mathrm{Gyr}$, in line with the median value for the galaxy on the whole. Dense gas tracers, HCN and HCO$^+$, are only detected at the galaxy center and on the leading half of IC3949. Our results favour a scenario in which ram pressure compresses the interstellar medium, promoting the formation of molecular gas that in turn fuels a localized increase of star formation.


title: Kinetic field theory: generic effects of alternative gravity theories on non-linear cosmic density-fluctuations

abstract: Non-linear cosmic structures contain valuable information on the expansion history of the background space-time, the nature of dark matter, and the gravitational interaction. The recently developed kinetic field theory of cosmic structure formation (KFT) allows to accurately calculate the non-linear power spectrum of cosmic density fluctuations up to wave numbers of $k\lesssim10\,h\,\mathrm{Mpc}^{-1}$ at redshift zero. Cosmology and gravity enter this calculation via two functions, viz. the background expansion function and possibly a time-dependent modification of the gravitational coupling strength. The success of the cosmological standard model based on general relativity suggests that cosmological models in generalized theories of gravity should have observable effects differing only weakly from those in standard cosmology. Based on this assumption, we derive the functional, first-order Taylor expansion of the non-linear power spectrum of cosmic density fluctuations obtained from the mean-field approximation in KFT in terms of the expansion function and the gravitational coupling strength. This allows us to study non-linear power spectra expected in large classes of generalized gravity theories. To give one example, we apply our formalism to generalized Proca theories.


title: Fully-heavy tetraquark spectroscopy in the relativistic quark model

abstract: Masses of the ground and excited (1P, 2S, 1D, 2P, 3S) states of the fully-heavy tetraquarks, composed of charm ($c$) and bottom ($b$) quarks and antiquarks, are calculated in the diquark-antidiquark picture within the relativistic quark model based on the quasipotential approach and quantum chromodynamics. The quasipotentials of the quark-quark and diquark-antidiquark interactions are constructed similarly to the previous consideration of mesons and baryons. Relativistic effects are consistently taken into account. A tetraquark is considered as a bound state of a diquark and an antidiquark. The finite size of the diquark is taken into account, using the form factors of the diquark-gluon interaction. It is shown that most of the investigated states of tetraquarks lie above the decay thresholds into a meson pair, as a result they can be observed only as broad resonances. The narrow state X(6900) recently discovered in the di-$J/\psi$ production spectrum by the LHCb, CMS and ATLAS Collaborations corresponds to an excited state of the fully-charmed tetraquark. Other recently discovered exotic heavy resonances X(6200), X(6400), X(6600), X(7200), X(7300) can also be interpreted as the different excitations of the fully-charmed tetraquark.


title: Data-driven discovery of Green's functions

abstract: Discovering hidden partial differential equations (PDEs) and operators from data is an important topic at the frontier between machine learning and numerical analysis. This doctoral thesis introduces theoretical results and deep learning algorithms to learn Green's functions associated with linear partial differential equations and rigorously justify PDE learning techniques. A theoretically rigorous algorithm is derived to obtain a learning rate, which characterizes the amount of training data needed to approximately learn Green's functions associated with elliptic PDEs. The construction connects the fields of PDE learning and numerical linear algebra by extending the randomized singular value decomposition to non-standard Gaussian vectors and Hilbert--Schmidt operators, and exploiting the low-rank hierarchical structure of Green's functions using hierarchical matrices. Rational neural networks (NNs) are introduced and consist of neural networks with trainable rational activation functions. The highly compositional structure of these networks, combined with rational approximation theory, implies that rational functions have higher approximation power than standard activation functions. In addition, rational NNs may have poles and take arbitrarily large values, which is ideal for approximating functions with singularities such as Green's functions. Finally, theoretical results on Green's functions and rational NNs are combined to design a human-understandable deep learning method for discovering Green's functions from data. This approach complements state-of-the-art PDE learning techniques, as a wide range of physics can be captured from the learned Green's functions such as dominant modes, symmetries, and singularity locations.


title: A sturcture-preserving, upwind-SAV scheme for the degenerate Cahn--Hilliard equation with applications to simulating surface diffusion

abstract: This paper establishes a structure-preserving numerical scheme for the Cahn--Hilliard equation with degenerate mobility. First, by applying a finite volume method with upwind numerical fluxes to the degenerate Cahn--Hilliard equation rewritten by the scalar auxiliary variable (SAV) approach, we creatively obtain an unconditionally bound-preserving, energy-stable and fully-discrete scheme, which, for the first time, addresses the boundedness of the classical SAV approach under $H^{-1}$-gradient flow. Then, a dimensional-splitting technique is introduced in high-dimensional cases, which greatly reduces the computational complexity while preserves original structural properties. Numerical experiments are presented to verify the bound-preserving and energy-stable properties of the proposed scheme. Finally, by applying the proposed structure-preserving scheme, we numerically demonstrate that surface diffusion can be approximated by the Cahn--Hilliard equation with degenerate mobility and Flory--Huggins potential when the absolute temperature is sufficiently low, which agrees well with the theoretical result by using formal asymptotic analysis.wn theoretically by formal matched asymptotics.


title: Code4ML: a Large-scale Dataset of annotated Machine Learning Code

abstract: Program code as a data source is gaining popularity in the data science community. Possible applications for models trained on such assets range from classification for data dimensionality reduction to automatic code generation. However, without annotation number of methods that could be applied is somewhat limited. To address the lack of annotated datasets, we present the Code4ML corpus. It contains code snippets, task summaries, competitions and dataset descriptions publicly available from Kaggle - the leading platform for hosting data science competitions. The corpus consists of ~2.5 million snippets of ML code collected from ~100 thousand Jupyter notebooks. A representative fraction of the snippets is annotated by human assessors through a user-friendly interface specially designed for that purpose. Code4ML dataset can potentially help address a number of software engineering or data science challenges through a data-driven approach. For example, it can be helpful for semantic code classification, code auto-completion, and code generation for an ML task specified in natural language.


title: On the multipole mixing ratio of the $1066$ keV transition from the 0.52 $\mu s$ isomer of $^{180}$Hf

abstract: The nucleus $^{180}$Hf is one of the most primary of examples of an axially symmetric prolate rotor. Combined with the presence of high-$K$ isomers, spectroscopic studies can provide important information on the nature of its single-particle levels. Precise measurements are essential for constraining nuclear models and interpreting the nature of such isomeric states. In this work, the nucleus $^{180}$Hf was populated using the proton pick-up reaction $^{181}$Ta($^{11}$B,$^{12}$C)$^{180}$Hf at beam energy of 47 MeV at Horia Hulubei National Institute of Nuclear Physics and Engineering (IFIN-HH). The spin of the 1374 keV state and the mixing ratio of the $1066$ keV transition have been measured, the latter with an increased precision compared to the previous value from literature. The presently measured spin of the 1374 keV state, currently assigned a tentative value of $(4^-_1)$, favors one of the two different values reported in the literature. The particular state constitutes the band-head of a rotational band in $^{180}$Hf. The measured multipolarity mixing ratio of the inter-band transition $1374 \rightarrow 309$ keV can provide important information for the testing and constraining of theoretical nuclear models used for the study of the intrinsic properties of $^{180}$Hf as well as its neighboring isotopes.


title: Flows For The Masses: A multi-fluid non-linear perturbation theory for massive neutrinos

abstract: Velocity dispersion of the massive neutrinos presents a daunting challenge for non-linear cosmological perturbation theory. We consider the neutrino population as a collection of non-linear fluids, each with uniform initial momentum, through an extension of the Time Renormalization Group perturbation theory. Employing recently-developed Fast Fourier Transform techniques, we accelerate our non-linear perturbation theory by more than two orders of magnitude, making it quick enough for practical use. After verifying that the neutrino mode-coupling integrals and power spectra converge, we show that our perturbation theory agrees with N-body neutrino simulations to within 10% for neutrino fractions $\Omega_{\nu,0} h^2 \leq 0.005$ up to wave numbers of k = 1 h/Mpc, an accuracy consistent with 2.5% errors in the neutrino mass determination. Non-linear growth represents a >10% correction to the neutrino power spectrum even for density fractions as low as $\Omega_{\nu,0} h^2 = 0.001$, demonstrating the limits of linear theory for accurate neutrino power spectrum predictions. Our code FlowsForTheMasses is avaliable online at github.com/upadhye/FlowsForTheMasses .


title: The physical meaning of the holographic principle

abstract: We show in this pedagogical review that far from being "an apparent law of physics that stands by itself" (R. Bousso, Rev. Mod. Phys. 74 (2002), 825-874), the holographic principle (HP) is a straightforward consequence of the quantum information theory of separable systems. It provides a basis for the theories of measurement, time, and scattering. Principles equivalent to the HP appear in both computer science and the life sciences, suggesting that the HP is not just a fundamental principle of physics, but of all of science.