title: Modeling of dendritic solidification and numerical analysis of the phase-field approach to model complex morphologies in alloys

abstract: Dendrites are one of the most widely observed patterns in nature and occur across a wide spectrum of physical phenomena. In solidification and growth patterns in metals and crystals, the multi-level branching structures of dendrites pose a modeling challenge, and a full resolution of these structures is computationally demanding. In the literature, theoretical models of dendritic formation and evolution, essentially as extensions of the classical moving boundary Stefan problem exist. Much of this understanding is from the analysis of dendrites occurring during the solidification of metallic alloys. Motivated by the problem of modeling microstructure evolution from liquid melts of pure metals and alloys during MAM, we developed a comprehensive numerical framework for modeling a large variety of dendritic structures that are relevant to metal solidification. In this work, we present a numerical framework encompassing the modeling of Stefan problem formulations relevant to dendritic evolution using a phase-field approach and a finite element method implementation. Using this framework, we model numerous complex dendritic morphologies that are physically relevant to the solidification of pure melts and binary alloys. The distinguishing aspects of this work are - a unified treatment of both pure metals and alloys; novel numerical error estimates of dendritic tip velocity; and the convergence of error for the primal fields of temperature and the order parameter with respect to numerical discretization. To the best of our knowledge, this is a first-of-its-kind study of numerical convergence of the phase-field equations of dendritic growth in a finite element method setting. Further, we modeled various types of physically relevant dendritic solidification patterns in 2D and 3D computational domains.


title: Implementing arbitrary quantum operations via quantum walks on a cycle graph

abstract: The quantum circuit model is the most commonly used model for implementing quantum computers and quantum neural networks whose essential tasks are to realize certain unitary operations. Here we propose an alternative approach; we use a simple discrete-time quantum walk (DTQW) on a cycle graph to model an arbitrary unitary operation $U(N)$ without the need to decompose it into a sequence of gates of smaller sizes. Our model is essentially a quantum neural network based on DTQW. Firstly, it is universal as we show that any unitary operation $U(N)$ can be realized via an appropriate choice of coin operators. Secondly, our DTQW-based neural network can be updated efficiently via a learning algorithm, i.e., a modified stochastic gradient descent algorithm adapted to our network. By training this network, one can promisingly find approximations to arbitrary desired unitary operations. With an additional measurement on the output, the DTQW-based neural network can also implement general measurements described by positive-operator-valued measures (POVMs). We show its capacity in implementing arbitrary 2-outcome POVM measurements via numeric simulation. We further demonstrate that the network can be simplified and can overcome device noises during the training so that it becomes more friendly for laboratory implementations. Our work shows the capability of the DTQW-based neural network in quantum computation and its potential in laboratory implementations.


title: Discovering Design Concepts for CAD Sketches

abstract: Sketch design concepts are recurring patterns found in parametric CAD sketches. Though rarely explicitly formalized by the CAD designers, these concepts are implicitly used in design for modularity and regularity. In this paper, we propose a learning based approach that discovers the modular concepts by induction over raw sketches. We propose the dual implicit-explicit representation of concept structures that allows implicit detection and explicit generation, and the separation of structure generation and parameter instantiation for parameterized concept generation, to learn modular concepts by end-to-end training. We demonstrate the design concept learning on a large scale CAD sketch dataset and show its applications for design intent interpretation and auto-completion.


title: Short Paper: Static and Microarchitectural ML-Based Approaches For Detecting Spectre Vulnerabilities and Attacks

abstract: Spectre intrusions exploit speculative execution design vulnerabilities in modern processors. The attacks violate the principles of isolation in programs to gain unauthorized private user information. Current state-of-the-art detection techniques utilize micro-architectural features or vulnerable speculative code to detect these threats. However, these techniques are insufficient as Spectre attacks have proven to be more stealthy with recently discovered variants that bypass current mitigation mechanisms. Side-channels generate distinct patterns in processor cache, and sensitive information leakage is dependent on source code vulnerable to Spectre attacks, where an adversary uses these vulnerabilities, such as branch prediction, which causes a data breach. Previous studies predominantly approach the detection of Spectre attacks using the microarchitectural analysis, a reactive approach. Hence, in this paper, we present the first comprehensive evaluation of static and microarchitectural analysis-assisted machine learning approaches to detect Spectre vulnerable code snippets (preventive) and Spectre attacks (reactive). We evaluate the performance trade-offs in employing classifiers for detecting Spectre vulnerabilities and attacks.


title: Scale-free linear protocol design for global regulated state synchronization of discrete-time double-integrator multi-agent systems subject to actuator saturation

abstract: This paper studies global regulated state synchronization of discrete-time double-integrator multi-agent systems subject to actuator saturation by utilizing localized information exchange. We propose a scale-free linear protocol that achieves global regulated state synchronization for any network with arbitrary number of agents and arbitrarily directed communication graph that has a path between each agent and exosystem which generates the reference trajectory.


title: Large deviations for the empirical measure and empirical flow of Markov renewal processes with a countable state space

abstract: Here we propose the Donsker-Varadhan-type compactness conditions and prove the joint large deviation principle for the empirical measure and empirical flow of Markov renewal processes (semi-Markov processes) with a countable state space, generalizing the relevant results for continuous-time Markov chains with a countable state space obtained in [Ann. Inst. H. Poincar\'{e} Probab. Statist. 51, 867-900 (2015)] and [Stoch. Proc. Appl. 125, 2786-2819 (2015)], as well as the relevant results for Markov renewal processes with a finite state space obtained in [Adv. Appl. Probab. 48, 648-671 (2016)]. In particular, our results hold when the flow space is endowed with either the bounded weak* topology or the strong $L^1$ topology. Even for continuous-time Markov chains, our compactness conditions are weaker than the ones proposed in previous papers. Furthermore, under some stronger conditions, we obtain the explicit expression of the marginal rate function of the empirical flow.


title: Asymmetric predictability in causal discovery: an information theoretic approach

abstract: Causal investigations in observational studies pose a great challenge in research where randomized trials or intervention-based studies are not feasible. We develop an information geometric causal discovery and inference framework of "predictive asymmetry". For $(X, Y)$, predictive asymmetry enables assessment of whether $X$ is more likely to cause $Y$ or vice-versa. The asymmetry between cause and effect becomes particularly simple if $X$ and $Y$ are deterministically related. We propose a new metric called the Directed Mutual Information ($DMI$) and establish its key statistical properties. $DMI$ is not only able to detect complex non-linear association patterns in bivariate data, but also is able to detect and infer causal relations. Our proposed methodology relies on scalable non-parametric density estimation using Fourier transform. The resulting estimation method is manyfold faster than the classical bandwidth-based density estimation. We investigate key asymptotic properties of the $DMI$ methodology and a data-splitting technique is utilized to facilitate causal inference using the $DMI$. Through simulation studies and an application, we illustrate the performance of $DMI$.


title: Question-Interlocutor Scope Realized Graph Modeling over Key Utterances for Dialogue Reading Comprehension

abstract: In this work, we focus on dialogue reading comprehension (DRC), a task extracting answer spans for questions from dialogues. Dialogue context modeling in DRC is tricky due to complex speaker information and noisy dialogue context. To solve the two problems, previous research proposes two self-supervised tasks respectively: guessing who a randomly masked speaker is according to the dialogue and predicting which utterance in the dialogue contains the answer. Although these tasks are effective, there are still urging problems: (1) randomly masking speakers regardless of the question cannot map the speaker mentioned in the question to the corresponding speaker in the dialogue, and ignores the speaker-centric nature of utterances. This leads to wrong answer extraction from utterances in unrelated interlocutors' scopes; (2) the single utterance prediction, preferring utterances similar to the question, is limited in finding answer-contained utterances not similar to the question. To alleviate these problems, we first propose a new key utterances extracting method. It performs prediction on the unit formed by several contiguous utterances, which can realize more answer-contained utterances. Based on utterances in the extracted units, we then propose Question-Interlocutor Scope Realized Graph (QuISG) modeling. As a graph constructed on the text of utterances, QuISG additionally involves the question and question-mentioning speaker names as nodes. To realize interlocutor scopes, speakers in the dialogue are connected with the words in their corresponding utterances. Experiments on the benchmarks show that our method can achieve better and competitive results against previous works.


title: Implicit Identity Leakage: The Stumbling Block to Improving Deepfake Detection Generalization

abstract: In this paper, we analyse the generalization ability of binary classifiers for the task of deepfake detection. We find that the stumbling block to their generalization is caused by the unexpected learned identity representation on images. Termed as the Implicit Identity Leakage, this phenomenon has been qualitatively and quantitatively verified among various DNNs. Furthermore, based on such understanding, we propose a simple yet effective method named the ID-unaware Deepfake Detection Model to reduce the influence of this phenomenon. Extensive experimental results demonstrate that our method outperforms the state-of-the-art in both in-dataset and cross-dataset evaluation. The code is available at https://github.com/megvii-research/CADDM.


title: Joint Waveform and Passive Beamformer Design in Multi-IRS-Aided Radar

abstract: Intelligent reflecting surface (IRS) technology has recently attracted a significant interest in non-light-of-sight radar remote sensing. Prior works have largely focused on designing single IRS beamformers for this problem. For the first time in the literature, this paper considers multi-IRS-aided multiple-input multiple-output (MIMO) radar and jointly designs the transmit unimodular waveforms and optimal IRS beamformers. To this end, we derive the Cramer-Rao lower bound (CRLB) of target direction-of-arrival (DoA) as a performance metric. Unimodular transmit sequences are the preferred waveforms from a hardware perspective. We show that, through suitable transformations, the joint design problem can be reformulated as two unimodular quadratic programs (UQP). To deal with the NP-hard nature of both UQPs, we propose unimodular waveform and beamforming design for multi-IRS radar (UBeR) algorithm that takes advantage of the low-cost power method-like iterations. Numerical experiments illustrate that the MIMO waveforms and phase shifts obtained from our UBeR algorithm are effective in improving the CRLB of DoA estimation.


title: Policy iteration: for want of recursive feasibility, all is not lost

abstract: This paper investigates recursive feasibility, recursive robust stability and near-optimality properties of policy iteration (PI). For this purpose, we consider deterministic nonlinear discrete-time systems whose inputs are generated by PI for undiscounted cost functions. We first assume that PI is recursively feasible, in the sense that the optimization problems solved at each iteration admit a solution. In this case, we provide novel conditions to establish recursive robust stability properties for a general attractor, meaning that the policies generated at each iteration ensure a robust \KL-stability property with respect to a general state measure. We then derive novel explicit bounds on the mismatch between the (suboptimal) value function returned by PI at each iteration and the optimal one. Afterwards, motivated by a counter-example that shows that PI may fail to be recursively feasible, we modify PI so that recursive feasibility is guaranteed a priori under mild conditions. This modified algorithm, called PI+, is shown to preserve the recursive robust stability when the attractor is compact. Additionally, PI+ enjoys the same near-optimality properties as its PI counterpart under the same assumptions. Therefore, PI+ is an attractive tool for generating near-optimal stabilizing control of deterministic discrete-time nonlinear systems.


title: PredNAS: A Universal and Sample Efficient Neural Architecture Search Framework

abstract: In this paper, we present a general and effective framework for Neural Architecture Search (NAS), named PredNAS. The motivation is that given a differentiable performance estimation function, we can directly optimize the architecture towards higher performance by simple gradient ascent. Specifically, we adopt a neural predictor as the performance predictor. Surprisingly, PredNAS can achieve state-of-the-art performances on NAS benchmarks with only a few training samples (less than 100). To validate the universality of our method, we also apply our method on large-scale tasks and compare our method with RegNet on ImageNet and YOLOX on MSCOCO. The results demonstrate that our PredNAS can explore novel architectures with competitive performances under specific computational complexity constraints.


title: TPFNet: A Novel Text In-painting Transformer for Text Removal

abstract: Text erasure from an image is helpful for various tasks such as image editing and privacy preservation. In this paper, we present TPFNet, a novel one-stage (end-toend) network for text removal from images. Our network has two parts: feature synthesis and image generation. Since noise can be more effectively removed from low-resolution images, part 1 operates on low-resolution images. The output of part 1 is a low-resolution text-free image. Part 2 uses the features learned in part 1 to predict a high-resolution text-free image. In part 1, we use "pyramidal vision transformer" (PVT) as the encoder. Further, we use a novel multi-headed decoder that generates a high-pass filtered image and a segmentation map, in addition to a text-free image. The segmentation branch helps locate the text precisely, and the high-pass branch helps in learning the image structure. To precisely locate the text, TPFNet employs an adversarial loss that is conditional on the segmentation map rather than the input image. On Oxford, SCUT, and SCUT-EnsText datasets, our network outperforms recently proposed networks on nearly all the metrics. For example, on SCUT-EnsText dataset, TPFNet has a PSNR (higher is better) of 39.0 and text-detection precision (lower is better) of 21.1, compared to the best previous technique, which has a PSNR of 32.3 and precision of 53.2. The source code can be obtained from https://github.com/CandleLabAI/TPFNet


title: Finite-Part Integration of the Hilbert Transform

abstract: The one-sided and full Hilbert transforms are evaluated exactly by means of the method of finite-part integration [E.A. Galapon, \textit{Proc. Roy. Soc. A} \textbf{473}, 20160567 (2017)]. In general, the result consists of two terms -- the first is an infinite series of finite-part of divergent integrals, and the second is a contribution arising from the singularity of the kernel of transformation. The first term is precisely the result obtained when the kernel of transformation is binomially expanded in positive powers of the parameter of transformation, followed by term-by-term integration, and the resulting divergent integrals assigned values equal to their finite-parts. In all cases, the finite-part contribution is present while the presence or absence of the singular contribution depends on the interval of integration and on the parity of the function under transformation about the origin. From the exact evaluation of the Hilbert transform, the dominant asymptotic behavior for arbitrarily small parameter is obtained.


title: Bi-Link: Bridging Inductive Link Predictions from Text via Contrastive Learning of Transformers and Prompts

abstract: Inductive knowledge graph completion requires models to comprehend the underlying semantics and logic patterns of relations. With the advance of pretrained language models, recent research have designed transformers for link prediction tasks. However, empirical studies show that linearizing triples affects the learning of relational patterns, such as inversion and symmetry. In this paper, we propose Bi-Link, a contrastive learning framework with probabilistic syntax prompts for link predictions. Using grammatical knowledge of BERT, we efficiently search for relational prompts according to learnt syntactical patterns that generalize to large knowledge graphs. To better express symmetric relations, we design a symmetric link prediction model, establishing bidirectional linking between forward prediction and backward prediction. This bidirectional linking accommodates flexible self-ensemble strategies at test time. In our experiments, Bi-Link outperforms recent baselines on link prediction datasets (WN18RR, FB15K-237, and Wikidata5M). Furthermore, we construct Zeshel-Ind as an in-domain inductive entity linking the environment to evaluate Bi-Link. The experimental results demonstrate that our method yields robust representations which can generalize under domain shift.


title: Symmetric and Nonsymmetric Macdonald Polynomials via a Path Model with a Pseudo-crystal Structure

abstract: In this paper we derive a counterpart of the well-known Ram-Yip formula for symmetric and nonsymmetric Macdonald polynomials of arbitrary type. Our new formula is in terms of a generalization of the Lakshmibai-Seshadri paths (originating in standard monomial theory), which we call pseudo-quantum Lakshmibai-Seshadri (LS) paths. This model carries less information than the alcove walks in the Ram-Yip formula, and it is therefore more efficient. Furthermore, we construct a connected pseudo-crystal structure on the pseudo-quantum LS paths, which is expected to lead to a simple Littlewood-Richardson rule for multiplying Macdonald polynomials. By contrast with the Kashiwara crystals, our pseudo-crystals have edges labeled by arbitrary roots.


title: Eeny, meeny, miny, moe. How to choose data for morphological inflection

abstract: Data scarcity is a widespread problem in numerous natural language processing (NLP) tasks for low-resource languages. Within morphology, the labour-intensive work of tagging/glossing data is a serious bottleneck for both NLP and language documentation. Active learning (AL) aims to reduce the cost of data annotation by selecting data that is most informative for improving the model. In this paper, we explore four sampling strategies for the task of morphological inflection using a Transformer model: a pair of oracle experiments where data is chosen based on whether the model already can or cannot inflect the test forms correctly, as well as strategies based on high/low model confidence, entropy, as well as random selection. We investigate the robustness of each strategy across 30 typologically diverse languages. We also perform a more in-depth case study of Nat\"ugu. Our results show a clear benefit to selecting data based on model confidence and entropy. Unsurprisingly, the oracle experiment, where only incorrectly handled forms are chosen for further training, which is presented as a proxy for linguist/language consultant feedback, shows the most improvement. This is followed closely by choosing low-confidence and high-entropy predictions. We also show that despite the conventional wisdom of larger data sets yielding better accuracy, introducing more instances of high-confidence or low-entropy forms, or forms that the model can already inflect correctly, can reduce model performance.


title: Power-generation enhancements and upstream flow properties of turbines in unsteady inflow conditions

abstract: Energy-harvesting systems in complex flow environments, such as floating offshore wind turbines, tidal turbines, and ground-fixed turbines in axial gusts, encounter unsteady streamwise flow conditions that affect their power generation and structural loads. In some cases, enhancements in time-averaged power generation above the steady-flow operating point are observed. To characterize these dynamics, a nonlinear dynamical model for the rotation rate and power extraction of a periodically surging turbine is derived and connected to two potential-flow representations of the induction zone upstream of the turbine. The model predictions for the time-averaged power extraction of the turbine and the upstream flow velocity and pressure are compared against data from experiments conducted with a surging-turbine apparatus in an open-circuit wind tunnel at a diameter-based Reynolds number of $Re_D = 6.3\times10^5$ and surge-velocity amplitudes of up to 24% of the wind speed. The combined modeling approach captures trends in both the time-averaged power extraction and the fluctuations in upstream flow quantities, while relying only on data from steady-flow measurements. The sensitivity of the observed increases in time-averaged power to steady-flow turbine characteristics is established, thus clarifying the conditions under which these enhancements are possible. Finally, the influence of unsteady fluid mechanics on time-averaged power extraction is explored analytically. The theoretical framework and experimental validation provide a cohesive modeling approach that can drive the design, control, and optimization of turbines in unsteady flow conditions, as well as inform the development of novel energy-harvesting systems that can leverage unsteady flows for large increases in power-generation capacities.


title: Ensemble Projection Pursuit for General Nonparametric Regression

abstract: The projection pursuit regression (PPR) has played an important role in the development of statistics and machine learning. However, when compared to other established methods like random forests (RF) and support vector machines (SVM), PPR has yet to showcase a similar level of accuracy as a statistical learning technique. In this paper, we revisit the estimation of PPR and propose an \textit{optimal} greedy algorithm and an ensemble approach via "feature bagging", hereafter referred to as ePPR, aiming to improve the efficacy. Compared to RF, ePPR has two main advantages. Firstly, its theoretical consistency can be proved for more general regression functions as long as they are $L^2$ integrable, and higher consistency rates can be achieved. Secondly, ePPR does not split the samples, and thus each term of PPR is estimated using the whole data, making the minimization more efficient and guaranteeing the smoothness of the estimator. Extensive comparisons based on real data sets show that ePPR is more efficient in regression and classification than RF and other competitors. The efficacy of ePPR, a variant of Artificial Neural Networks (ANN), demonstrates that with suitable statistical tuning, ANN can equal or even exceed RF in dealing with small to medium-sized datasets. This revelation challenges the widespread belief that ANN's superiority over RF is limited to processing extensive sample sizes.


title: Noncommutative Bohnenblust--Hille inequalities

abstract: Bohnenblust--Hille inequalities for Boolean cubes have been proven with dimension-free constants that grow subexponentially in the degree \cite{defant2019fourier}. Such inequalities have found great applications in learning low-degree Boolean functions \cite{eskenazis2022learning}. Motivated by learning quantum observables, a qubit analogue of Bohnenblust--Hille inequality for Boolean cubes was recently conjectured in \cite{RWZ22}. The conjecture was resolved in \cite{CHP}. In this paper, we give a new proof of these Bohnenblust--Hille inequalities for qubit system with constants that are dimension-free and of exponential growth in the degree. As a consequence, we obtain a junta theorem for low-degree polynomials. Using similar ideas, we also study learning problems of low degree quantum observables and Bohr's radius phenomenon on quantum Boolean cubes.


title: Inducer-tuning: Connecting Prefix-tuning and Adapter-tuning

abstract: Prefix-tuning, or more generally continuous prompt tuning, has become an essential paradigm of parameter-efficient transfer learning. Using a large pre-trained language model (PLM), prefix-tuning can obtain strong performance by training only a small portion of parameters. In this paper, we propose to understand and further develop prefix-tuning through the kernel lens. Specifically, we make an analogy between \textit{prefixes} and \textit{inducing variables} in kernel methods and hypothesize that \textit{prefixes} serving as \textit{inducing variables} would improve their overall mechanism. From the kernel estimator perspective, we suggest a new variant of prefix-tuning -- \textit{inducer-tuning}, which shares the exact mechanism as prefix-tuning while leveraging the residual form found in adapter-tuning. This mitigates the initialization issue in prefix-tuning. Through comprehensive empirical experiments on natural language understanding and generation tasks, we demonstrate that inducer-tuning can close the performance gap between prefix-tuning and fine-tuning.


title: Impact of photoexcitation on secondary electron emission: a Monte Carlo study

abstract: Understanding the transport of photogenerated charge carriers in semiconductors is crucial for applications in photovoltaics, optoelectronics and photo-detectors. While recent experimental studies using scanning ultrafast electron microscopy (SUEM) have demonstrated that the local change in the secondary electron emission induced by photoexcitation enables direct visualization of the photocarrier dynamics in space and time, the origin of the corresponding image contrast still remains unclear. Here, we investigate the impact of photoexcitation on secondary electron emissions from semiconductors using a Monte Carlo simulation aided by time-dependent density functional theory (TDDFT). Particularly, we examine two photo-induced effects: the generation of photo-carriers in the sample bulk, and the surface photovoltage (SPV) effect. Using doped silicon as a model system and focusing on primary electron energies below 1 keV, we found that both the hot photocarrier effect immediately after photoexcitation and the SPV effect play dominant roles in changing the secondary electron yield (SEY), while the distribution of photocarriers in the bulk leads to a negligible change in SEY. Our work provides insights into electron-matter interaction under photo-illumiation and paves the way towards a quantitative interpretation of the SUEM contrasts.


title: The numerical value for a universal quantity of a two-dimensional dimerized quantum antiferromagnet

abstract: The numerical value of a universal quantity associated with the quantum critical regime, namely $\chi_u c^2/T$, for a two-dimensional (2D) dimerized spin-1/2 antiferromagnet is calculated using the quantum Monte Carlo simulations (QMC). Here $\chi_u$, $c$, and $T$ are the uniform susceptibility, the spin-wave velocity, and the temperature, respectively. By simulating large lattices at moderately low temperatures, we find $\chi_u c^2/T \sim 0.32$. Our estimation of $\chi_u c^2/T$ deviates from the related analytic prediction but agrees with recent numerical calculations of other 2D dimerized spin-1/2 antiferromagnets.


title: Sinhala Sentence Embedding: A Two-Tiered Structure for Low-Resource Languages

abstract: In the process of numerically modeling natural languages, developing language embeddings is a vital step. However, it is challenging to develop functional embeddings for resource-poor languages such as Sinhala, for which sufficiently large corpora, effective language parsers, and any other required resources are difficult to find. In such conditions, the exploitation of existing models to come up with an efficacious embedding methodology to numerically represent text could be quite fruitful. This paper explores the effectivity of several one-tiered and two-tiered embedding architectures in representing Sinhala text in the sentiment analysis domain. With our findings, the two-tiered embedding architecture where the lower-tier consists of a word embedding and the upper-tier consists of a sentence embedding has been proven to perform better than one-tier word embeddings, by achieving a maximum F1 score of 88.04% in contrast to the 83.76% achieved by word embedding models. Furthermore, embeddings in the hyperbolic space are also developed and compared with Euclidean embeddings in terms of performance. A sentiment data set consisting of Facebook posts and associated reactions have been used for this research. To effectively compare the performance of different embedding systems, the same deep neural network structure has been trained on sentiment data with each of the embedding systems used to encode the text associated.


title: Benchmarking Language Models for Code Syntax Understanding

abstract: Pre-trained language models have demonstrated impressive performance in both natural language processing and program understanding, which represent the input as a token sequence without explicitly modeling its structure. Some prior works show that pre-trained language models can capture the syntactic rules of natural languages without finetuning on syntax understanding tasks. However, there is limited understanding of how well pre-trained models understand the code structure so far. In this work, we perform the first thorough benchmarking of the state-of-the-art pre-trained models for identifying the syntactic structures of programs. Specifically, we introduce CodeSyntax, a large-scale dataset of programs annotated with the syntactic relationships in their corresponding abstract syntax trees. Our key observation is that existing language models pretrained on code still lack the understanding of code syntax. In fact, these pre-trained programming language models fail to match the performance of simple baselines based on positional offsets and keywords. We also present a natural language benchmark to highlight the differences between natural languages and programming languages in terms of syntactic structure understanding. Our findings point out key limitations of existing pre-training methods for programming languages, and suggest the importance of modeling code syntactic structures.


title: SCP-GAN: Self-Correcting Discriminator Optimization for Training Consistency Preserving Metric GAN on Speech Enhancement Tasks

abstract: In recent years, Generative Adversarial Networks (GANs) have produced significantly improved results in speech enhancement (SE) tasks. They are difficult to train, however. In this work, we introduce several improvements to the GAN training schemes, which can be applied to most GAN-based SE models. We propose using consistency loss functions, which target the inconsistency in time and time-frequency domains caused by Fourier and Inverse Fourier Transforms. We also present self-correcting optimization for training a GAN discriminator on SE tasks, which helps avoid "harmful" training directions for parts of the discriminator loss function. We have tested our proposed methods on several state-of-the-art GAN-based SE models and obtained consistent improvements, including new state-of-the-art results for the Voice Bank+DEMAND dataset.


title: Copula approach to exchange-correlation hole in many-electron systems with strong correlations

abstract: Electronic correlation is a fundamental topic in many-electron systems. To characterize this correlation, one may introduce the concept of exchange-correlation hole. In this paper, we first briefly revisit its definition and relation to electron and geminal densities, followed by their intimate relations to copula functions in probability theory and statistics. We then propose a copula-based approach to estimate the exchange-correlation hole from the electron density. It is anticipated that the proposed scheme would become a promising ingredient towards the future development of strongly correlated electronic structure calculations.


title: Sinusoidal Frequency Estimation by Gradient Descent

abstract: Sinusoidal parameter estimation is a fundamental task in applications from spectral analysis to time-series forecasting. Estimating the sinusoidal frequency parameter by gradient descent is, however, often impossible as the error function is non-convex and densely populated with local minima. The growing family of differentiable signal processing methods has therefore been unable to tune the frequency of oscillatory components, preventing their use in a broad range of applications. This work presents a technique for joint sinusoidal frequency and amplitude estimation using the Wirtinger derivatives of a complex exponential surrogate and any first order gradient-based optimizer, enabling end to-end training of neural network controllers for unconstrained sinusoidal models.


title: Interpolating sequences for pairs of spaces

abstract: We characterize interpolating sequences for pairs of reproducing kernels $(s, \ell)$, where $s$ is a complete Pick factor of $\ell.$ This answers a question of Aleman, Hartz, McCarthy and Richter.


title: Stabilization of ion-trap secular frequencies for a quantum phase transition study

abstract: An array of ions in a linear radio-frequency (RF) Paul trap is a good candidate for investigating structural phase transitions, such as the linear-to-zigzag (LZ) transition, due to the convenient control provided by modification of the trap confinement strength. In such studies, the trap secular frequencies are a key factor that limits the stability of the critical point (CP). In this paper, we implement secular-frequency stabilization, including active feedback stabilization of the RF voltage near the trap electrodes, and achieve a stability of better than 5~ppm over 200~s for both transverse and axial potentials. To evaluate the combined long-term stability of the trap potential in both directions, we measure the zigzag (ZZ) mode frequency near the CP, where the effect of instability in both trap directions is substantially amplified. The short-term noise within a limited spectral window is also suppressed by this scheme, as inferred from decoherence rates of the ZZ mode measured at different frequencies with Ramsey fringes. We also identify that the limitation of the secular frequency stability is mainly from the imperfect temperature insensitivity of voltage dividers and RF detectors, and as a result improvement of lab temperature stability is of great help for stabilizing the trap frequency.


title: An in vitro living system for flow rectification

abstract: Small - but finite - fluid inertia can be leveraged to generate steady flows out of liquid vibrations around an immersed interface. In engineering, external high-frequency drivers (10$^2$-10$^5$ Hz) allow this inertial rectification phenomenon, known as viscous streaming, to be employed in micron-scale devices for precise flow control, particle manipulation and spatially controlled chemistry. However, beyond artificial settings, streaming may also be accessed by larger-scale biological systems pertaining to lower frequencies. Then, millimeter-size bacteria or larvae that oscillate cilia and appendages in the 1-10Hz range may be able to endogenously rectify surrounding flows, for feeding or locomotion, removing the need for external actuators, tethers or tubings. In support of this hypothesis, here we demonstrate an in vitro living system able to produce streaming flows, endogenously, autonomously and unassisted. Computationally informed, our biological device generates oscillatory flows through the cyclic contractions of an engineered muscle tissue, shaped in the form of a ring and suspended in fluid within a Micro-Particle Image Velocimetry setup, for analysis. Flow patterns consistent with streaming simulations are observed for low-frequency muscle contractions (2-4Hz), either spontaneous or light-induced, illustrating system autonomy and controllability, respectively. Thus, this work provides experimental evidence of biologically powered streaming in untethered millimeter-scale living systems, showcasing the utility of bio-hybrid technology for fundamental and applied fluid mechanics.


title: Meta-node: A Concise Approach to Effectively Learn Complex Relationships in Heterogeneous Graphs

abstract: Existing message passing neural networks for heterogeneous graphs rely on the concepts of meta-paths or meta-graphs due to the intrinsic nature of heterogeneous graphs. However, the meta-paths and meta-graphs need to be pre-configured before learning and are highly dependent on expert knowledge to construct them. To tackle this challenge, we propose a novel concept of meta-node for message passing that can learn enriched relational knowledge from complex heterogeneous graphs without any meta-paths and meta-graphs by explicitly modeling the relations among the same type of nodes. Unlike meta-paths and meta-graphs, meta-nodes do not require any pre-processing steps that require expert knowledge. Going one step further, we propose a meta-node message passing scheme and apply our method to a contrastive learning model. In the experiments on node clustering and classification tasks, the proposed meta-node message passing method outperforms state-of-the-arts that depend on meta-paths. Our results demonstrate that effective heterogeneous graph learning is possible without the need for meta-paths that are frequently used in this field.


title: Calibrationless Reconstruction of Uniformly-Undersampled Multi-Channel MR Data with Deep Learning Estimated ESPIRiT Maps

abstract: Purpose: To develop a truly calibrationless reconstruction method that derives ESPIRiT maps from uniformly-undersampled multi-channel MR data by deep learning. Methods: ESPIRiT, one commonly used parallel imaging reconstruction technique, forms the images from undersampled MR k-space data using ESPIRiT maps that effectively represents coil sensitivity information. Accurate ESPIRiT map estimation requires quality coil sensitivity calibration or autocalibration data. We present a U-Net based deep learning model to estimate the multi-channel ESPIRiT maps directly from uniformly-undersampled multi-channel multi-slice MR data. The model is trained using fully-sampled multi-slice axial brain datasets from the same MR receiving coil system. To utilize subject-coil geometric parameters available for each dataset, the training imposes a hybrid loss on ESPIRiT maps at the original locations as well as their corresponding locations within the standard reference multi-slice axial stack. The performance of the approach was evaluated using publicly available T1-weighed brain and cardiac data. Results: The proposed model robustly predicted multi-channel ESPIRiT maps from uniformly-undersampled k-space data. They were highly comparable to the reference ESPIRiT maps directly computed from 24 consecutive central k-space lines. Further, they led to excellent ESPIRiT reconstruction performance even at high acceleration, exhibiting a similar level of errors and artifacts to that by using reference ESPIRiT maps. Conclusion: A new deep learning approach is developed to estimate ESPIRiT maps directly from uniformly-undersampled MR data. It presents a general strategy for calibrationless parallel imaging reconstruction through learning from coil and protocol specific data.


title: SPQR: An R Package for Semi-Parametric Density and Quantile Regression

abstract: We develop an R package SPQR that implements the semi-parametric quantile regression (SPQR) method in Xu and Reich (2021). The method begins by fitting a flexible density regression model using monotonic splines whose weights are modeled as data-dependent functions using artificial neural networks. Subsequently, estimates of conditional density and quantile process can all be obtained. Unlike many approaches to quantile regression that assume a linear model, SPQR allows for virtually any relationship between the covariates and the response distribution including non-linear effects and different effects on different quantile levels. To increase the interpretability and transparency of SPQR, model-agnostic statistics developed by Apley and Zhu (2020) are used to estimate and visualize the covariate effects and their relative importance on the quantile function. In this article, we detail how this framework is implemented in SPQR and illustrate how this package should be used in practice through simulated and real data examples.


title: Robust Contextual Linear Bandits

abstract: Model misspecification is a major consideration in applications of statistical methods and machine learning. However, it is often neglected in contextual bandits. This paper studies a common form of misspecification, an inter-arm heterogeneity that is not captured by context. To address this issue, we assume that the heterogeneity arises due to arm-specific random variables, which can be learned. We call this setting a robust contextual bandit. The arm-specific variables explain the unknown inter-arm heterogeneity, and we incorporate them in the robust contextual estimator of the mean reward and its uncertainty. We develop two efficient bandit algorithms for our setting: a UCB algorithm called RoLinUCB and a posterior-sampling algorithm called RoLinTS. We analyze both algorithms and bound their $n$-round Bayes regret. Our experiments show that RoLinTS is comparably statistically efficient to the classic methods when the misspecification is low, more robust when the misspecification is high, and significantly more computationally efficient than its naive implementation.


title: Imputation of missing values in multi-view data

abstract: Data for which a set of objects is described by multiple distinct feature sets (called views) is known as multi-view data. When missing values occur in multi-view data, all features in a view are likely to be missing simultaneously. This may lead to very large quantities of missing data which, especially when combined with high-dimensionality, can make the application of conditional imputation methods computationally infeasible. However, the multi-view structure could be leveraged to reduce the complexity and computational load of imputation. We introduce a new imputation method based on the existing stacked penalized logistic regression (StaPLR) algorithm for multi-view learning. It performs imputation in a dimension-reduced space to address computational challenges inherent to the multi-view context. We compare the performance of the new imputation method with several existing imputation algorithms in simulated data sets and a real data application. The results show that the new imputation method leads to competitive results at a much lower computational cost, and makes the use of advanced imputation algorithms such as missForest and predictive mean matching possible in settings where they would otherwise be computationally infeasible.


title: Reconstruction from edge image combined with color and gradient difference for industrial surface anomaly detection

abstract: Reconstruction-based methods are widely explored in industrial visual anomaly detection. Such methods commonly require the model to well reconstruct the normal patterns but fail in the anomalies, and thus the anomalies can be detected by evaluating the reconstruction errors. However, in practice, it's usually difficult to control the generalization boundary of the model. The model with an overly strong generalization capability can even well reconstruct the abnormal regions, making them less distinguishable, while the model with a poor generalization capability can not reconstruct those changeable high-frequency components in the normal regions, which ultimately leads to false positives. To tackle the above issue, we propose a new reconstruction network where we reconstruct the original RGB image from its gray value edges (EdgRec). Specifically, this is achieved by an UNet-type denoising autoencoder with skip connections. The input edge and skip connections can well preserve the high-frequency information in the original image. Meanwhile, the proposed restoration task can force the network to memorize the normal low-frequency and color information. Besides, the denoising design can prevent the model from directly copying the original high-frequent components. To evaluate the anomalies, we further propose a new interpretable hand-crafted evaluation function that considers both the color and gradient differences. Our method achieves competitive results on the challenging benchmark MVTec AD (97.8\% for detection and 97.7\% for localization, AUROC). In addition, we conduct experiments on the MVTec 3D-AD dataset and show convincing results using RGB images only. Our code will be available at https://github.com/liutongkun/EdgRec.


title: Leveraging Affirmative Interpretations from Negation Improves Natural Language Understanding

abstract: Negation poses a challenge in many natural language understanding tasks. Inspired by the fact that understanding a negated statement often requires humans to infer affirmative interpretations, in this paper we show that doing so benefits models for three natural language understanding tasks. We present an automated procedure to collect pairs of sentences with negation and their affirmative interpretations, resulting in over 150,000 pairs. Experimental results show that leveraging these pairs helps (a) T5 generate affirmative interpretations from negations in a previous benchmark, and (b) a RoBERTa-based classifier solve the task of natural language inference. We also leverage our pairs to build a plug-and-play neural generator that given a negated statement generates an affirmative interpretation. Then, we incorporate the pretrained generator into a RoBERTa-based classifier for sentiment analysis and show that doing so improves the results. Crucially, our proposal does not require any manual effort.


title: Synchronization of Online Social Rhythms via Avatar Communications

abstract: In this study, we consider users' online communication rhythms (online social rhythms) as coupled oscillators in a complex social network. Users' rhythms may be entrained onto those of their friends, and macro-scale pattern of such rhythms can emerge. We investigated the entrainment in online social rhythms and long-range correlations of the rhythms using an avatar communication dataset. We indicated entrainment in online social rhythms to emerge if the strength of a new connection reaches a threshold. This entrainment spread via densely-connected clusters. Consequently, long-range correlations of online social rhythms extended to about 36% of the network, although offline social life naturally restricts online social rhythms. This research supports an understanding of human social dynamics in terms of systems of coupled oscillators.


title: History-Based, Bayesian, Closure for Stochastic Parameterization: Application to Lorenz '96

abstract: Physical parameterizations are used as representations of unresolved subgrid processes within weather and global climate models or coarse-scale turbulent models, whose resolutions are too coarse to resolve small-scale processes. These parameterizations are typically grounded on physically-based, yet empirical, representations of the underlying small-scale processes. Machine learning-based parameterizations have recently been proposed as an alternative and have shown great promises to reduce uncertainties associated with small-scale processes. Yet, those approaches still show some important mismatches that are often attributed to stochasticity in the considered process. This stochasticity can be due to noisy data, unresolved variables or simply to the inherent chaotic nature of the process. To address these issues, we develop a new type of parameterization (closure) which is based on a Bayesian formalism for neural networks, to account for uncertainty quantification, and includes memory, to account for the non-instantaneous response of the closure. To overcome the curse of dimensionality of Bayesian techniques in high-dimensional spaces, the Bayesian strategy is based on a Hamiltonian Monte Carlo Markov Chain sampling strategy that takes advantage of the likelihood function and kinetic energy's gradients with respect to the parameters to accelerate the sampling process. We apply the proposed Bayesian history-based parameterization to the Lorenz '96 model in the presence of noisy and sparse data, similar to satellite observations, and show its capacity to predict skillful forecasts of the resolved variables while returning trustworthy uncertainty quantifications for different sources of error. This approach paves the way for the use of Bayesian approaches for closure problems.

categories: stat.ML cs.LG cs.NA math.NA nlin.CD physics.ao-ph


title: Differentially Private Stochastic Convex Optimization for Network Routing Applications

abstract: Network routing problems are common across many engineering applications. Computing optimal routing policies requires knowledge about network demand, i.e., the origin and destination (OD) of all requests in the network. However, privacy considerations make it challenging to share individual OD data that would be required for computing optimal policies. Privacy can be particularly challenging in standard network routing problems because sources and sinks can be easily identified from flow conservation constraints, making feasibility and privacy mutually exclusive. In this paper, we present a differentially private algorithm for network routing problems. The main ingredient is a reformulation of network routing which moves all user data-dependent parameters out of the constraint set and into the objective function. We then present an algorithm for solving this formulation based on a differentially private variant of stochastic gradient descent. In this algorithm, differential privacy is achieved by injecting noise, and one may wonder if this noise injection compromises solution quality. We prove that our algorithm is both differentially private and asymptotically optimal as the size of the training set goes to infinity. We corroborate the theoretical results with numerical experiments on a road traffic network which show that our algorithm provides differentially private and near-optimal solutions in practice.


title: Phase Behaviors of Ionic Liquids Attributed to the Dual Ionic and Organic Nature

abstract: Ionic liquids (ILs), also known as room-temperature molten salts, are composed of pure ions with melting points usually below 100 degrees centigrade. Because of their low volatility and vast amounts of species, ILs can serve as "green solvents" and "designer solvents" to meet the requirements of various applications by fine tuning their molecular structures. A good understanding of the phase behaviors of ILs is certainly fundamentally important in terms of their wide applications. This review intends to summarize the major conclusions so far drawn on phase behaviors of ILs by computational, theoretical, and experimental studies, illustrating the intrinsic relationship between their dual ionic and organic nature and the crystalline phases, nanoscale segregation liquid phase, ionic liquid crystal phases, as well as phase behaviors of their mixture with small organic molecules.


title: Mathematical definition of public language, and modeling of will and consciousness based on the public language

abstract: To propose a mathematical model of consciousness and will, we first simulated the inverted qualia with a toy model of a neural network. As a result, we confirmed that there can be an inverted qualia on the neural network. In other words, the qualia were individual-dependent and considered difficult as an indicator of consciousness and will. To solve that difficulty, we introduce a probability space and a random variable into a set of qualia and define a public language for events. Based on this idea of public language, consciousness and will are modeled. In this proposal, future actions are randomly selected from the comparison between "recognition of events" by external observation and past episodic memory, and the actual "recognition of actions" is regarded as the occurrence of consciousness. The basic formula is also derived. This proposal is compared with other past philosophical discussions.


title: Provable Safe Reinforcement Learning with Binary Feedback

abstract: Safety is a crucial necessity in many applications of reinforcement learning (RL), whether robotic, automotive, or medical. Many existing approaches to safe RL rely on receiving numeric safety feedback, but in many cases this feedback can only take binary values; that is, whether an action in a given state is safe or unsafe. This is particularly true when feedback comes from human experts. We therefore consider the problem of provable safe RL when given access to an offline oracle providing binary feedback on the safety of state, action pairs. We provide a novel meta algorithm, SABRE, which can be applied to any MDP setting given access to a blackbox PAC RL algorithm for that setting. SABRE applies concepts from active learning to reinforcement learning to provably control the number of queries to the safety oracle. SABRE works by iteratively exploring the state space to find regions where the agent is currently uncertain about safety. Our main theoretical results shows that, under appropriate technical assumptions, SABRE never takes unsafe actions during training, and is guaranteed to return a near-optimal safe policy with high probability. We provide a discussion of how our meta-algorithm may be applied to various settings studied in both theoretical and empirical frameworks.


title: AVES: Animal Vocalization Encoder based on Self-Supervision

abstract: The lack of annotated training data in bioacoustics hinders the use of large-scale neural network models trained in a supervised way. In order to leverage a large amount of unannotated audio data, we propose AVES (Animal Vocalization Encoder based on Self-Supervision), a self-supervised, transformer-based audio representation model for encoding animal vocalizations. We pretrain AVES on a diverse set of unannotated audio datasets and fine-tune them for downstream bioacoustics tasks. Comprehensive experiments with a suite of classification and detection tasks have shown that AVES outperforms all the strong baselines and even the supervised "topline" models trained on annotated audio classification datasets. The results also suggest that curating a small training subset related to downstream tasks is an efficient way to train high-quality audio representation models. We open-source our models at \url{https://github.com/earthspecies/aves}.


title: CS1QA: A Dataset for Assisting Code-based Question Answering in an Introductory Programming Course

abstract: We introduce CS1QA, a dataset for code-based question answering in the programming education domain. CS1QA consists of 9,237 question-answer pairs gathered from chat logs in an introductory programming class using Python, and 17,698 unannotated chat data with code. Each question is accompanied with the student's code, and the portion of the code relevant to answering the question. We carefully design the annotation process to construct CS1QA, and analyze the collected dataset in detail. The tasks for CS1QA are to predict the question type, the relevant code snippet given the question and the code and retrieving an answer from the annotated corpus. Results for the experiments on several baseline models are reported and thoroughly analyzed. The tasks for CS1QA challenge models to understand both the code and natural language. This unique dataset can be used as a benchmark for source code comprehension and question answering in the educational setting.


title: Two-stage dimensional emotion recognition by fusing predictions of acoustic and text networks using SVM

abstract: Automatic speech emotion recognition (SER) by a computer is a critical component for more natural human-machine interaction. As in human-human interaction, the capability to perceive emotion correctly is essential to take further steps in a particular situation. One issue in SER is whether it is necessary to combine acoustic features with other data such as facial expressions, text, and motion capture. This research proposes to combine acoustic and text information by applying a late-fusion approach consisting of two steps. First, acoustic and text features are trained separately in deep learning systems. Second, the prediction results from the deep learning systems are fed into a support vector machine (SVM) to predict the final regression score. Furthermore, the task in this research is dimensional emotion modeling because it can enable a deeper analysis of affective states. Experimental results show that this two-stage, late-fusion approach, obtains higher performance than that of any one-stage processing, with a linear correlation from one-stage to two-stage processing. This late-fusion approach improves previous early fusion results measured in concordance correlation coefficients score.


title: Visually Improved Erosion Algorithm for the Procedural Generation of Tile-based Terrain

abstract: Procedural terrain generation is the process of generating a digital representation of terrain using a computer program or procedure, with little to no human guidance. This paper proposes a procedural terrain generation algorithm based on a graph representation of fluvial erosion that offers several novel improvements over existing algorithms. Namely, the use of a height constraint map with two types of locally defined constraint strengths; the ability to specify a realistic erosion strength via level of rainfall; and the ability to carve realistic gorges. These novelties allow it to generate more varied and realistic terrain by integrating additional parameters and simulation processes, while being faster and offering more flexibility and ease of use to terrain designers due to the nature and intuitiveness of these new parameters and processes. This paper additionally reviews some common metrics used to evaluate terrain generators, and suggests a completely new one that contributes to a more holistic evaluation.


title: Quantum-to-Classical Crossover in Single-electron Emitter

abstract: We investigate the temperature-driven quantum-to-classical crossover in a single-electron emitter. The emitter is composed of a quantum conductor and an electrode, which is coupled via an Ohmic contact. At zero temperature, it has been shown that a single electron can be injected coherently by applying an unit-charge Lorentzian pulse on the electrode. As the electrode temperature increases, we show that the electron emission approaches a time-dependence Poisson process at long times. The Poissonian character is demonstrated from the time-resolved full counting statistics. In the meantime, we show that the emission events remain correlated, which is due to the Pauli exclusion principle. The correlation is revealed from the emission rates of individual electrons, from which a characteristic correlation time can be extracted. The correlation time drops rapidly as the electrode temperature increases, indicating that correlation can only play a non-negligible role at short times in the high-temperature limit. By using the same procedure, we further show that the quantum-to-classical crossover exhibits similar features when the emission is driven by a Lorentzian pulse carrying two electron charge. Our results show how the electron emission process is affected by thermal fluctuations in a single-electron emitter.


title: The Biscari Archive. A case study of the application of Transkribus tool

abstract: The Paterno' Castello Principi di Biscari Archive, preserved at the State Archives of Catania, amongst one of the most crucial family archives, is, in the light of a digital historical methodology, the best computable historical heritage for demonstrating the applicability of applying an HTR tool, such as Transkribus, to digitised historical documents.


title: Strange partners of the doubly charmed tetraquark $T^{+}_{cc}$

abstract: The spectroscopic parameters and widths of the axial-vector $T_{cc:s}^{ \mathrm{AV}}$ and scalar $T_{cc:s}^{\mathrm{S}}$, $\widetilde{T}_{cc:s}^{ \mathrm{S}}$ strange partners of the doubly charmed exotic meson $T_{cc}^{+}$ with the content $cc\overline{u}\overline{s}$, are calculated in the framework of the QCD sum rule method. We model $T_{cc:s}^{\mathrm{AV}}$ as the diquark-antidiquark state composed of axial-vector and scalar components, whereas scalar particles $T_{cc:s}^{\mathrm{S}}$ and $\widetilde{ T}_{cc:s}^{\mathrm{S}}$ are built of axial-vector and scalar diquarks, respectively. The masses and current couplings of these tetraquarks are calculated in the context of the two-point sum rule approach by taking into account the quark, gluon and mixed condensates up to dimension $10$. The full width of the state $T_{cc:s}^{\mathrm{AV}}$ is found from analysis of the processes $T_{cc:s}^{\mathrm{AV}} \to D^{0}D_{s}^{\ast +}$ and $ T_{cc:s}^{\mathrm{AV}} \to D^{\ast}(2007)^{0}D_{s}^{+}$. Decays to $ D^{0}D_{s}^{+}$, $D^{\ast}(2007)^{0}D_{s}^{\ast+}$ and $D^{0}D_{s}^{+}$ mesons are utilized in the case of the scalar tetraquarks $T_{cc:s}^{\mathrm{ S}}$ and $\widetilde{T}_{cc:s}^{\mathrm{S}}$, respectively. The partial widths of the aforementioned decays are determined via the strong couplings $ g_1$, $g_2 $, $G_1$, $G_2$ and $\widetilde{G}$, which describe the strong interactions of the particles at the relevant tetraquark-meson-meson vertices. These couplings are computed using the QCD three-point sum rule method, most appropriate for the strong decays under study. ....


title: Impact and analysis of space-time coupling on slotted MAC in UANs

abstract: The propagation delay is non-negligible in underwater acoustic networks (UANs) since the propagation speed is five orders of magnitude smaller than the speed of light. In this case, space and time factors are strongly coupled to determine the collisions of packet transmissions. To this end, this paper analyzes the impact of spatial-time coupling on slotted medium access control (MAC). We find that both inter-slot and intra-slot collisions may exist, and the inter-slot collision may span multiple slots. The sending slot dependent interference regions could be an annulus inside the whole transmission range. It is pointed out that there exist collision-free regions when a guard interval larger than a packet duration is used in the slot setting. In this sense, the long slot brings spatial reuse in a transmission range. However, we further find that the successful transmission probabilities and throughput are the same for the slot lengths of one packet duration and two packet durations. Simulation results show that the maximum successful transmission probability and throughput can be achieved by a guard interval less than a packet duration, which is much shorter than the existing slot setting in typical Slotted-ALOHA. Simulations also show that the spatial impact is greater for vertical transmission than for horizontal transmissions due to the longer vertical transmission range in three-dimensional UANs.


title: Effect of different splitting criteria on the performance of speech emotion recognition

abstract: Traditional speech emotion recognition (SER) evaluations have been performed merely on a speaker-independent condition; some of them even did not evaluate their result on this condition. This paper highlights the importance of splitting training and test data for SER by script, known as sentence-open or text-independent criteria. The results show that employing sentence-open criteria degraded the performance of SER. This finding implies the difficulties of recognizing emotion from speech in different linguistic information embedded in acoustic information. Surprisingly, text-independent criteria consistently performed worse than speaker+text-independent criteria. The full order of difficulties for splitting criteria on SER performances from the most difficult to the easiest is text-independent, speaker+text-independent, speaker-independent, and speaker+text-dependent. The gap between speaker+text-independent and text-independent was smaller than other criteria, strengthening the difficulties of recognizing emotion from speech in different sentences.


title: SentBS: Sentence-level Beam Search for Controllable Summarization

abstract: A wide range of control perspectives have been explored in controllable text generation. Structure-controlled summarization is recently proposed as a useful and interesting research direction. However, current structure-controlling methods have limited effectiveness in enforcing the desired structure. To address this limitation, we propose a sentence-level beam search generation method (SentBS), where evaluation is conducted throughout the generation process to select suitable sentences for subsequent generations. We experiment with different combinations of decoding methods to be used as subcomponents by SentBS and evaluate results on the structure-controlled dataset MReD. Experiments show that all explored combinations for SentBS can improve the agreement between the generated text and the desired structure, with the best method significantly reducing the structural discrepancies suffered by the existing model, by approximately 68%.


title: New approaches for Schr\"odinger equations with prescribed mass: The Sobolev subcritical case and The Sobolev critical case with mixed dispersion

abstract: In this paper, we prove the existence of normalized solutions for the following Schr\"odinger equation \begin{equation*} \left\{ \begin{array}{ll} -\Delta u-\lambda u=f(u), & x\in \R^N, \int_{\R^N}u^2\mathrm{d}x=c \end{array} \right. \end{equation*} with $N\ge3$, $c>0$, $\lambda\in \R$ and $f\in \mathcal{C}(\R,\R)$ in the Sobolev subcritical case with weaker $L^2$-supercritical conditions and in the Sobolev critical case when $f(u)=\mu |u|^{q-2}u+|u|^{2^*-2}u$ with $\mu>0$ and $2<q<2^*=\f{2N}{N-2}$ allowing to be $L^2$-subcritical, critical or supercritical. Our approach is based on several new critical point theorems on a manifold, which not only help to weaken the previous $L^2$-supercritical conditions in the Sobolev subcritical case, but present an alternative scheme to construct bounded (PS) sequences on a manifold when $f(u)=\mu |u|^{q-2}u+|u|^{2^*-2}u$ technically simpler than the Ghoussoub minimax principle involving topological arguments, as well as working for all $2<q<2^*$. In particular, we propose new strategies to control the energy level in the Sobolev critical case which allow to treat, in a unified way, the dimensions $N=3$ and $N\ge 4$, and fulfill what were expected by Soave and by Jeanjean-Le . We believe that our approaches and strategies may be adapted and modified to attack more variational problems in the constraint contexts.


title: Historical infinitesimalists and modern historiography of infinitesimals

abstract: In the history of infinitesimal calculus, we trace innovation from Leibniz to Cauchy and reaction from Berkeley to Mansion and beyond. We explore 19th century infinitesimal lores, including the approaches of Simeon-Denis Poisson, Gaspard-Gustave de Coriolis, and Jean-Nicolas Noel. We examine contrasting historiographic approaches to such lores, in the work of Laugwitz, Schubring, Spalt, and others, and address a recent critique by Archibald et al. We argue that the element of contingency in this history is more prominent than many modern historians seem willing to acknowledge.


title: Constructions of entanglement-assisted quantum MDS codes from generalized Reed-Solomon codes

abstract: By generalizing the stabilizer quantum error-correcting codes, entanglement-assisted quantum error-correcting (EAQEC) codes were introduced, which could be derived from any classical linear codes via the relaxation of self-orthogonality conditions with the aid of pre-shared entanglement between the sender and the receiver. In this paper, three classes of entanglement-assisted quantum error-correcting maximum-distance-separable (EAQMDS) codes are constructed through generalized Reed-Solomon codes. Under our constructions, the minimum distances of our EAQMDS codes are much larger than those of the known EAQMDS codes of the same lengths that consume the same number of ebits. Furthermore, some of the lengths of the EAQMDS codes are not divisors of $q^2-1$, which are completely new and unlike all those known lengths existed before.


title: Quasinormal modes in higher derivative gravity: testing the black hole parametrization and sensitivity of overtones

abstract: The fundamental quasinormal modes of black holes in higher-derivative gravity given by the Einstein-Weyl action are known to be moderately corrected by the Weyl term. Here we will show that the first several overtones are highly sensitive to even a relatively small Weyl correction, which might be important when representing the earlier stage of the black hole ringdown. In addition, we have solved the problem related to the analytical parametrized approximation of the numerical black hole solution in the Einstein-Weyl theory: In some range of parameters the approximation for the metric developed up to the third order leads to the unusual highly nonmonotonic behavior of the frequencies. We have shown that this problem can be solved via the extension of the parametrization of the metric to higher orders until reaching the regime when the frequencies do not change with further increasing of the order.


title: SimpleDG: Simple Domain Generalization Baseline without Bells and Whistles

abstract: We present a simple domain generalization baseline, which wins second place in both the common context generalization track and the hybrid context generalization track respectively in NICO CHALLENGE 2022. We verify the founding in recent literature, domainbed, that ERM is a strong baseline compared to recent state-of-the-art domain generalization methods and propose SimpleDG which includes several simple yet effective designs that further boost generalization performance. Code is available at https://github.com/megvii-research/SimpleDG


title: Linear Response Theory of Evolved Metabolic Systems

abstract: Predicting cellular metabolic states is a central problem in biophysics. Conventional approaches, however, sensitively depend on the microscopic details of individual metabolic systems. In this Letter, we derived a universal linear relationship between the metabolic responses against nutrient conditions and metabolic inhibition, with the aid of a microeconomic theory. The relationship holds in arbitrary metabolic systems as long as the law of mass conservation stands, as supported by extensive numerical calculations. It offers quantitative predictions without prior knowledge of systems.


title: Parallel Gated Neural Network With Attention Mechanism For Speech Enhancement

abstract: Deep learning algorithm are increasingly used for speech enhancement (SE). In supervised methods, global and local information is required for accurate spectral mapping. A key restriction is often poor capture of key contextual information. To leverage long-term for target speakers and compensate distortions of cleaned speech, this paper adopts a sequence-to-sequence (S2S) mapping structure and proposes a novel monaural speech enhancement system, consisting of a Feature Extraction Block (FEB), a Compensation Enhancement Block (ComEB) and a Mask Block (MB). In the FEB a U-net block is used to extract abstract features using complex-valued spectra with one path to suppress the background noise in the magnitude domain using masking methods and the MB takes magnitude features from the FEBand compensates the lost complex-domain features produced from ComEB to restore the final cleaned speech. Experiments are conducted on the Librispeech dataset and results show that the proposed model obtains better performance than recent models in terms of ESTOI and PESQ scores.


title: Multi-Environment based Meta-Learning with CSI Fingerprints for Radio Based Positioning

abstract: Radio based positioning of a user equipment (UE) based on deep learning (DL) methods using channel state information (CSI) fingerprints have shown promising results. DL models are able to capture complex properties embedded in the CSI about a particular environment and map UE's CSI to the UE's position. However, the CSI fingerprints and the DL models trained on such fingerprints are highly dependent on a particular propagation environment, which generally limits the transfer of knowledge of the DL models from one environment to another. In this paper, we propose a DL model consisting of two parts: the first part aims to learn environment independent features while the second part combines those features depending on the particular environment. To improve transfer learning, we propose a meta learning scheme for training the first part over multiple environments. We show that for positioning in a new environment, initializing a DL model with the meta learned environment independent function achieves higher UE positioning accuracy compared to regular transfer learning from one environment to the new environment, or compared to training the DL model from scratch with only fingerprints from the new environment. Our proposed scheme is able to create an environment independent function which can embed knowledge from multiple environments and more effectively learn from a new environment.


title: Callisto's atmosphere: First evidence for H2 and constraints on H2O

abstract: We explore the parameter space for the contribution to Callisto's H corona observed by the Hubble Space Telescope (Roth et al. 2017a) from sublimated H2O and radiolytically produced H2 using the Direct Simulation Monte Carlo (DSMC) method. The spatial morphology of this corona produced via photo- and magnetospheric electron impact-induced dissociation is described by tracking the motion of and simulating collisions between the hot H atoms and thermal molecules including a near-surface O2 component. Our results indicate that sublimated H2O produced from the surface ice, whether assumed to be intimately mixed with or distinctly segregated from the dark non-ice or ice-poor regolith, cannot explain the observed structure of the H corona. On the other hand, a global H2 component can reproduced the observation, and is also capable of producing the enhanced electron densities observed at high altitudes by Galileo's plasma-wave instrument (Gurnett et al., 1997, 2000), providing the first evidence of H2 in Callisto's atmosphere. The range of H2 surface densities explored, under a variety of conditions, that are consistent with these observations is ~(0.4-1)x10^8 cm^-3. The simulated H2 escape rates and estimated lifetimes suggest that Callisto has a neutral H2 torus. We also place a rough upper limit on the peak H2O number density (<~10^8 cm^-3), column density (<~10^15 cm^-2), and sublimation flux (<~10^12 cm^-2 s^-1), all of which are 1-2 orders of magnitude less than that assumed in previous models. Finally, we discuss the implications of these results, as well as how they compare to Europa and Ganymede.


title: End-to-End Multimodal Representation Learning for Video Dialog

abstract: Video-based dialog task is a challenging multimodal learning task that has received increasing attention over the past few years with state-of-the-art obtaining new performance records. This progress is largely powered by the adaptation of the more powerful transformer-based language encoders. Despite this progress, existing approaches do not effectively utilize visual features to help solve tasks. Recent studies show that state-of-the-art models are biased toward textual information rather than visual cues. In order to better leverage the available visual information, this study proposes a new framework that combines 3D-CNN network and transformer-based networks into a single visual encoder to extract more robust semantic representations from videos. The visual encoder is jointly trained end-to-end with other input modalities such as text and audio. Experiments on the AVSD task show significant improvement over baselines in both generative and retrieval tasks.


title: Normalized solutions for the Choquard equation with mass supercritical nonlinearity

abstract: We consider the nonlinear Choquard equation $$\begin{cases} & - \Delta u = (I_\alpha \ast F(u))F'(u) -\mu u \ \text{in}\ \mathbb{R}^N, & u \in \ H^1(\mathbb{R}^N), \ \int_{\mathbb{R}^N} |u|^2 dx=m, \end{cases} $$ where $\alpha\in(0,N)$, $m>0$ is prescribed, $\mu \in \mathbb{R}$ is a Lagarange multiplier, and $I_\alpha$ is the Riesz potential. Under general assumptions on the nonlinearity $F,$ we prove the existence and multiplicity of normalized solutions.


title: Improving Speech-to-Speech Translation Through Unlabeled Text

abstract: Direct speech-to-speech translation (S2ST) is among the most challenging problems in the translation paradigm due to the significant scarcity of S2ST data. While effort has been made to increase the data size from unlabeled speech by cascading pretrained speech recognition (ASR), machine translation (MT) and text-to-speech (TTS) models; unlabeled text has remained relatively under-utilized to improve S2ST. We propose an effective way to utilize the massive existing unlabeled text from different languages to create a large amount of S2ST data to improve S2ST performance by applying various acoustic effects to the generated synthetic data. Empirically our method outperforms the state of the art in Spanish-English translation by up to 2 BLEU. Significant gains by the proposed method are demonstrated in extremely low-resource settings for both Spanish-English and Russian-English translations.


title: UFO2: A unified pre-training framework for online and offline speech recognition

abstract: In this paper, we propose a Unified pre-training Framework for Online and Offline (UFO2) Automatic Speech Recognition (ASR), which 1) simplifies the two separate training workflows for online and offline modes into one process, and 2) improves the Word Error Rate (WER) performance with limited utterance annotating. Specifically, we extend the conventional offline-mode Self-Supervised Learning (SSL)-based ASR approach to a unified manner, where the model training is conditioned on both the full-context and dynamic-chunked inputs. To enhance the pre-trained representation model, stop-gradient operation is applied to decouple the online-mode objectives to the quantizer. Moreover, in both the pre-training and the downstream fine-tuning stages, joint losses are proposed to train the unified model with full-weight sharing for the two modes. Experimental results on the LibriSpeech dataset show that UFO2 outperforms the SSL-based baseline method by 29.7% and 18.2% relative WER reduction in offline and online modes, respectively.


title: Inertial range scaling of inhomogeneous turbulence

abstract: We investigate how inhomogeneity influences the $k^{-5/3}$ inertial range scaling of turbulent kinetic energy spectra (with $k$ the wavenumber). For weak statistical inhomogeneity, the energy spectrum can be described as an equilibrium spectrum plus a perturbation. Theoretical arguments suggest that this latter contribution scales as $k^{-7/3}$. This prediction is assessed using direct numerical simulations of three-dimensional Kolmogorov flow.


title: Chern-insulator phases and spontaneous spin and valley order in a moir\'e lattice model for magic-angle twisted bilayer graphene

abstract: At a certain "magic" relative twist angle of two graphene sheets it remains a challenge to obtain a detailed description of the proliferation of correlated topological electronic phases and their filling-dependence. We perform a self-consistent real-space Hartree-Fock study of an effective moir{\'e} lattice model to map out the preferred ordered phases as a function of Coulomb interaction strength and moir{\'e} flat-band filling factor. It is found that a quantum valley Hall phase, previously discovered at charge neutrality, is present at all integer fillings for sufficiently large interactions. However, except from charge neutrality additional spontaneous spin/valley polarization is present in the ground state at nonzero integer fillings, leading to Chern-insulator phases and anomalous quantum Hall effects at odd filling factors, thus constituting an example of interaction-driven nontrivial topology. At weaker interactions, all nonzero integer fillings feature metallic inhomogeneous spin/valley ordered phases which may also break additional point group symmetries of the system. We discuss these findings in the light of previous theoretical studies and recent experimental developments of magic-angle twisted bilayer graphene.


title: Which Factors Matter Most? Can Startup Valuation be Micro-Targeted?

abstract: While startup valuations are influenced by revenues, risks, age, and macroeconomic conditions, specific causality is traditionally a black box. Because valuations are not disclosed, roles played by other factors (industry, geography, and intellectual property) can often only be guessed at. VC valuation research indicates the importance of establishing a factor-hierarchy to better understand startup valuations and their dynamics, suggesting the wisdom of hiring data-scientists for this purpose. Bespoke understanding can be established via construction of hierarchical prediction models based on decision trees and random forests. These have the advantage of understanding which factors matter most. In combination with OLS, the also tell us the circumstances of when specific causalities apply. This study explores the deterministic role of categorical variables on the valuation of start-ups (i.e. the joint-combination geographic, urban, and sectoral denomination-variables), in order to be able to build a generalized valuation scorecard approach. Using a dataset of 1,091 venture-capital investments, containing 1,044 unique EU and EEA, this study examines microeconomic, sectoral, and local-level impacts on startup valuation. In principle, the study relies on Fixedeffects and Joint-fixed-effects regressions as well as the analysis and exploration of divergent micropopulations and fault-lines by means of non-parametric approaches combining econometric and machinelearning techniques.


title: Probabilistic Prime Factorization based on Virtually Connected Boltzmann Machine and Probabilistic Annealing

abstract: Probabilistic computing has been introduced to operate functional networks using a probabilistic bit (p-bit), generating 0 or 1 probabilistically from its electrical input. In contrast to quantum computers, probabilistic computing enables the operation of adiabatic algorithms even at room temperature, and is expected to broaden computational abilities in non-deterministic polynomial searching and learning problems. However, previous developments of probabilistic machines have focused on emulating the operation of quantum computers similarly, implementing every p-bit with large weight-sum matrix multiplication blocks or requiring tens of times more p-bits than semiprime bits. Furthermore, previous probabilistic machines adopted the graph model of quantum computers for updating the hardware connections, which further increased the number of sampling operations. Here we introduce a digitally accelerated prime factorization machine with a virtually connected Boltzmann machine and probabilistic annealing method, designed to reduce the complexity and number of sampling operations to below those of previous probabilistic factorization machines. In 10-bit to 64-bit factorizations were performed to assess the effectiveness of the machine, and the machine offers 1.2 X 10^8 times improvement in the number of sampling operations compared with previous factorization machines, with a 22-fold smaller hardware resource. This work shows that probabilistic machines can be implemented in a cost-effective manner using a field-programmable gate array, and hence we suggest that probabilistic computers can be employed for solving various large NP searching problems in the near future.


title: Adaptive scaling of the learning rate by second order automatic differentiation

abstract: In the context of the optimization of Deep Neural Networks, we propose to rescale the learning rate using a new technique of automatic differentiation. This technique relies on the computation of the {\em curvature}, a second order information whose computational complexity is in between the computation of the gradient and the one of the Hessian-vector product. If (1C,1M) represents respectively the computational time and memory footprint of the gradient method, the new technique increase the overall cost to either (1.5C,2M) or (2C,1M). This rescaling has the appealing characteristic of having a natural interpretation, it allows the practitioner to choose between exploration of the parameters set and convergence of the algorithm. The rescaling is adaptive, it depends on the data and on the direction of descent. The numerical experiments highlight the different exploration/convergence regimes.


title: Universal robust quantum gates by geometric correspondence of noisy quantum dynamics

abstract: Exposure to noises is a major obstacle for processing quantum information, but noises don't necessarily induce errors. Errors on the quantum gates could be suppressed via robust quantum control techniques. But understanding the genesis of errors and finding a universal treatment remains grueling. To resolve this issue, we develop a geometric theory to capture quantum dynamics due to various noises graphically, obtaining the quantum erroneous evolution diagrams (QEED). Our theory provides explicit necessary and sufficient criteria for robust control Hamiltonian and quantitative geometric metrics of the gate error. We then develop a protocol to engineer a universal set of single- and two-qubit robust gates that correct the generic errors. Our numerical simulation shows gate fidelities above $99.99\%$ over a broad region of noise strength using simplest and smooth pulses for arbitrary gate time. Our approach offers new insights into the geometric aspects of noisy quantum dynamics and several advantages over existing methods, including the treatment of arbitrary noises, independence of system parameters, scalability, and being friendly to experiments.


title: Simulation-based Modelling of Growth and Pollination of Greenhouse Strawberry

abstract: The cultivated strawberry Fragaria ananassa Duch. is widely planted in greenhouses in China. Its production heavily depends on pollination services. Compared with artificial pollination, bee pollination can significantly improve fruit quality and save considerable labor requirement. Multiple factors such as bee foraging behavior, planting pattern and the spatial complexity of the greenhouse environment interacting over time and space are major obstacles to understanding of bee pollination dynamics. We propose a spatially-explicit agent-based simulation model which allows users to explore how various factors including bee foraging behavior and strawberry phenology conditions as well as the greenhouse environment influence pollination efficiency and fruit quality. Simulation experiments allowed us to compare pollination efficiencies in different conditions. Especially, the cause of bee pollination advantage, optimal bee density and bee hive location were discussed based on sensitivity analysis. In addition, simulation results provide some insights for strawberry planting in a greenhouse. The firmly validated open-source model is a useful tool for hypothesis testing and theory development for strawberry pollination research.


title: OTSeq2Set: An Optimal Transport Enhanced Sequence-to-Set Model for Extreme Multi-label Text Classification

abstract: Extreme multi-label text classification (XMTC) is the task of finding the most relevant subset labels from an extremely large-scale label collection. Recently, some deep learning models have achieved state-of-the-art results in XMTC tasks. These models commonly predict scores for all labels by a fully connected layer as the last layer of the model. However, such models can't predict a relatively complete and variable-length label subset for each document, because they select positive labels relevant to the document by a fixed threshold or take top k labels in descending order of scores. A less popular type of deep learning models called sequence-to-sequence (Seq2Seq) focus on predicting variable-length positive labels in sequence style. However, the labels in XMTC tasks are essentially an unordered set rather than an ordered sequence, the default order of labels restrains Seq2Seq models in training. To address this limitation in Seq2Seq, we propose an autoregressive sequence-to-set model for XMTC tasks named OTSeq2Set. Our model generates predictions in student-forcing scheme and is trained by a loss function based on bipartite matching which enables permutation-invariance. Meanwhile, we use the optimal transport distance as a measurement to force the model to focus on the closest labels in semantic label space. Experiments show that OTSeq2Set outperforms other competitive baselines on 4 benchmark datasets. Especially, on the Wikipedia dataset with 31k labels, it outperforms the state-of-the-art Seq2Seq method by 16.34% in micro-F1 score. The code is available at https://github.com/caojie54/OTSeq2Set.


title: A Bibliometric Analysis and Review on Reinforcement Learning for Transportation Applications

abstract: Transportation is the backbone of the economy and urban development. Improving the efficiency, sustainability, resilience, and intelligence of transportation systems is critical and also challenging. The constantly changing traffic conditions, the uncertain influence of external factors (e.g., weather, accidents), and the interactions among multiple travel modes and multi-type flows result in the dynamic and stochastic natures of transportation systems. The planning, operation, and control of transportation systems require flexible and adaptable strategies in order to deal with uncertainty, non-linearity, variability, and high complexity. In this context, Reinforcement Learning (RL) that enables autonomous decision-makers to interact with the complex environment, learn from the experiences, and select optimal actions has been rapidly emerging as one of the most useful approaches for smart transportation. This paper conducts a bibliometric analysis to identify the development of RL-based methods for transportation applications, typical journals/conferences, and leading topics in the field of intelligent transportation in recent ten years. Then, this paper presents a comprehensive literature review on applications of RL in transportation by categorizing different methods with respect to the specific application domains. The potential future research directions of RL applications and developments are also discussed.


title: Linearized frequency domain Landau-Lifshitz-Gilbert equation formulation

abstract: We present a general finite element linearized Landau-Lifshitz-Gilbert equation (LLGE) solver for magnetic systems under weak time-harmonic excitation field. The linearized LLGE is obtained by assuming a small deviation around the equilibrium state of the magnetic system. Inserting such expansion into LLGE and keeping only first order terms gives the linearized LLGE, which gives a frequency domain solution for the complex magnetization amplitudes under an external time-harmonic applied field of a given frequency. We solve the linear system with an iterative solver using generalized minimal residual method. We construct a preconditioner matrix to effectively solve the linear system. The validity, effectiveness, speed, and scalability of the linear solver are demonstrated via numerical examples.


title: Effects of Inner Halo Angular Momentum on the Peanut/X-shapes of Bars

abstract: Cosmological simulations show that dark matter halos surrounding baryonic disks have a wide range of angular momenta, measured by the spin parameter ($\lambda$). In this study, we bring out the importance of inner angular momentum($<$30 kpc), measured in terms of the halo spin parameter, on the secular evolution of the bar using N-body simulations. We have varied the halo spin parameter $\lambda$ from 0 to 0.1 for co-rotating (prograde) spinning halos and one counter-rotating (retrograde) halo spin ($\lambda$=-0.1) with respect to the disk. We report that as the halo spin increases, the buckling is also triggered earlier and is followed by a second buckling phase in high-spin halo models. The timescale for the second buckling is significantly longer than the first buckling. We find that bar strength does not reduce significantly after the buckling in all of our models, which provides new insights about the role of inner halo angular momentum, unlike previous studies. Also, the buckled bar can still transfer significant angular momentum to the halo in the secular evolution phase, but it reduces with increasing halo spin. In the secular evolution phase, the bar strength increases and saturates to nearly equal values for all the models irrespective of halo spin and the sense of rotation with respect to the disk. The final boxy/peanut shape is more pronounced ($\sim$20 $\%$) in high spin halos having higher angular momentum in the inner region compared to non-rotating halos. We explain our results with angular momentum exchanges between the disk and halo.


title: Design of a Resistive Plate Chamber using additive manufacturing

abstract: Driven by the recent improvement in additive manufacturing technologies, we designed a detector that can be fully printed with a standard and commercial 3D printer. The main goals of this research concern the marginal design and construction costs, the reproducibility/modularity of the products, and the reduced assembly time. During the first phase of this research, after determining the most suitable material, we produced 10 examples of detectors.


title: A new proof of Nishioka's theorem in Mahler's method

abstract: In a recent work [3], the authors established new results about general linear Mahler systems in several variables from the perspective of transcendental number theory, such as a multivariate extension of Nishioka's theorem. Working with functions of several variables and with different Mahler transformations leads to a number of complications, including the need to prove a general vanishing theorem and to use tools from ergodic Ramsey theory and Diophantine approximation (e.g., a variant of the $p$-adic Schmidt subspace theorem). These complications make the proof of the main results proved in [3] rather intricate. In this article, we describe our new approach in the special case of linear Mahler systems in one variable. This leads to a new, elementary, and self-contained proof of Nishioka's theorem, as well as of the lifting theorem more recently obtained by Philippon [22] and the authors [1]. Though the general strategy remains the same as in [3], the proof turns out to be greatly simplified. Beyond its own interest, we hope that reading this article will facilitate the understanding of the proof of the main results obtained in [3].


title: Is MultiWOZ a Solved Task? An Interactive TOD Evaluation Framework with User Simulator

abstract: Task-Oriented Dialogue (TOD) systems are drawing more and more attention in recent studies. Current methods focus on constructing pre-trained models or fine-tuning strategies while the evaluation of TOD is limited by a policy mismatch problem. That is, during evaluation, the user utterances are from the annotated dataset while these utterances should interact with previous responses which can have many alternatives besides annotated texts. Therefore, in this work, we propose an interactive evaluation framework for TOD. We first build a goal-oriented user simulator based on pre-trained models and then use the user simulator to interact with the dialogue system to generate dialogues. Besides, we introduce a sentence-level and a session-level score to measure the sentence fluency and session coherence in the interactive evaluation. Experimental results show that RL-based TOD systems trained by our proposed user simulator can achieve nearly 98% inform and success rates in the interactive evaluation of MultiWOZ dataset and the proposed scores measure the response quality besides the inform and success rates. We are hoping that our work will encourage simulator-based interactive evaluations in the TOD task.