title: PBH formation in EFT of single field inflation with sharp transition

abstract: Using the Effective Field Theory (EFT) framework of single field inflation, we investigate the possibility of the formation of Primordial Black Holes (PBHs) in the Slow Roll (SR) to Ultra Slow Roll (USR) sharp transition. We demonstrate that, due to one-loop correction to the power spectrum, causality is violated ($c_s>1$) for the mass range of PBHs, $M_{\rm PBH}>10^{2}{\rm gm}$ created during the said transition. We find that non-canonical features with $c_s<1$ worsen the predictions of the canonical framework of single-field inflation.


title: Ergodicity and super weak compactness

abstract: We prove that a closed convex subset of a Banach space is (super-)weakly compact if and only if it is (super)-ergodic. As a consequence we deduce that super weakly compact sets are characterized by the fixed point property for continuous affine mappings. We also prove that the M-(fixed point property for affine isometries) implies the Banach-Saks property.


title: Dialectograms: Machine Learning Differences between Discursive Communities

abstract: Word embeddings provide an unsupervised way to understand differences in word usage between discursive communities. A number of recent papers have focused on identifying words that are used differently by two or more communities. But word embeddings are complex, high-dimensional spaces and a focus on identifying differences only captures a fraction of their richness. Here, we take a step towards leveraging the richness of the full embedding space, by using word embeddings to map out how words are used differently. Specifically, we describe the construction of dialectograms, an unsupervised way to visually explore the characteristic ways in which each community use a focal word. Based on these dialectograms, we provide a new measure of the degree to which words are used differently that overcomes the tendency for existing measures to pick out low frequent or polysemous words. We apply our methods to explore the discourses of two US political subreddits and show how our methods identify stark affective polarisation of politicians and political entities, differences in the assessment of proper political action as well as disagreement about whether certain issues require political intervention at all.


title: DocILE Benchmark for Document Information Localization and Extraction

abstract: This paper introduces the DocILE benchmark with the largest dataset of business documents for the tasks of Key Information Localization and Extraction and Line Item Recognition. It contains 6.7k annotated business documents, 100k synthetically generated documents, and nearly~1M unlabeled documents for unsupervised pre-training. The dataset has been built with knowledge of domain- and task-specific aspects, resulting in the following key features: (i) annotations in 55 classes, which surpasses the granularity of previously published key information extraction datasets by a large margin; (ii) Line Item Recognition represents a highly practical information extraction task, where key information has to be assigned to items in a table; (iii) documents come from numerous layouts and the test set includes zero- and few-shot cases as well as layouts commonly seen in the training set. The benchmark comes with several baselines, including RoBERTa, LayoutLMv3 and DETR-based Table Transformer; applied to both tasks of the DocILE benchmark, with results shared in this paper, offering a quick starting point for future work. The dataset, baselines and supplementary material are available at https://github.com/rossumai/docile.


title: ALMA Band 6 high-resolution observations of the transitional disk around SY Cha

abstract: In this study, we reported the results of high-resolution (0.14 arcsec) Atacama Large Millimeter/submillimeter Array (ALMA) observations of the 225 GHz dust continuum and CO molecular emission lines from the transitional disk around SY Cha. Our high-resolution observations clearly revealed the inner cavity and the central point source for the first time. The radial profile of the ring can be approximated by a bright narrow ring superimposed on a fainter wide ring. Furthermore, we found that there is a weak azimuthal asymmetry in dust continuum emission. For gas emissions, we detected $\rm{}^{12}CO$(2$-$1), $\rm{}^{13}CO$(2$-$1) and $\rm{}C^{18}O$(2$-$1), from which we estimated the total gas mass of the disk to be $2.2\times10^{-4}M_\odot$, assuming a CO/H$_2$ ratio of $10^{-4}$. The observations showed that the gas is present inside the dust cavity. The analysis of the velocity structure of the $\rm{}^{12}CO$(2$-$1) emission line revealed that the velocity is distorted at the location of the dust inner disk, which may be owing to warping of the disk or radial gas flow within the cavity of the dust disk. High-resolution observations of SY Cha showed that this system is composed of a ring and a distorted inner disk, which may be common, as indicated by the survey of transitional disk systems at a resolution of $\sim$0.1~arcsec.


title: Evaluation of Virtual Reality Interaction Techniques: the case of 3D Graph

abstract: The virtual reality (VR) and human-computer interaction (HCI) combination has radically changed the way users approach a virtual environment, increasing the feeling of VR immersion, and improving the user experience and usability. The evolution of these two technologies led to the focus on VR locomotion and interaction. Locomotion is generally controller-based, but today hand gesture recognition methods were also used for this purpose. However, hand gestures can be stressful for the user who has to keep the gesture activation for a long time to ensure locomotion, especially continuously. Likewise, in Head Mounted Display (HMD)-based virtual environment or Spherical-based system, the use of classic controllers for the 3D scene interaction could be unnatural for the user compared to using hand gestures such \eg pinching to grab 3D objects. To address these issues, we propose a user study comparing the use of the classic controllers (six-degree-of-freedom (6-DOF) or trackballs) in HMD and spherical-based systems, and the hand tracking and gestures in both VR immersive modes. In particular, we focused on the possible differences between spherical-based systems and HMD in terms of the level of immersion perceived by the user, the mode of user interaction (controller and hands), on the reaction of users concerning usefulness, easiness, and behavioral intention to use.


title: Pseudo-homogeneous tiling of the hyperbolic plane

abstract: A pseudo-homogeneous tiling of a surface is a tiling satisfying the property that the tuple of integers determined by the number of sides of the tiles surrounding each vertex is the same up to a permutation. We develop a systematic method to classify all tuples for which there exist a pseudo-homogeneous tiling of the hyperbolic plane. This, in turn, provides a complete and explicit answer to the question whether a given set of regular polygons tile (edge-to-edge) the hyperbolic plane. As a by-product, we obtain the first known example of a weakly aperiodic set of regular polygons. Further, we produce an infinite family of single weakly aperiodic convex tile with rational inner angles.


title: Auto-SpMV: Automated Optimizing SpMV Kernels on GPU

abstract: Sparse matrix-vector multiplication (SpMV) is an essential linear algebra operation that dominates the computing cost in many scientific applications. Due to providing massive parallelism and high memory bandwidth, GPUs are commonly used to accelerate SpMV kernels. Prior studies mainly focused on reducing the latency of SpMV kernels on GPU. However, few attempts have been made to improve the energy efficiency of SpMV kernels, resulting in GPUs being excluded from the range of low-power applications. Furthermore, prior work has primarily focused on optimizing the sparse format of SpMV kernels, the literature ignores evaluating the impact of tweaking compilation parameters. Lastly, Little attention has been paid to preparing a comprehensive training dataset of running SpMV kernels and fine-tuning the learning hyperparameters. To address these limitations, we present a novel framework, dubbed Auto-SpMV, that enables energy-efficient and low-latency SpMV kernels on GPU. To achieve the best run time performance, Auto-SpMV proposes two optimization modes: compile-time and run-time. In the compile-time mode, Auto-SpMV tweaks the compilation parameters, while in the run-time mode, Auto-SpMV selects the best sparse format for the sparse input matrix. To achieve the best classification results, 1) we collect the largest dataset ever having 30 different sparse matrices running with more than 15K different configurations, and 2) we boost classification models by automatically fine-tuning the learning hyperparameters. Experimental results reveal that Auto-SpMV optimizes latency, energy consumption, average power, and energy efficiency in the compile-time mode by up to 51.9%, 52%, 33.2%, and 53%, respectively, compared to the default setting. Auto-SpMV optimizes average power and energy efficiency in the run-time mode by up to 34.6% and 99.7%, respectively, compared to the default setting.


title: Ab initio calculations of the $2p_{3/2} \rightarrow 2s$ transition in He-, Li-, and Be-like uranium

abstract: The bound-state QED approach is applied to calculations of the $2p_{3/2} \rightarrow 2s$ transition energies in He-, Li-, and Be-like uranium. For U$^{90+}$ and U$^{89+}$, standard perturbation theory for a single level is employed, while the calculations of U$^{88+}$ have required its counterpart for quasidegenerate levels. The utilized approach merges the rigorous QED treatment up to the second order of perturbation theory with the higher-order electron-correlation contributions evaluated within the Breit approximation. The higher-order screened QED effects are estimated by means of the model-QED operator. The nuclear recoil, nuclear polarization, and nuclear deformation effects are taken into account as well. Along with the transition energies, their pairwise differences are calculated. The comprehensive analysis of the uncertainties due to uncalculated effects is carried out, and the most accurate theoretical predictions, which are in perfect agreement with available experimental data, are obtained.


title: Hurwitz numbers for reflection groups $B$ and $D$

abstract: We are building a theory of simple Hurwitz numbers for the reflection groups B and D parallel to the classical theory for the symmetric group. We also study analogs of the cut-and-join operators. An algebraic description of Hurwitz numbers and an explicit formula for them in terms of Schur polynomials are provided. We also relate Hurwitz numbers for B and D to ribbon decomposition of surfaces with boundary -- a similar result for the symmetric group was proved earlier by Yu.Burman and the author. Finally, the generating function of B-Hurwitz numbers is shown to give rise to two independent tau-function of the KP hierarchy.


title: The Impact of Expertise in the Loop for Exploring Machine Rationality

abstract: Human-in-the-loop optimization utilizes human expertise to guide machine optimizers iteratively and search for an optimal solution in a solution space. While prior empirical studies mainly investigated novices, we analyzed the impact of the levels of expertise on the outcome quality and corresponding subjective satisfaction. We conducted a study (N=60) in text, photo, and 3D mesh optimization contexts. We found that novices can achieve an expert level of quality performance, but participants with higher expertise led to more optimization iteration with more explicit preference while keeping satisfaction low. In contrast, novices were more easily satisfied and terminated faster. Therefore, we identified that experts seek more diverse outcomes while the machine reaches optimal results, and the observed behavior can be used as a performance indicator for human-in-the-loop system designers to improve underlying models. We inform future research to be cautious about the impact of user expertise when designing human-in-the-loop systems.


title: Jaccard Metric Losses: Optimizing the Jaccard Index with Soft Labels

abstract: Intersection over Union (IoU) losses are surrogates that directly optimize the Jaccard index. Leveraging IoU losses as part of the loss function have demonstrated superior performance in semantic segmentation tasks compared to optimizing pixel-wise losses such as the cross-entropy loss alone. However, we identify a lack of flexibility in these losses to support vital training techniques like label smoothing, knowledge distillation, and semi-supervised learning, mainly due to their inability to process soft labels. To address this, we introduce Jaccard Metric Losses (JMLs), which are identical to the soft Jaccard loss in standard settings with hard labels but are fully compatible with soft labels. We apply JMLs to three prominent use cases of soft labels: label smoothing, knowledge distillation and semi-supervised learning, and demonstrate their potential to enhance model accuracy and calibration. Our experiments show consistent improvements over the cross-entropy loss across 4 semantic segmentation datasets (Cityscapes, PASCAL VOC, ADE20K, DeepGlobe Land) and 13 architectures, including classic CNNs and recent vision transformers. Remarkably, our straightforward approach significantly outperforms state-of-the-art knowledge distillation and semi-supervised learning methods. The code is available at \href{https://github.com/zifuwanggg/JDTLosses}{https://github.com/zifuwanggg/JDTLosses}.


title: Uniform stabilization for the semi-linear wave equation with nonlinear Kelvin-Voigt damping

abstract: This paper is concerned with the decay estimate of solutions to the semilinear wave equation subject to two localized dampings in a bounded domain. The first one is of the nonlinear Kelvin-Voigt type and is distributed around a neighborhood of the boundary according to the Geometric Control Condition. While the second one is a frictional damping and we consider it hurting the geometric condition of control. We show uniform decay rate results of the corresponding energy for all initial data taken in bounded sets of finite energy phase-space. The proof is based on obtaining an observability inequality which combines unique continuation properties and the tools of the Microlocal Analysis Theory.


title: Simpson's correspondence on singular varieties in positive characteristic

abstract: The main aim of the paper is to provide analogues of Simpson's correspondence on singular projective varieties defined over an algebraically closed field of characteristic $p>0$. There are two main cases. In the first case, we consider analogues of numerically flat vector bundles on a big open subset of a normal projective variety (with arbitrary singularities). Here we introduce the S-fundamental group scheme for quasi-projective varieties that admit compactifications with complement of codimension $\ge 2$. We prove that this group scheme coincides with the S-funda\-men\-tal group scheme of the regular locus of any of its (small) projective compactification. In particular, it provides a new invariant for normal projective varieties isomorphic in codimension $1$. In the second case, we consider vector bundles with an integrable $\lambda$-connection on a normal projective variety $X$ that is (almost) liftable modulo $p^2$. In this case we restrict to varieties with $F$-liftable singularities that are analogous to log canonical singularities. We prove that a semistable Higgs vector bundle on the regular locus of $X$, with appropriately defined vanishing Chern classes, admits a canonical Higgs--de Rham flow. This provides an analogue of some results due to D. Greb, S. Kebekus, B. Taji and T. Peternell. Finally, we give some applications of the obtained results, also to varieties defined in characteristic zero.


title: Treat societally impactful scientific insights as open-source software artifacts

abstract: So far, the relationship between open science and software engineering expertise has largely focused on the open release of software engineering research insights and reproducible artifacts, in the form of open-access papers, open data, and open-source tools and libraries. In this position paper, we draw attention to another perspective: scientific insight itself is a complex and collaborative artifact under continuous development and in need of continuous quality assurance, and as such, has many parallels to software artifacts. Considering current calls for more open, collaborative and reproducible science; increasing demands for public accountability on matters of scientific integrity and credibility; methodological challenges coming with transdisciplinary science; political and communication tensions when scientific insight on societally relevant topics is to be translated to policy; and struggles to incentivize and reward academics who truly want to move into these directions beyond traditional publishing habits and cultures, we make the parallels between the emerging open science requirements and concepts already well-known in (open-source) software engineering research more explicit. We argue that the societal impact of software engineering expertise can reach far beyond the software engineering research community, and call upon the community members to pro-actively help driving the necessary systems and cultural changes towards more open and accountable research.


title: Femtosecond Photophysics of Molecular Polaritons

abstract: Molecular polaritons are hybrid states of photonic and molecular character that form when molecules strongly interact with light. Strong coupling tunes energy levels and importantly, can modify molecular properties (e.g. photoreaction rates) opening an avenue for novel polariton chemistry. In this perspective, we focus on the collective aspects of strongly coupled molecular systems and how this pertains to the dynamical response of such systems, which though of key importance for attaining modified function under polariton formation, is still not well understood. We discuss how the ultrafast time and spectral resolution make pump-probe spectroscopy an ideal tool to reveal the energy transfer pathways from polariton states to other molecular states of functional interest. Finally, we illustrate how analyzing the free (rather than electronic) energy structure in molecular polariton systems may provide new clues into how energy flows and thus how strong coupling may be exploited.


title: Bumblebee black holes in light of Event Horizon Telescope observations

abstract: We report the existence of novel static spherical black-hole solutions in a vector-tensor gravitational theory called the bumblebee gravity model which extends the Einstein-Maxwell theory by allowing the vector to nonminimally couple to the Ricci curvature tensor. A test of the solutions in the strong-field regime is performed for the first time using the recent observations of the supermassive black-hole shadows in the galaxy M87 and the Milky Way from the Event Horizon Telescope Collaboration. The parameter space is found largely unexcluded and more experiments are needed to fully bound the theory.


title: Local strong solutions to the stochastic third grade fluid equations with Navier boundary conditions

abstract: This work is devoted to the study of non-Newtonian fluids of grade three on two-dimensional and three-dimensional bounded domains, driven by a nonlinear multiplicative Wiener noise. More precisely, we establish the existence and uniqueness of the local (in time) solution, which corresponds to an addapted stochastic process with sample paths defined up to a certain positive stopping time, with values in the Sobolev space H^3. Our approach combines a cut-off approximation scheme, a stochastic compactness arguments and a general version of Yamada-Watanabe theorem. This leads to the existence of a local strong pathwise solution.


title: ConMAE: Contour Guided MAE for Unsupervised Vehicle Re-Identification

abstract: Vehicle re-identification is a cross-view search task by matching the same target vehicle from different perspectives. It serves an important role in road-vehicle collaboration and intelligent road control. With the large-scale and dynamic road environment, the paradigm of supervised vehicle re-identification shows limited scalability because of the heavy reliance on large-scale annotated datasets. Therefore, the unsupervised vehicle re-identification with stronger cross-scene generalization ability has attracted more attention. Considering that Masked Autoencoder (MAE) has shown excellent performance in self-supervised learning, this work designs a Contour Guided Masked Autoencoder for Unsupervised Vehicle Re-Identification (ConMAE), which is inspired by extracting the informative contour clue to highlight the key regions for cross-view correlation. ConMAE is implemented by preserving the image blocks with contour pixels and randomly masking the blocks with smooth textures. In addition, to improve the quality of pseudo labels of vehicles for unsupervised re-identification, we design a label softening strategy and adaptively update the label with the increase of training steps. We carry out experiments on VeRi-776 and VehicleID datasets, and a significant performance improvement is obtained by the comparison with the state-of-the-art unsupervised vehicle re-identification methods. The code is available on the website of https://github.com/2020132075/ConMAE.


title: Counter-GAP: Counterfactual Bias Evaluation through Gendered Ambiguous Pronouns

abstract: Bias-measuring datasets play a critical role in detecting biased behavior of language models and in evaluating progress of bias mitigation methods. In this work, we focus on evaluating gender bias through coreference resolution, where previous datasets are either hand-crafted or fail to reliably measure an explicitly defined bias. To overcome these shortcomings, we propose a novel method to collect diverse, natural, and minimally distant text pairs via counterfactual generation, and construct Counter-GAP, an annotated dataset consisting of 4008 instances grouped into 1002 quadruples. We further identify a bias cancellation problem in previous group-level metrics on Counter-GAP, and propose to use the difference between inconsistency across genders and within genders to measure bias at a quadruple level. Our results show that four pre-trained language models are significantly more inconsistent across different gender groups than within each group, and that a name-based counterfactual data augmentation method is more effective to mitigate such bias than an anonymization-based method.


title: Vertical Federated Knowledge Transfer via Representation Distillation for Healthcare Collaboration Networks

abstract: Collaboration between healthcare institutions can significantly lessen the imbalance in medical resources across various geographic areas. However, directly sharing diagnostic information between institutions is typically not permitted due to the protection of patients' highly sensitive privacy. As a novel privacy-preserving machine learning paradigm, federated learning (FL) makes it possible to maximize the data utility among multiple medical institutions. These feature-enrichment FL techniques are referred to as vertical FL (VFL). Traditional VFL can only benefit multi-parties' shared samples, which strongly restricts its application scope. In order to improve the information-sharing capability and innovation of various healthcare-related institutions, and then to establish a next-generation open medical collaboration network, we propose a unified framework for vertical federated knowledge transfer mechanism (VFedTrans) based on a novel cross-hospital representation distillation component. Specifically, our framework includes three steps. First, shared samples' federated representations are extracted by collaboratively modeling multi-parties' joint features with current efficient vertical federated representation learning methods. Second, for each hospital, we learn a local-representation-distilled module, which can transfer the knowledge from shared samples' federated representations to enrich local samples' representations. Finally, each hospital can leverage local samples' representations enriched by the distillation module to boost arbitrary downstream machine learning tasks. The experiments on real-life medical datasets verify the knowledge transfer effectiveness of our framework.


title: Uniform Banach-Saks properties

abstract: The principal aim of this paper is to study the Banach-Saks property when the speed of convergence of a Cesaro mean sequence can be chosen independtly from the choice of the initial sequence. We establish links between the uniform Banach-Saks property, properties $(A_\infty)$ of Partington and the $p$-Banach-Saks property. We also prove that the $p$-Banach-Saks property and the strong $p$-Banach-Saks property are equivalent. Many examples are given and we apply the results to the symmetric Kottman constant.


title: A Tractable Truthful Profit Maximization Mechanism Design with Autonomous Agents

abstract: Task allocation is a crucial process in modern systems, but it is often challenged by incomplete information about the utilities of participating agents. In this paper, we propose a new profit maximization mechanism for the task allocation problem, where the task publisher seeks an optimal incentive function to maximize its own profit and simultaneously ensure the truthful announcing of the agent's private information (type) and its participation in the task, while an autonomous agent aims at maximizing its own utility function by deciding on its participation level and announced type. Our mechanism stands out from the classical contract theory-based truthful mechanisms as it empowers agents to make their own decisions about their level of involvement, making it more practical for many real-world task allocation scenarios. It has been proven that by considering a linear form of incentive function consisting of two decision functions for the task publisher the mechanism's goals are met. The proposed truthful mechanism is initially modeled as a non-convex functional optimization with the double continuum of constraints, nevertheless, we demonstrate that by deriving an equivalent form of the incentive constraints, it can be reformulated as a tractable convex optimal control problem. Further, we propose a numerical algorithm to obtain the solution.


title: CatAlyst: Domain-Extensible Intervention for Preventing Task Procrastination Using Large Generative Models

abstract: CatAlyst uses generative models to help workers' progress by influencing their task engagement instead of directly contributing to their task outputs. It prompts distracted workers to resume their tasks by generating a continuation of their work and presenting it as an intervention that is more context-aware than conventional (predetermined) feedback. The prompt can function by drawing their interest and lowering the hurdle for resumption even when the generated continuation is insufficient to substitute their work, while recent human-AI collaboration research aiming at work substitution depends on a stable high accuracy. This frees CatAlyst from domain-specific model-tuning and makes it applicable to various tasks. Our studies involving writing and slide-editing tasks demonstrated CatAlyst's effectiveness in helping workers swiftly resume tasks with a lowered cognitive load. The results suggest a new form of human-AI collaboration where large generative models publicly available but imperfect for each individual domain can contribute to workers' digital well-being.


title: Improvement in the Performance and Efficiency on Self-Deficient CaTiO$_3$: Towards Sustainable and Affordable New-Generation Solar Cells

abstract: Thin films of pure and self-deficient calcium titanites i.e., CaTiO$_3$, Ca$_{1-\alpha}$TiO$_3$, CaTi$_{1-\beta}$O$_3$ and CaTiO$_{3-\gamma}$ have been deposited on ITO substrate using dip coating method. X-ray diffraction and Scanning electron Microscopy (SEM) analysis confirm the structural and morphology of all deposited thin films. Photocurrent measurement has been done, and it is observed that during the incidence of UV light on the as-prepared device (i.e., in the "ON" state), a significant increase in photocurrent (IUV) at zero voltage was observed in case of O deficient CaTiO$_3$, while in case of Ti and Ca deficient thin films smaller values of photocurrents were seen. Responsivity and detectivity of deposited thin films of all self-deficient CaTiO3 were found to be maximum in the UV region while they also showed smaller contributions in the visible range possibly due to the presence of self-deficiency. The self-deficient sample exhibits lower resistance (higher recombination rate) than the pure sample at low voltage, but at higher voltage, it is almost identical. Furthermore, theoretical calculations have been performed using the first-principles density-functional theory to validate the experimental findings on self-deficient CaTiO$_3$. Incident-photon-to-current efficiency (IPCE) and current density have also been measured for all deficient CaTiO$_3$ samples. Maximum IPCE have been found in the range 25%-28% for Ti and O deficient samples in the UV range (280- 400 nm). We argue that first-principles DFT calculations combined with the experimental measurements on self-deficient CaTiO$_3$ thin films offer a reliable way to enhance the performance of perovskite-based solar devices.


title: Deriving a genetic regulatory network from an optimization principle

abstract: Many biological systems approach physical limits to their performance, motivating the idea that their behavior and underlying mechanisms could be determined by such optimality. Nevertheless, optimization as a predictive principle has only been applied in very simplified setups. Here, in contrast, we explore a mechanistically-detailed class of models for the gap gene network of the Drosophila embryo, and determine its 50+ parameters by optimizing the information that gene expression levels convey about nuclear positions, subject to physical constraints on the number of available molecules. Optimal networks recapitulate the architecture and spatial gene expression profiles of the real organism. Our framework makes precise the many tradeoffs involved in maximizing functional performance, and allows us to explore alternative networks to address the questions of necessity vs contingency. Multiple solutions to the optimization problem may be realized in closely related organisms.


title: An EPTAS for Budgeted Matching and Budgeted Matroid Intersection

abstract: We study the budgeted versions of the well known matching and matroid intersection problems. While both problems admit a polynomial-time approximation scheme (PTAS) [Berger et al. (Math. Programming, 2011), Chekuri, Vondrak and Zenklusen (SODA 2011)], it has been an intriguing open question whether these problems admit a fully PTAS (FPTAS), or even an efficient PTAS (EPTAS). In this paper we answer the second part of this question affirmatively, by presenting an EPTAS for budgeted matching and budgeted matroid intersection. A main component of our scheme is a novel construction of representative sets for desired solutions, whose cardinality depends only on $\varepsilon$, the accuracy parameter. Thus, enumerating over solutions within a representative set leads to an EPTAS. This crucially distinguishes our algorithms from previous approaches, which rely on exhaustive enumeration over the solution set. Our ideas for constructing representative sets may find use in tackling other budgeted optimization problems, and are thus of independent interest.


title: Maintaining Discrete Probability Distributions in Practice

abstract: A classical problem in random number generation is the sampling of elements from a given discrete distribution. Formally, given a set of indices $S = \{1, \dots, n\}$ and sequence of weights $w_1, \dots, w_n \in \mathbb{R}^+$, the task is to provide samples from $S$ with distribution $p(i) = w_i / W$ where $W = \sum_j w_j$. A commonly accepted solution is Walker's Alias Table, which allows for each sample to be drawn in constant time. However, some applications correspond to a dynamic setting, where elements are inserted or removed, or weights change over time. Here, the Alias Table is not efficient, as it needs to be re-built whenever the underlying distribution changes. In this paper, we engineer a simple data structure for maintaining discrete probability distributions in the dynamic setting. Construction of the data structure is possible in time $O(n)$, sampling is possible in expected time $O(1)$, and an update of size $\Delta$ can be processed in time $O(\Delta n / W)$. As a special case, we maintain an urn containing $W$ marbles of $n$ colors where with each update $O(W / n)$ marbles can be added or removed in $O(1)$ time per update. To evaluate the efficiency of the data structure in practice we conduct an empirical study. The results suggest that the dynamic sampling performance is competitive with the static Alias Table. Compared to existing more complex dynamic solutions we obtain a sampling speed-up of up to half an order of magnitude.


title: Quantum probing of singularities at event horizons of black holes

abstract: It is proved that coordinate transformations of the Schwarzschild metric to new static and stationary metrics do not eliminate the mode of a particle ''fall'' to the event horizon of a black hole. This mode is unacceptable for the quantum mechanics of stationary states.


title: Sequential Underspecified Instrument Selection for Cause-Effect Estimation

abstract: Instrumental variable (IV) methods are used to estimate causal effects in settings with unobserved confounding, where we cannot directly experiment on the treatment variable. Instruments are variables which only affect the outcome indirectly via the treatment variable(s). Most IV applications focus on low-dimensional treatments and crucially require at least as many instruments as treatments. This assumption is restrictive: in the natural sciences we often seek to infer causal effects of high-dimensional treatments (e.g., the effect of gene expressions or microbiota on health and disease), but can only run few experiments with a limited number of instruments (e.g., drugs or antibiotics). In such underspecified problems, the full treatment effect is not identifiable in a single experiment even in the linear case. We show that one can still reliably recover the projection of the treatment effect onto the instrumented subspace and develop techniques to consistently combine such partial estimates from different sets of instruments. We then leverage our combined estimators in an algorithm that iteratively proposes the most informative instruments at each round of experimentation to maximize the overall information about the full causal effect.


title: Multi-Modal Interaction Control of Ultrasound Scanning Robots with Safe Human Guidance and Contact Recovery

abstract: Ultrasound scanning robots enable the automatic imaging of a patient's internal organs by maintaining close contact between the ultrasound probe and the patient's body during a scanning procedure. Comprehensive, high-quality ultrasound scans are essential for providing the patient with an accurate diagnosis and effective treatment plan. An ultrasound scanning robot usually works in a doctor-robot co-existing environment, hence both efficiency and safety during the collaboration should be considered. In this paper, we propose a novel multi-modal control scheme for ultrasound scanning robots, in which three interaction modes are integrated into a single control input. Specifically, the scanning mode drives the robot to track a time-varying trajectory on the patient's body under the desired impedance model; the recovery mode allows the robot to actively recontact the body whenever physical contact between the ultrasound probe and the patient's body is lost; the human-guided mode renders the robot passive such that the doctor can safely intervene to manually reposition the probe. The integration of multiple modes allows the doctor to intervene safely at any time during the task and also maximizes the robot's autonomous scanning ability. The performance of the robot is validated on a collaborative scanning task of a carotid artery examination.


title: A High-dimensional Convergence Theorem for U-statistics with Applications to Kernel-based Testing

abstract: We prove a convergence theorem for U-statistics of degree two, where the data dimension $d$ is allowed to scale with sample size $n$. We find that the limiting distribution of a U-statistic undergoes a phase transition from the non-degenerate Gaussian limit to the degenerate limit, regardless of its degeneracy and depending only on a moment ratio. A surprising consequence is that a non-degenerate U-statistic in high dimensions can have a non-Gaussian limit with a larger variance and asymmetric distribution. Our bounds are valid for any finite $n$ and $d$, independent of individual eigenvalues of the underlying function, and dimension-independent under a mild assumption. As an application, we apply our theory to two popular kernel-based distribution tests, MMD and KSD, whose high-dimensional performance has been challenging to study. In a simple empirical setting, our results correctly predict how the test power at a fixed threshold scales with $d$ and the bandwidth.


title: Specific-heat ratio effects on the interaction between shock wave and heavy-cylindrical bubble: based on discrete Boltzmann method

abstract: Specific-heat ratio effects on the interaction between a planar shock wave and a two-dimensional heavy-cylindrical bubble are studied by the discrete Boltzmann method. Snapshots of schlieren images and evolutions of characteristic scales, being consistent with experiments, are obtained. The specific-heat ratio effects on some relevant dynamic behaviors such as the bubble shape, deformation process, average motion, vortex motion, mixing degree of the fluid system are carefully studied, as well as the related Thermodynamic Non-Equilibriums (TNE) behaviors including the TNE strength, entropy production rate of the system. Specifically, it is found that the influence of specific-heat ratio on the entropy production contributed by non-organized energy flux (NOEF) is more significant than that caused by non-organized momentum flux (NOMF). Effects of specific-heat ratio on entropy production caused by NOMF and NOEF are contrary. The effects of specific-heat ratio on various TNE quantities show interesting differences. These differences consistently show the complexity of TNE flows which is still far from clear understanding.


title: An implicit staggered hybrid finite volume/finite element solver for the incompressible Navier-Stokes equations

abstract: We present a novel fully implicit hybrid finite volume/finite element method for incompressible flows. Following previous works on semi-implicit hybrid FV/FE schemes, the incompressible Navier-Stokes equations are split into a pressure and a transport-diffusion subsystem. The first of them can be seen as a Poisson type problem and is thus solved efficiently using classical continuous Lagrange finite elements. On the other hand, finite volume methods are employed to solve the convective subsystem, in combination with Crouzeix-Raviart finite elements for the discretization of the viscous stress tensor. For some applications, the related CFL condition, even if depending only in the bulk velocity, may yield a severe time restriction in case explicit schemes are used. To overcome this issue an implicit approach is proposed. The system obtained from the implicit discretization of the transport-diffusion operator is solved using an inexact Newton-Krylov method, based either on the BiCStab or the GMRES algorithm. To improve the convergence properties of the linear solver a symmetric Gauss-Seidel (SGS) preconditioner is employed, together with a simple but efficient approach for the reordering of the grid elements that is compatible with MPI parallelization. Besides, considering the Ducros flux for the nonlinear convective terms we can prove that the discrete advection scheme is kinetic energy stable. The methodology is carefully assessed through a set of classical benchmarks for fluid mechanics. A last test shows the potential applicability of the method in the context of blood flow simulation in realistic vessel geometries.


title: Branching Random Walks with One Particle Generation Center and Possible Absorption at Every Point

abstract: We consider a new model of a branching random walk on a multidimensional lattice with continuous time and one source of particle reproduction and death, as well as an infinite number of sources in which, in addition to the walk, only absorption of particles can occur. The asymptotic behavior of the integer moments of both the total number of particles and the number of particles at a lattice point is studied depending on the relationship between the model parameters. In the case of the existence of an isolated positive eigenvalue of the evolution operator of the average number of particles, a limit theorem is obtained on the exponential growth of both the total number of particles and the number of particles at a lattice point.


title: Attention does not guarantee best performance in speech enhancement

abstract: Attention mechanism has been widely utilized in speech enhancement (SE) because theoretically it can effectively model the long-term inherent connection of signal both in time domain and spectrum domain. However, the generally used global attention mechanism might not be the best choice since the adjacent information naturally imposes more influence than the far-apart information in speech enhancement. In this paper, we validate this conjecture by replacing attention with RNN in two typical state-of-the-art (SOTA) models, multi-scale temporal frequency convolutional network (MTFAA) with axial attention and conformer-based metric-GAN network (CMGAN).


title: Methods of generating soft topologies and soft separation axioms

abstract: The paper develops a novel analysis of mutual interactions between topology and soft topology. It is known that each soft topology produces a system of crisp (parameterized) topologies. The other way round is also possible. Namely, one can generate a soft topology from a system of crisp topologies. Different methods of producing soft topologies are discussed by implementing two formulas. Then, the relationships between the resulting soft topologies are obtained. With the help of an example, it is demonstrated that one formula is more constructible than the other. Now, it is reasonable to ask which (topological) properties of a soft topology can be transferred to the set of crisp topologies or the opposite. To address this question, we consider the standard separation axioms and show how well these axioms can be preserved when moving from a system of crisp topologies to the soft topology generated by it and contrariwise. Additionally, our findings extend and disprove some results from the literature.


title: Ultracold Feshbach molecules in an orbital optical lattice

abstract: Quantum gas systems provide a unique experimental platform to study a fundamental paradigm of quantum many-body physics: the crossover between Bose-Einstein condensed (BEC) molecular pairs and Bardeen Cooper Schrieffer (BCS) superfluidity. Some studies have considered quantum gas samples confined in optical lattices, however, focusing on the case, when only the lowest Bloch band is populated, such that orbital degrees of freedom are excluded. In this work, for the first time, ultracold Feshbach molecules of fermionic $^{40}K$ atoms are selectively prepared in the second Bloch band of an optical square lattice, covering a wide range of interaction strengths including the regime of unitarity. Binding energies and band relaxation dynamics are measured by means of a method resembling mass spectrometry. The longest lifetimes arise for strongly interacting Feshbach molecules at the onset of unitarity with values around 300 ms for the lowest band and 100 ms for the second band. In the case of strong confinement in a deep lattice potential, we observe bound dimers also for negative values of the s-wave scattering length, extending previous findings for molecules in the lowest band. Our work prepares the stage for orbital BEC-BCS crossover physics.


title: Local spectral attention for full-band speech enhancement

abstract: Attention mechanism has been widely utilized in speech enhancement (SE) because theoretically it can effectively model the inherent connection of signal both in time domain and spectrum domain. Usually, the span of attention is limited in time domain while the attention in frequency domain spans the whole frequency range. In this paper, we notice that the attention over the whole frequency range hampers the inference for full-band SE and possibly leads to excessive residual noise. To alleviate this problem, we introduce local spectral attention (LSA) into full-band SE model by limiting the span of attention. The ablation test on the state-of-the-art (SOTA) full-band SE model reveals that the local frequency attention can effectively improve overall performance. The improved model achieves the best objective score on the full-band VoiceBank+DEMAND set.


title: TOI-2525 b and c: A pair of massive warm giant planets with a strong transit timing variations revealed by TESS

abstract: TOI-2525 is a K-type star with an estimated mass of M = 0.849$_{-0.033}^{+0.024}$ M$_\odot$ and radius of R = 0.785$_{-0.007}^{+0.007}$ R$_\odot$ observed by the TESS mission in 22 sectors (within sectors 1 and 39). The TESS light curves yield significant transit events of two companions, which show strong transit timing variations (TTVs) with a semi-amplitude of a $\sim$6 hours. We performed TTV dynamical, and photo-dynamical light curve analysis of the TESS data, combined with radial velocity (RV) measurements from FEROS and PFS, and we confirmed the planetary nature of these companions. The TOI-2525 system consists of a transiting pair of planets comparable to Neptune and Jupiter with estimated dynamical masses of $m_{\rm b}$ = 0.088$_{-0.004}^{+0.005}$ M$_{\rm Jup.}$, and $m_{\rm c}$ = 0.709$_{-0.033}^{+0.034}$ M$_{\rm Jup.}$, radius of $r_b$ = 0.88$_{-0.02}^{+0.02}$ R$_{\rm Jup.}$ and $r_c$ = 0.98$_{-0.02}^{+0.02}$ R$_{\rm Jup.}$, and with orbital periods of $P_{\rm b}$ = 23.288$_{-0.002}^{+0.001}$ days and $P_{\rm c}$ = 49.260$_{-0.001}^{+0.001}$ days for the inner and the outer planet, respectively. The period ratio is close to the 2:1 period commensurability, but the dynamical simulations of the system suggest that it is outside the mean motion resonance (MMR) dynamical configuration. TOI-2525 b is among the lowest density Neptune-mass planets known to date, with an estimated median density of $\rho_{\rm b}$ = 0.174$_{-0.015}^{+0.016}$ g\,cm$^{-3}$. The TOI-2525 system is very similar to the other K-dwarf systems discovered by TESS, TOI-2202 and TOI-216, which are composed of almost identical K-dwarf primary and two warm giant planets near the 2:1 MMR.


title: Monadic NIP in monotone classes of relational structures

abstract: We prove that for any monotone class of finite relational structures, the first-order theory of the class is NIP in the sense of stability theory if, and only if, the collection of Gaifman graphs of structures in this class is nowhere dense. This generalises to relational structures a result previously known for graphs and answers an open question posed by Adler and Adler (2014). The result is established by the application of Ramsey-theoretic techniques and shows that the property of being NIP is highly robust for monotone classes. We also show that the model-checking problem for first-order logic is intractable on any class of monotone structures that is not (monadically) NIP. This is a contribution towards the conjecture of Bonnet et al. that the hereditary classes of structures admitting fixed-parameter tractable model-checking are precisely those that are monadically NIP.


title: Effect of pressure on the dynamics of iodine defects in MAPI: An atomistic simulation

abstract: The diffusion of iodine defects has been considered the most important degradation mechanism of methylammonium lead iodine (MAPI) in solar cells. The present study demonstrates the importance of the pressure inside this material on the dynamics of iodine defects, using molecular dynamics simulations. It is known that the diffusion coefficient of an iodine vacancy is an order of magnitude higher than that of interstitial iodine. We show that this difference systematically increases with increased tensile strain and that both diffusion coefficients tend to zero when a compressive strain is applied. This result suggests that compression of the MAPI can be a good solution to reduce its degradation rate. %Also, different methods of determining the diffusion coefficient, including mean squared displacement (MSD) and velocity auto-correlation function, are discussed and applied to the case of ${\rm V}_{\rm I}$. Besides, the statistical aspect of deriving the diffusion coefficient from the mean squared displacement (MSD) is discussed in terms of the initial conditions (positions and velocities) of the atoms and the simulation time, considering different seeds of the pseudo-random number generator used in the simulations performed with the LAMMPS software.


title: Dark Matter Searches with Top Quarks

abstract: Collider signatures with top quarks provide sensitive probes of dark matter (DM) production at the Large Hadron Collider (LHC). In this article, we review the results of DM searches in final states with top quarks conducted by the ATLAS and CMS Collaborations at the LHC, including the most recent results on the full LHC Run 2 dataset. We highlight the complementarity of DM searches in final states with top quarks with searches in other final states in the framework of various simplified models of DM. A re-interpretation of a DM search with top quarks in the context of an effective-field theory description of scalar dark energy is also discussed. Finally, we give an outlook on the potential of DM searches with top quarks in LHC Run 3, at the high-luminosity LHC, and possible future colliders. In this context, we highlight new benchmark models that could be probed by existing and future searches as well as those that predict still uncovered signatures of anomalous top-quark production and decays at the LHC.


abstract: Large pretrained language models (LMs) have shown impressive In-Context Learning (ICL) ability, where the model learns to do an unseen task via a prompt consisting of input-output examples as the demonstration, without any parameter updates. The performance of ICL is highly dominated by the quality of the selected in-context examples. However, previous selection methods are mostly based on simple heuristics, leading to sub-optimal performance. In this work, we formulate in-context example selection as a subset selection problem. We propose CEIL (Compositional Exemplars for In-context Learning), which is instantiated by Determinantal Point Processes (DPPs) to model the interaction between the given input and in-context examples, and optimized through a carefully-designed contrastive learning objective to obtain preference from LMs. We validate CEIL on 12 classification and generation datasets from 7 distinct NLP tasks, including sentiment analysis, paraphrase detection, natural language inference, commonsense reasoning, open-domain question answering, code generation, and semantic parsing. Extensive experiments demonstrate not only the state-of-the-art performance but also the transferability and compositionality of CEIL, shedding new light on effective and efficient in-context learning. Our code is released at https://github.com/HKUNLP/icl-ceil.


title: Arens regularity of ideals in $A(G)$, $A_{cb}(G)$ and $A_M(G)$

abstract: In this paper, we look at the question of when various ideals in the Fourier algebra $A(G)$ or its closures $A_M(G)$ and $A_{cb}(G)$ in, respectively, its multiplier and $cb$-multiplier algebra are Arens regular. We show that in each case, if a non-zero ideal is Arens regular, then the underlying group $G$ must be discrete. In addition, we show that if an ideal $I$ in $A(G)$ has a bounded approximate identity, then it is Arens regular if and only if it is finite-dimensional.


title: From Kinetic Flocking Model of Cucker-Smale Type to Self-Organized Hydrodynamic model

abstract: We investigate the hydrodynamic limit problem for a kinetic flocking model. We develop a GCI-based Hilbert expansion method, and establish rigorously the asymptotic regime from the kinetic Cucker-Smale model with a confining potential in a mesoscopic scale to the macroscopic limit system for self-propelled individuals, which is derived formally by Aceves-S\'anchez, Bostan, Carrillo and Degond (2019). In the traditional kinetic equation with collisions, for example, Boltzmann type equations, the key properties that connect the kinetic and fluid regimes are: the linearized collision operator (linearized collision operator around the equilibrium), denoted by $\mathcal{L}$, is symmetric, and has a nontrivial null space (its elements are called collision invariants) which include all the fluid information, i.e. the dimension of Ker($\mathcal{L}$) is equal to the number of fluid variables. Furthermore, the moments of the collision invariants with the kinetic equations give the macroscopic equations. The new feature and difficulty of the corresponding problem considered in this paper is: the linearized operator $\mathcal{L}$ is not symmetric, i.e. $\mathcal{L}\neq \mathcal{L}^*$, where $\mathcal{L}^*$ is the dual of $\mathcal{L}$. Moreover, the collision invariants lies in Ker($\mathcal{L}^*$), which is called generalized collision invariants (GCI). This is fundamentally different with classical Boltzmann type equations. This is a common feature of many collective motions of self-propelled particles with alignment in living systems, or many active particle system. Another difficulty (also common for active system) is involved by the normalization of the direction vector, which is highly nonlinear.


title: Role of the single-particle dynamics in the transverse current autocorrelation function of a liquid metal

abstract: A very recent simulation study of the transverse current autocorrelation of the Lennard-Jones fluid revealed, as expected, that this function can be perfectly described within the exponential expansion theory. However, above a certain wavevector $Q$, not only transverse collective excitations are found to propagate in the fluid, but a second oscillatory component of unclear origin (thereby called X) must be considered to properly account for the time behavior of the correlation. Here we present an extended investigation of the transverse current autocorrelation of liquid Au as obtained by ab initio molecular dynamics in the very wide range 5.7 nm$^{-1}$ $\le Q \le$ 32.8 nm$^{-1}$ in order to follow the behavior of the X component, if present, also at large $Q$ values. By combining the study of the transverse current autocorrelation with the analogous analysis of its self part, we show that the second oscillatory component originates from the longitudinal dynamics and appears in the same form as a collective excitation is represented in the single-particle behavior. Therefore, the signature of the longitudinal processes (sound waves) in the transverse current autocorrelation is not due to often conjectured couplings of longitudinal and trasverse modes, but descends from the self part of the function, which contains the traces of all processes acting in the fluid as the density of states, that is the spectrum of the velocity autocorrelation function, does.


title: Cross-center Early Sepsis Recognition by Medical Knowledge Guided Collaborative Learning for Data-scarce Hospitals

abstract: There are significant regional inequities in health resources around the world. It has become one of the most focused topics to improve health services for data-scarce hospitals and promote health equity through knowledge sharing among medical institutions. Because electronic medical records (EMRs) contain sensitive personal information, privacy protection is unavoidable and essential for multi-hospital collaboration. In this paper, for a common disease in ICU patients, sepsis, we propose a novel cross-center collaborative learning framework guided by medical knowledge, SofaNet, to achieve early recognition of this disease. The Sepsis-3 guideline, published in 2016, defines that sepsis can be diagnosed by satisfying both suspicion of infection and Sequential Organ Failure Assessment (SOFA) greater than or equal to 2. Based on this knowledge, SofaNet adopts a multi-channel GRU structure to predict SOFA values of different systems, which can be seen as an auxiliary task to generate better health status representations for sepsis recognition. Moreover, we only achieve feature distribution alignment in the hidden space during cross-center collaborative learning, which ensures secure and compliant knowledge transfer without raw data exchange. Extensive experiments on two open clinical datasets, MIMIC-III and Challenge, demonstrate that SofaNet can benefit early sepsis recognition when hospitals only have limited EMRs.


title: HateProof: Are Hateful Meme Detection Systems really Robust?

abstract: Exploiting social media to spread hate has tremendously increased over the years. Lately, multi-modal hateful content such as memes has drawn relatively more traction than uni-modal content. Moreover, the availability of implicit content payloads makes them fairly challenging to be detected by existing hateful meme detection systems. In this paper, we present a use case study to analyze such systems' vulnerabilities against external adversarial attacks. We find that even very simple perturbations in uni-modal and multi-modal settings performed by humans with little knowledge about the model can make the existing detection models highly vulnerable. Empirically, we find a noticeable performance drop of as high as 10% in the macro-F1 score for certain attacks. As a remedy, we attempt to boost the model's robustness using contrastive learning as well as an adversarial training-based method - VILLA. Using an ensemble of the above two approaches, in two of our high resolution datasets, we are able to (re)gain back the performance to a large extent for certain attacks. We believe that ours is a first step toward addressing this crucial problem in an adversarial setting and would inspire more such investigations in the future.


title: Thermodynamics of BTZ Black Holes in Nonlinear Electrodynamics

abstract: We investigate electrically charged black holes in $(2+1)$ dimensional gravity coupled to nonlinear electrodynamics (NED). The metric function $f(r)$ is depicted, showing that there can be one or two horizons. We study black hole thermodynamics in extended phase space. The cosmological constant played the role of thermodynamics pressure. Electrostatic potential, vacuum polarization, internal energy, Helmholtz and Gibbs free energies as functions of black hole horizon and Hawking temperature were analysed. The global stability of the black hole is discussed. The specific heat and local thermodynamic stability of black holes are studied. Finally, the Van der Walls behaviour of the black holes is investigated.


title: A practically efficient fixed-pivot selection algorithm and its extensible MATLAB suite

abstract: Many statistical problems and applications require repeated computation of order statistics, such as the median, but most statistical and programming environments do not offer in their main distribution linear selection algorithms. We introduce one, formally equivalent to quickselect, which keeps the position of the pivot fixed. This makes the implementation simpler and much practical compared with the best known solutions. It also enables an "oracular" pivot position option that can reduce a lot the convergence time of certain statistical applications. We have extended the algorithm to weighted percentiles such as the weighted median, applicable to data associated with varying precision measurements, image filtering, descriptive statistics like the medcouple and for combining multiple predictors in boosting algorithms. We provide the new functions in MATLAB, C and R. We have packaged them in a broad MATLAB toolbox addressing robust statistical methods, many of which can be now optimised by means of efficient (weighted) selections.


title: MTTM: Metamorphic Testing for Textual Content Moderation Software

abstract: The exponential growth of social media platforms such as Twitter and Facebook has revolutionized textual communication and textual content publication in human society. However, they have been increasingly exploited to propagate toxic content, such as hate speech, malicious advertisement, and pornography, which can lead to highly negative impacts (e.g., harmful effects on teen mental health). Researchers and practitioners have been enthusiastically developing and extensively deploying textual content moderation software to address this problem. However, we find that malicious users can evade moderation by changing only a few words in the toxic content. Moreover, modern content moderation software performance against malicious inputs remains underexplored. To this end, we propose MTTM, a Metamorphic Testing framework for Textual content Moderation software. Specifically, we conduct a pilot study on 2,000 text messages collected from real users and summarize eleven metamorphic relations across three perturbation levels: character, word, and sentence. MTTM employs these metamorphic relations on toxic textual contents to generate test cases, which are still toxic yet likely to evade moderation. In our evaluation, we employ MTTM to test three commercial textual content moderation software and two state-of-the-art moderation algorithms against three kinds of toxic content. The results show that MTTM achieves up to 83.9%, 51%, and 82.5% error finding rates (EFR) when testing commercial moderation software provided by Google, Baidu, and Huawei, respectively, and it obtains up to 91.2% EFR when testing the state-of-the-art algorithms from the academy. In addition, we leverage the test cases generated by MTTM to retrain the model we explored, which largely improves model robustness (0% to 5.9% EFR) while maintaining the accuracy on the original test set.


title: On Differential Privacy and Adaptive Data Analysis with Bounded Space

abstract: We study the space complexity of the two related fields of differential privacy and adaptive data analysis. Specifically, (1) Under standard cryptographic assumptions, we show that there exists a problem P that requires exponentially more space to be solved efficiently with differential privacy, compared to the space needed without privacy. To the best of our knowledge, this is the first separation between the space complexity of private and non-private algorithms. (2) The line of work on adaptive data analysis focuses on understanding the number of samples needed for answering a sequence of adaptive queries. We revisit previous lower bounds at a foundational level, and show that they are a consequence of a space bottleneck rather than a sampling bottleneck. To obtain our results, we define and construct an encryption scheme with multiple keys that is built to withstand a limited amount of key leakage in a very particular way.


title: Scaffolding Progress: How Structured Editors Shape Novice Errors When Transitioning from Blocks to Text

abstract: Transitioning from block-based programming to text-based programming environments can be challenging as it requires students to learn new programming language concepts. In this paper, we identify and classify the issues encountered when transitioning from block-based to text-based programming. In particular, we investigate differences that emerge in learners when using a structured editor compared to an unstructured editor. We followed 26 high school students (ages 12-16; M=14 years) as they transitioned from Scratch to Python in three phases: (i) learning Scratch, (ii) transitioning from Scratch to Python using either a structured or unstructured editor, and (iii) evaluating Python coding skills using an unstructured editor. We identify 27 distinct types of issues and show that learners who used a structured editor during the transition phase had 4.6x less syntax issues and 1.9x less data-type issues compared to those who did not. When these learners switched to an unstructured editor for evaluation, they kept a lower rate on data-type issues but faced 4x more syntax errors.


title: Hubble Tension: The Evidence of New Physics

abstract: The $\Lambda$CDM model provides a good fit to most astronomical observations but harbors large areas of phenomenology and ignorance. With the improvements in the precision and number of observations, discrepancies between key cosmological parameters of this model have emerged. Among them, the most notable tension is the 4$\sigma$ to 6$\sigma$ deviation between the Hubble constant ($H_{0}$) estimations measured by the local distance ladder and the cosmic microwave background (CMB) measurement. In this review, we revisit the $H_{0}$ tension based on the latest research and sort out evidence from solutions to this tension that might imply new physics beyond the $\Lambda$CDM model. The evidence leans more towards modifying the late-time universe.


title: Non-Abelian generalization of non-Hermitian quasicrystal: PT-symmetry breaking, localization, entanglement and topological transitions

abstract: Non-Hermitian quasicrystal forms a unique class of matter with symmetry-breaking, localization and topological transitions induced by gain and loss or nonreciprocal effects. In this work, we introduce a non-Abelian generalization of the non-Hermitian quasicrystal, in which the interplay between non-Hermitian effects and non-Abelian quasiperiodic potentials create mobility edges and rich transitions among extended, critical and localized phases. These generic features are demonstrated by investigating three non-Abelian variants of the non-Hermitian Aubry-Andr\'e-Harper model. A unified characterization is given to their spectrum, localization, entanglement and topological properties. Our findings thus add new members to the family of non-Hermitian quasicrystal and uncover unique physics that can be triggered by non-Abelian effects in non-Hermitian systems.


title: Fair Enough: Standardizing Evaluation and Model Selection for Fairness Research in NLP

abstract: Modern NLP systems exhibit a range of biases, which a growing literature on model debiasing attempts to correct. However current progress is hampered by a plurality of definitions of bias, means of quantification, and oftentimes vague relation between debiasing algorithms and theoretical measures of bias. This paper seeks to clarify the current situation and plot a course for meaningful progress in fair learning, with two key contributions: (1) making clear inter-relations among the current gamut of methods, and their relation to fairness theory; and (2) addressing the practical problem of model selection, which involves a trade-off between fairness and accuracy and has led to systemic issues in fairness research. Putting them together, we make several recommendations to help shape future work.


title: Symmetries and Lie Algebra of Ramanujan Equation

abstract: Symmetry analysis of Ramanujan's system of differential equations is performed by representing it as a third-order equation. A new system consisting of a second-order and a first-order equation is derived from Ramanujan's system. The Lie algebra of the new system is equivalent to the algebra of the third-order equation. This forms the basis of our intuition that for a system of first-order odes its infinite-dimensional algebra of symmetries contains a subalgebra which is a representation of the Lie algebra for any system or differential equation which can be obtained from the original system, even though the transformations are not point.


title: Euclidean Quantum Gravity from Variational Dynamics

abstract: A variational phase space is constructed for a compact and piecewise flat Riemannian manifold. An extended action functional is provided such that the variational dynamics generate a symplectic flow on the phase space. This symplectic flow is numerically integrated as it evolves with respect to the variational parameter. Assuming ergodicity, the resulting flow samples the Euclidean path integral.


title: Sharp inequalities and solitons for statistical submersions

abstract: In this research article, initially, we prove some sharp inequalities on statistical submersions involving Ricci and scalar curvatures of the statistical manifolds. In addition, we establish the geometrical bearing on statistical submersions in terms of Ricci-Bourguignon soliton. Moreover, we characterize the fibers of a statistical submersion as Ricci-Bourguignon solitons with conformal vector field. Finally, in the particular case when the vertical potential vector field of the Ricci-Bourguignon soliton is of gradient type, we derive a Poisson equation for a statistical submersion.


title: Modelling the emergence of cosmic anisotropy from non-linear structures

abstract: Astronomical observations suggest that the Universe may be anisotropic on the largest scales. In order to model this situation, we develop a new approach to cosmology that allows for large-scale anisotropy to emerge from the growth of non-linear structure. This is achieved by decomposing all relevant fields with respect to a preferred space-like direction, and then averaging the resulting scalar quantities over spatial domains. Our approach allows us to derive a set of large-scale effective field equations that govern the dynamics of any emergent large-scale anisotropy, and which (up to back-reaction terms) take the form of the field equations of the locally rotationally symmetric Bianchi cosmologies. We apply our approach to the dust-filled Farnsworth solutions, which are an interesting set of exact cosmological models that allow for both anisotropic expansion and large-scale bulk flow.


title: Towards indirect assessment of surface anomalies on wind turbine rotor blades

abstract: We present results from novel field, lab and computer studies, that pave the way towards non-invasive classification of localised surface defects on running wind turbine rotors using infrared thermography (IRT). In particular, we first parametrise the problem from a fluid dynamical point of view using the roughness Reynolds number ($Re_k$) and demonstrate how the parameter regime relevant for modern wind turbines translate to parameter values that are currently feasible in typical wind tunnel and computer experiments. Second, we discuss preparatory wind tunnel and field measurements, that demonstrate a promising degree of sensitivity of the recorded IRT data w.r.t. the key control parameter ($Re_k$), which is a minimum requirement for the proposed classification technique to work. Third, we introduce and validate a local domain ansatz for future computer experiments, that enables well-resolved Navier-Stokes simulations for the target parameter regime at reasonable computational costs.


title: Learning by Applying: A General Framework for Mathematical Reasoning via Enhancing Explicit Knowledge Learning

abstract: Mathematical reasoning is one of the crucial abilities of general artificial intelligence, which requires machines to master mathematical logic and knowledge from solving problems. However, existing approaches are not transparent (thus not interpretable) in terms of what knowledge has been learned and applied in the reasoning process. In this paper, we propose a general Learning by Applying (LeAp) framework to enhance existing models (backbones) in a principled way by explicit knowledge learning. In LeAp, we perform knowledge learning in a novel problem-knowledge-expression paradigm, with a Knowledge Encoder to acquire knowledge from problem data and a Knowledge Decoder to apply knowledge for expression reasoning. The learned mathematical knowledge, including word-word relations and word-operator relations, forms an explicit knowledge graph, which bridges the knowledge "learning" and "applying" organically. Moreover, for problem solving, we design a semantics-enhanced module and a reasoning-enhanced module that apply knowledge to improve the problem comprehension and symbol reasoning abilities of any backbone, respectively. We theoretically prove the superiority of LeAp's autonomous learning mechanism. Experiments on three real-world datasets show that LeAp improves all backbones' performances, learns accurate knowledge, and achieves a more interpretable reasoning process.


title: Synergies between Venus & Exoplanetary Observations

abstract: In this chapter we examine how our knowledge of present day Venus can inform terrestrial exoplanetary science and how exoplanetary science can inform our study of Venus. In a superficial way the contrasts in knowledge appear stark. We have been looking at Venus for millennia and studying it via telescopic observations for centuries. Spacecraft observations began with Mariner 2 in 1962 when we confirmed that Venus was a hothouse planet, rather than the tropical paradise science fiction pictured. As long as our level of exploration and understanding of Venus remains far below that of Mars, major questions will endure. On the other hand, exoplanetary science has grown leaps and bounds since the discovery of Pegasus 51b in 1995, not too long after the golden years of Venus spacecraft missions came to an end with the Magellan Mission in 1994. Multi-million to billion dollar/euro exoplanet focused spacecraft missions such as JWST, and its successors will be flown in the coming decades. At the same time, excitement about Venus exploration is blooming again with a number of confirmed and proposed missions in the coming decades from India, Russia, Japan, the European Space Agency and the National Aeronautics and Space Administration. In this chapter, we review what is known and what we may discover tomorrow in complementary studies of Venus and its exoplanetary cousins.


title: A concise review on some Higgs-related new physics models in light of current experiments

abstract: Higgs boson may serve as a portal to new physics beyond the standard model (BSM) which is implied by theoretical naturalness or experimental anomalies. In this note we briefly survey some Higgs-related BSM physics models, including the low energy SUSY (focusing on the minimal SUSY model), the little Higgs models, the two-Higgs-doublet models and the simplest singlet extensions of the Higgs sector. For each illustrated BSM model, we emphatically elucidate its phenomenological power in explaining current measurements of the muon g-2, the W-boson mass and the dark matter. For the singlet extensions like the xSM and 2HDM+S, we discuss the induced cosmic phase transition and the dark matter relic density as well as the vacuum stability. Finally, we give an outlook.


title: Gintropic Scaling of Scientometric Indexes

abstract: The most frequently used indicators for the productivity and impact of scientists are the total number of publication ($N_{pub}$), total number of citations ($N_{cit}$) and the Hirsch (h) index. Since the seminal paper of Hirsch, in 2005, it is largely debated whether the h index can be considered as an indicator independent of $N_{pub}$ and $N_{cit}$. Exploiting the Paretian form for the distribution of citations for the papers authored by a researcher, here we discuss scaling relations between h, $N_{pub}$ and $N_{cit}$. The analysis incorporates the Gini index as an inequality measure of citation distributions and a recently proposed inequality kernel, gintropy (resembling to the entropy kernel). We find a new upper bound for the h value as a function of the total number of citations, confimed on massive data collected from Google Scholar. Our analyses reveals also that the individualized Gini index calculated for the citations received by the publications of an author peaks around 0.8, a value much higher than the one characteristic for the usual socio-economic inequalities.

categories: cs.DL physics.comp-ph physics.pop-ph physics.soc-ph


title: Synthesizing Human Gaze Feedback for Improved NLP Performance

abstract: Integrating human feedback in models can improve the performance of natural language processing (NLP) models. Feedback can be either explicit (e.g. ranking used in training language models) or implicit (e.g. using human cognitive signals in the form of eyetracking). Prior eye tracking and NLP research reveal that cognitive processes, such as human scanpaths, gleaned from human gaze patterns aid in the understanding and performance of NLP models. However, the collection of real eyetracking data for NLP tasks is challenging due to the requirement of expensive and precise equipment coupled with privacy invasion issues. To address this challenge, we propose ScanTextGAN, a novel model for generating human scanpaths over text. We show that ScanTextGAN-generated scanpaths can approximate meaningful cognitive signals in human gaze patterns. We include synthetically generated scanpaths in four popular NLP tasks spanning six different datasets as proof of concept and show that the models augmented with generated scanpaths improve the performance of all downstream NLP tasks.


title: A note on optimal transport and Monge-Amp\`ere geometry

abstract: We identify a novel connection between a recently introduced pseudo-Riemannian framework for optimal mass transport and the geometry of Monge-Amp\`ere equations. We show this correspondence by application to an example from geophysical fluid dynamics.


title: The dual-path hypothesis for the emergence of anosognosia in Alzheimer's disease

abstract: Although neurocognitive models have been proposed to explain anosognosia in Alzheimer's disease (AD), the neural cascade responsible for its origin in the human brain remains unknown. Here, we build on a mechanistic dual-path hypothesis that brings error-monitoring and emotional processing systems as key elements for self-awareness, with distinct impacts on the emergence of anosognosia in AD. Proceeding from the notion of anosognosia as a dimensional syndrome, ranging from the lack of concern about one's own deficits (i.e., anosodiaphoria) to the complete lack of awareness of deficits, our hypothesis states that (i) unawareness of deficits would result from a failure in the error-monitoring system, whereas (ii) anosodiaphoria would more likely result from an imbalance between emotional processing and error-monitoring systems. In the first case, a synaptic failure in the error-monitoring system, in which the cingulate cortex plays a major role, would have a negative impact on error (or deficits) awareness, preventing patients from becoming aware of their condition. In the second case, an impairment in the emotional processing system, in which the amygdala and orbitofrontal cortex play a major role, would prevent patients from monitoring the internal milieu for relevant errors (or deficits) and assigning appropriate value to them, thus biasing their impact on the error-monitoring system. Our hypothesis stems from two scientific premises. One comes from preliminary results in AD patients showing a synaptic failure in the error-monitoring system and decline of awareness at the time of diagnosis. Another comes from the somatic marker hypothesis, which proposes that emotional signals are critical to adaptive behavior. Further exploration will be of great interest to illuminate the foundations of self-awareness and improve our understanding of the underlying mechanisms of anosognosia in AD.


title: Powerful Primitives in the Bounded Quantum Storage Model

abstract: The bounded quantum storage model aims to achieve security against computationally unbounded adversaries that are restricted only with respect to their quantum memories. In this work, we provide information-theoretic secure constructions in this model for the following powerful primitives: (1) CCA1-secure symmetric key encryption, message authentication codes, and one-time programs. These schemes require no quantum memory for the honest user, while they can be made secure against adversaries with arbitrarily large memories by increasing the transmission length sufficiently. (2) CCA1-secure asymmetric key encryption, encryption tokens, signatures, signature tokens, and program broadcast. These schemes are secure against adversaries with roughly $e^{\sqrt{m}}$ quantum memory where $m$ is the quantum memory required for the honest user. All of the constructions additionally satisfy notions of disappearing and unclonable security.


title: Parameterizable Acoustical Modeling and Auralization of Cultural Heritage Sites based on Photogrammetry

abstract: The photogrammetric and reconstructive modeling of cultural heritage sites is mostly focused on visually perceivable aspects, but if their intended purpose is the performance of cultural acts with a sonic emphasis, it is important to consider the preservation of their acoustical behaviour to make them audible in an authentic way. This applies in particular to sacral and concert environments as popular objects for photogrammetric models, which contain geometrical and textural information that can be used to locate and classify acoustically relevant surface properties. With the advancing conversion or destruction of historical acoustical spaces, it becomes even more important to preserve their unique sonic characters, while three-dimensional auralizations become widely applicable. The proposed study presents the current state of a new methodological approach to acoustical modeling using photogrammetric data and introduces a parameterizable pipeline that will be accessible as an open-source software with a graphical user interface.


title: Enhance Local Consistency in Federated Learning: A Multi-Step Inertial Momentum Approach

abstract: Federated learning (FL), as a collaborative distributed training paradigm with several edge computing devices under the coordination of a centralized server, is plagued by inconsistent local stationary points due to the heterogeneity of the local partial participation clients, which precipitates the local client-drifts problems and sparks off the unstable and slow convergence, especially on the aggravated heterogeneous dataset. To address these issues, we propose a novel federated learning algorithm, named FedMIM, which adopts the multi-step inertial momentum on the edge devices and enhances the local consistency for free during the training to improve the robustness of the heterogeneity. Specifically, we incorporate the weighted global gradient estimations as the inertial correction terms to guide both the local iterates and stochastic gradient estimation, which can reckon the global objective optimization on the edges' heterogeneous dataset naturally and maintain the demanding consistent iteration locally. Theoretically, we show that FedMIM achieves the $\mathcal{O}(\frac{1}{\sqrt{SKT}})$ convergence rate with a linear speedup property with respect to the number of selected clients $S$ and proper local interval $K$ in communication round $T$ without convex assumption. Empirically, we conduct comprehensive experiments on various real-world datasets and demonstrate the efficacy of the proposed FedMIM against several state-of-the-art baselines.


title: Flexible-modal Deception Detection with Audio-Visual Adapter

abstract: Detecting deception by human behaviors is vital in many fields such as custom security and multimedia anti-fraud. Recently, audio-visual deception detection attracts more attention due to its better performance than using only a single modality. However, in real-world multi-modal settings, the integrity of data can be an issue (e.g., sometimes only partial modalities are available). The missing modality might lead to a decrease in performance, but the model still learns the features of the missed modality. In this paper, to further improve the performance and overcome the missing modality problem, we propose a novel Transformer-based framework with an Audio-Visual Adapter (AVA) to fuse temporal features across two modalities efficiently. Extensive experiments conducted on two benchmark datasets demonstrate that the proposed method can achieve superior performance compared with other multi-modal fusion methods under flexible-modal (multiple and missing modalities) settings.


title: Sequential Embedding-based Attentive (SEA) classifier for malware classification

abstract: The tremendous growth in smart devices has uplifted several security threats. One of the most prominent threats is malicious software also known as malware. Malware has the capability of corrupting a device and collapsing an entire network. Therefore, its early detection and mitigation are extremely important to avoid catastrophic effects. In this work, we came up with a solution for malware detection using state-of-the-art natural language processing (NLP) techniques. Our main focus is to provide a lightweight yet effective classifier for malware detection which can be used for heterogeneous devices, be it a resource constraint device or a resourceful machine. Our proposed model is tested on the benchmark data set with an accuracy and log loss score of 99.13 percent and 0.04 respectively.


title: A Brief Report on LawGPT 1.0: A Virtual Legal Assistant Based on GPT-3

abstract: LawGPT 1.0 is a virtual legal assistant built on the state-of-the-art language model GPT-3, fine-tuned for the legal domain. The system is designed to provide legal assistance to users in a conversational manner, helping them with tasks such as answering legal questions, generating legal documents, and providing legal advice. In this paper, we provide a brief overview of LawGPT 1.0, its architecture, and its performance on a set of legal benchmark tasks. Please note that the detailed information about the model is protected by a non-disclosure agreement (NDA) and cannot be disclosed in this report.


title: Porting numerical integration codes from CUDA to oneAPI: a case study

abstract: We present our experience in porting optimized CUDA implementations to oneAPI. We focus on the use case of numerical integration, particularly the CUDA implementations of PAGANI and $m$-Cubes. We faced several challenges that caused performance degradation in the oneAPI ports. These include differences in utilized registers per thread, compiler optimizations, and mappings of CUDA library calls to oneAPI equivalents. After addressing those challenges, we tested both the PAGANI and m-Cubes integrators on numerous integrands of various characteristics. To evaluate the quality of the ports, we collected performance metrics of the CUDA and oneAPI implementations on the Nvidia V100 GPU. We found that the oneAPI ports often achieve comparable performance to the CUDA versions, and that they are at most 10% slower.


title: A Globally Convergent Estimator of the Parameters of the Classical Model of a Continuous Stirred Tank Reactor

abstract: In this paper we provide the first solution to the challenging problem of designing a globally exponentially convergent estimator for the parameters of the standard model of a continuous stirred tank reactor. Because of the presence of non-separable exponential nonlinearities in the system dynamics that appear in Arrhenius law, none of the existing parameter estimators is able to deal with them in an efficient way and, in spite of many attempts, the problem was open for many years. To establish our result we propose a novel procedure to obtain a suitable nonlinearly parameterized regression equation and introduce a radically new estimation algorithm - derived applying the Immersion and Invariance methodology - that is applicable to these regression equations. A further contribution of the paper is that parameter convergence is guaranteed with weak excitation requirements.


title: Entanglement in the Quantum Spherical Model -- a Review

abstract: We review some recent results on entanglement in the Quantum Spherical Model (QSM). The focus lays on the physical results rather than the mathematical details. Specifically, we study several entanglement-related quantities, such asentanglement entropies, and logarithmic negativity, in the presence of quantum and classical critical points, and in magnetically ordered phases. We consider both the short as well as the long-range QSM. The study of entanglement properties of the QSM is feasible because the model is mappable to a Gaussian system in any dimension. Despite this fact the QSM is an ideal theoretical laboratory to investigate a wide variety of physical scenarios, such as non mean field criticality, the effect of long-range interactions, the interplay between finite-temperature fluctuations and genuine quantum ones.


title: Exploiting Programmatic Behavior of LLMs: Dual-Use Through Standard Security Attacks

abstract: Recent advances in instruction-following large language models (LLMs) have led to dramatic improvements in a range of NLP tasks. Unfortunately, we find that the same improved capabilities amplify the dual-use risks for malicious purposes of these models. Dual-use is difficult to prevent as instruction-following capabilities now enable standard attacks from computer security. The capabilities of these instruction-following LLMs provide strong economic incentives for dual-use by malicious actors. In particular, we show that instruction-following LLMs can produce targeted malicious content, including hate speech and scams, bypassing in-the-wild defenses implemented by LLM API vendors. Our analysis shows that this content can be generated economically and at cost likely lower than with human effort alone. Together, our findings suggest that LLMs will increasingly attract more sophisticated adversaries and attacks, and addressing these attacks may require new approaches to mitigations.


title: Temporal stability of intracranial EEG abnormality maps for localising epileptogenic tissue

abstract: Objective: Identifying abnormalities in interictal intracranial EEG, by comparing patient data to a normative map, has shown promise for the localisation of epileptogenic tissue and prediction of outcome. The approach typically uses short interictal segments of around one minute. However, the temporal stability of findings has not been established. Methods: Here, we generated a normative map of iEEG in non-pathological brain tissue from 249 patients. We computed regional band power abnormalities in a separate cohort of 39 patients for the duration of their monitoring period (0.92-8.62 days of iEEG data, mean 4.58 days per patient, over 4,800 hours recording). To assess the localising value of band power abnormality, we computed DRS - a measure of how different the surgically resected and spared tissue were in terms of band power abnormalities - over time. Results: In each patient, band power abnormality was relatively consistent over time. The median DRS of the entire recording period separated seizure free (ILAE = 1) and not seizure free (ILAE > 1) patients well (AUC = 0.69). This effect was similar interictally (AUC = 0.69) and peri-ictally (AUC = 0.71). Significance: Our results suggest that band power abnormality DRS, as a predictor of outcomes from epilepsy surgery, is a relatively robust metric over time. These findings add further support for abnormality mapping of neurophysiology data during presurgical evaluation.


title: Divergence-Based Domain Transferability for Zero-Shot Classification

abstract: Transferring learned patterns from pretrained neural language models has been shown to significantly improve effectiveness across a variety of language-based tasks, meanwhile further tuning on intermediate tasks has been demonstrated to provide additional performance benefits, provided the intermediate task is sufficiently related to the target task. However, how to identify related tasks is an open problem, and brute-force searching effective task combinations is prohibitively expensive. Hence, the question arises, are we able to improve the effectiveness and efficiency of tasks with no training examples through selective fine-tuning? In this paper, we explore statistical measures that approximate the divergence between domain representations as a means to estimate whether tuning using one task pair will exhibit performance benefits over tuning another. This estimation can then be used to reduce the number of task pairs that need to be tested by eliminating pairs that are unlikely to provide benefits. Through experimentation over 58 tasks and over 6,600 task pair combinations, we demonstrate that statistical measures can distinguish effective task pairs, and the resulting estimates can reduce end-to-end runtime by up to 40%.


title: Locating the Sources of Sub-synchronous Oscillations Induced by the Control of Voltage Source Converters Based on Energy Structure and Nonlinearity Detection

abstract: The oscillation phenomena associated with the control of voltage source converters (VSCs) are widely concerning, and locating the source of these oscillations is crucial to suppressing them; therefore, this paper presents a locating scheme, based on the energy structure and nonlinearity detection. On the one hand, the energy structure, which conforms with the principle of the energy-based method and dissipativity theory, is constructed to describe the transient energy flow for VSCs, and on this basis, a defined characteristic quantity is implemented to narrow the scope of oscillation source location; on the other hand, according to the self-sustained oscillation characteristics of VSCs, an index for nonlinearity detection is applied to locate the VSCs which produce the oscillation energy. The combination of the energy structure and nonlinearity detection could distinguish the contributions of different VSCs to the oscillation. The results of a case study implemented by the PSCAD/EMTDC simulation validate the proposed scheme.


title: A Reparameterized Discrete Diffusion Model for Text Generation

abstract: This work studies discrete diffusion probabilistic models with applications to natural language generation. We derive an alternative yet equivalent formulation of the sampling from discrete diffusion processes and leverage this insight to develop a family of reparameterized discrete diffusion models. The derived generic framework is highly flexible, offers a fresh perspective of the generation process in discrete diffusion models, and features more effective training and decoding techniques. We conduct extensive experiments to evaluate the text generation capability of our model, demonstrating significant improvements over existing diffusion models.


title: Cross-Modal Fine-Tuning: Align then Refine

abstract: Fine-tuning large-scale pretrained models has led to tremendous progress in well-studied modalities such as vision and NLP. However, similar gains have not been observed in many other modalities due to a lack of relevant pretrained models. In this work, we propose ORCA, a general cross-modal fine-tuning framework that extends the applicability of a single large-scale pretrained model to diverse modalities. ORCA adapts to a target task via an align-then-refine workflow: given the target input, ORCA first learns an embedding network that aligns the embedded feature distribution with the pretraining modality. The pretrained model is then fine-tuned on the embedded data to exploit the knowledge shared across modalities. Through extensive experiments, we show that ORCA obtains state-of-the-art results on 3 benchmarks containing over 60 datasets from 12 modalities, outperforming a wide range of hand-designed, AutoML, general-purpose, and task-specific methods. We highlight the importance of data alignment via a series of ablation studies and demonstrate ORCA's utility in data-limited regimes.


title: Controllable quantum scars induced by spin-orbit couplings in quantum dots

abstract: Spin-orbit couplings (SOCs), originating from the relativistic corrections in the Dirac equation, offer nonlinearity in the classical limit and are capable of driving chaotic dynamics. In a nanoscale quantum dot confined by a two-dimensional parabolic potential with SOCs, various quantum scar states emerge quasi-periodically in the eigenstates of the system, when the ratio of confinement energies in the two directions is nearly commensurable. The scars, displaying both quantum interference and classical trajectory features on the electron density, due to relativistic effects, serve as a bridge between the classical and quantum behaviors of the system. When the strengths of Rashba and Dresselhaus SOCs are identical, the chaos in the classical limit is eliminated as the classical Hamilton's equations become linear, leading to the disappearance of all quantum scar states. Importantly, the quantum scars induced by SOCs are robust against small perturbations of system parameters. With precise control achievable through external gating, the quantum scar induced by Rashba SOC is fully controllable and detectable.