title: X-ray emission from a rapidly accreting narrow-line Seyfert 1 galaxy at z=6.56

abstract: This study aims at identifying luminous quasars at $z>5.7$ among X-ray-selected sources in the eROSITA Final Equatorial-Depth Survey (eFEDS) in order to place a lower limit on black hole accretion well into the epoch of re-ionisation. We confirm the low significance detection with eROSITA of a previously known, optically faint $z=6.56$ quasar from the Subaru High-z Exploration of Low-luminosity Quasars (SHELLQs) survey. We obtained a pointed follow-up observation of the source with the Chandra X-ray telescope in order to confirm the eROSITA detection. Using new near-infrared spectroscopy, we derived the physical properties of the super-massive black hole. Finally, we used this detection to infer a lower limit on the black hole accretion density rate at $z>6$. The Chandra observation confirms the eFEDS source as the most distant blind X-ray detection to date. The derived X-ray luminosity is high with respect to the rest-frame optical emission of the quasar. With a narrow MgII line, low derived black hole mass, and high Eddington ratio, as well as its steep photon index, the source shows properties that are similar to local narrow-line Seyfert 1 galaxies, which are thought to be powered by young super-massive black holes. In combination with a previous high-redshift quasar detection in the field, we show that quasars with $L_{2-10 \, \mathrm{keV}} >10^{45} \, \mathrm{erg \, s^{-1}}$ dominate accretion onto super-massive black holes at $z\sim 6$.


title: On inductive and inverse limits of systems of compact metric spaces and applications

abstract: The aim of this paper is to prove the existence of inductive and inverse limits of direct and inverse systems in a certain category of compact metric spaces as well as of compact metric groups. Some applications are presented.


title: Primes in denominators of algebraic numbers

abstract: Denote the set of algebraic numbers as $\overline{\mathbb{Q}}$ and the set of algebraic integers as $\overline{\mathbb{Z}}$. For $\gamma\in\overline{\mathbb{Q}}$, consider its irreducible polynomial in $\mathbb{Z}[x]$, $F_{\gamma}(x)=a_nx^n+\dots+a_0$. Denote $e(\gamma)=\gcd(a_{n},a_{n-1},\dots,a_1)$. Drungilas, Dubickas and Jankauskas show in a recent paper that $\mathbb{Z}[\gamma]\cap \mathbb{Q}=\{\alpha\in\mathbb{Q}\mid \{p\mid v_p(\alpha)<0\}\subseteq \{p\mid p|e(\gamma)\}\}$. Given a number field $K$ and $\gamma\in\overline{\mathbb{Q}}$, we show that there is a subset $X(K,\gamma)\subseteq \text{Spec}(\mathcal{O}_K)$, for which $\mathcal{O}_K[\gamma]\cap K=\{\alpha\in K\mid \{\mathfrak{p}\mid v_{\mathfrak{p}}(\alpha)<0\}\subseteq X(K,\gamma)\}$. We prove that $\mathcal{O}_K[\gamma]\cap K$ is a principal ideal domain if and only if the primes in $X(K,\gamma)$ generate the class group of $\mathcal{O}_K$. We show that given $\gamma\in \overline{\mathbb{Q}}$, we can find a finite set $S\subseteq \overline{\mathbb{Z}}$, such that for every number field $K$, we have $X(K,\gamma)=\{\mathfrak{p}\in\text{Spec}(\mathcal{O}_K)\mid \mathfrak{p}\cap S\neq \emptyset\}$. We study how this set $S$ relates to the ring $\overline{\mathbb{Z}}[\gamma]$ and the ideal $\mathfrak{D}_{\gamma}=\{a\in\overline{\mathbb{Z}}\mid a\gamma\in\overline{\mathbb{Z}}\}$ of $\overline{\mathbb{Z}}$. We also show that $\gamma_1,\gamma_2\in \overline{\mathbb{Q}}$ satisfy $\mathfrak{D}_{\gamma_1}=\mathfrak{D}_{\gamma_2}$ if and only if $X(K,\gamma_1)=X(K,\gamma_2)$ for all number fields $K$.


title: Neural Weight Search for Scalable Task Incremental Learning

abstract: Task incremental learning aims to enable a system to maintain its performance on previously learned tasks while learning new tasks, solving the problem of catastrophic forgetting. One promising approach is to build an individual network or sub-network for future tasks. However, this leads to an ever-growing memory due to saving extra weights for new tasks and how to address this issue has remained an open problem in task incremental learning. In this paper, we introduce a novel Neural Weight Search technique that designs a fixed search space where the optimal combinations of frozen weights can be searched to build new models for novel tasks in an end-to-end manner, resulting in scalable and controllable memory growth. Extensive experiments on two benchmarks, i.e., Split-CIFAR-100 and CUB-to-Sketches, show our method achieves state-of-the-art performance with respect to both average inference accuracy and total memory cost.


title: The stratified Grassmannian

abstract: We study a quasicategory variant of the stratified Grassmannian of Ayala, Francis and Rozenblyum, which bypasses the theory of conically-smooth stratified spaces. We prove that its maximal sub-$\infty$-groupoid is equivalent, non-canonically, to $\ast\amalg\mathbb{Z}_+\times\coprod_{k\geq1} B\mathrm{O}(k)$.


title: MeV Dark Matter with MeV Dark Photons in Abelian Kinetic Mixing Theories

abstract: We consider the cosmology and phenomenology of a dark photon portal to a simple dark sector consisting of a single, light, fermionic dark matter particle species with mass in the MeV range. We entertain three possible kinetic mixing structures of a new Abelian gauge group U(1)$_{\text{dark}}$ with the visible sector through U(1)$_{\text{e.m.}}$, U(1)$_{\text{Y}}$ and T[SU(2)$_{\text{L}}$]. We assume the dark photon to be massive and around the MeV scale, thus close to the mass scale of the dark matter candidate. We compute the dark matter relic density via freeze-out and freeze-in, entertaining the additional possibilities of (i) a late inflationary period that could dilute the dark matter yield of heavy candidates, and (ii) additional production modes, for models with under-abundant thermal production. We explore the parameter space compatible with a variety of experimental and astrophysical bounds, and discuss prospects for discovery with new CMB probes and MeV gamma-ray telescopes.


title: Row-Hamiltonian Latin squares and Falconer varieties

abstract: A \emph{Latin square} is a matrix of symbols such that each symbol occurs exactly once in each row and column. A Latin square $L$ is \emph{row-Hamiltonian} if the permutation induced by each pair of distinct rows of $L$ is a full cycle permutation. Row-Hamiltonian Latin squares are equivalent to perfect $1$-factorisations of complete bipartite graphs. For the first time, we exhibit a family of Latin squares that are row-Hamiltonian and also achieve precisely one of the related properties of being column-Hamiltonian or symbol-Hamiltonian. This family allows us to construct non-trivial, anti-associative, isotopically $L$-closed loop varieties, solving an open problem posed by Falconer in 1970.


title: Lessons Learned to Improve the UX Practices in Agile Projects Involving Data Science and Process Automation

abstract: Context: User-Centered Design and Agile methodologies focus on human issues. Nevertheless, agile methodologies focus on contact with contracting customers and generating value for them. Usually, the communication between end users and the agile team is mediated by customers. However, they do not know the problems end users face in their routines. Hence, UX issues are typically identified only after the implementation, during user testing and validation. Objective: Aiming to improve the understanding and definition of the problem in agile projects, this research investigates the practices and difficulties experienced by agile teams during the development of data science and process automation projects. Also, we analyze the benefits and the teams' perceptions regarding user participation in these projects. Method: We collected data from four agile teams in an academia-industry collaboration focusing on delivering data science and process automation solutions. Therefore, we applied a carefully designed questionnaire answered by developers, scrum masters, and UX designers. In total, 18 subjects answered the questionnaire. Results: From the results, we identify practices used by the teams to define and understand the problem and to represent the solution. The practices most often used are prototypes and meetings with stakeholders. Another practice that helped the team to understand the problem was using Lean Inceptions. Also, our results present some specific issues regarding data science projects. Conclusion: We observed that end-user participation can be critical to understanding and defining the problem. They help to define elements of the domain and barriers in the implementation. We identified a need for approaches that facilitate user-team communication in data science projects and the need for more detailed requirements representations to support data science solutions.


title: Joint segmentation and discontinuity-preserving deformable registration: Application to cardiac cine-MR images

abstract: Medical image registration is a challenging task involving the estimation of spatial transformations to establish anatomical correspondence between pairs or groups of images. Recently, deep learning-based image registration methods have been widely explored, and demonstrated to enable fast and accurate image registration in a variety of applications. However, most deep learning-based registration methods assume that the deformation fields are smooth and continuous everywhere in the image domain, which is not always true, especially when registering images whose fields of view contain discontinuities at tissue/organ boundaries. In such scenarios, enforcing smooth, globally continuous deformation fields leads to incorrect/implausible registration results. We propose a novel discontinuity-preserving image registration method to tackle this challenge, which ensures globally discontinuous and locally smooth deformation fields, leading to more accurate and realistic registration results. The proposed method leverages the complementary nature of image segmentation and registration and enables joint segmentation and pair-wise registration of images. A co-attention block is proposed in the segmentation component of the network to learn the structural correlations in the input images, while a discontinuity-preserving registration strategy is employed in the registration component of the network to ensure plausibility in the estimated deformation fields at tissue/organ interfaces. We evaluate our method on the task of intra-subject spatio-temporal image registration using large-scale cinematic cardiac magnetic resonance image sequences, and demonstrate that our method achieves significant improvements over the state-of-the-art for medical image registration, and produces high-quality segmentation masks for the regions of interest.


title: Learning-enhanced Nonlinear Model Predictive Control using Knowledge-based Neural Ordinary Differential Equations and Deep Ensembles

abstract: Nonlinear model predictive control (MPC) is a flexible and increasingly popular framework used to synthesize feedback control strategies that can satisfy both state and control input constraints. In this framework, an optimization problem, subjected to a set of dynamics constraints characterized by a nonlinear dynamics model, is solved at each time step. Despite its versatility, the performance of nonlinear MPC often depends on the accuracy of the dynamics model. In this work, we leverage deep learning tools, namely knowledge-based neural ordinary differential equations (KNODE) and deep ensembles, to improve the prediction accuracy of this model. In particular, we learn an ensemble of KNODE models, which we refer to as the KNODE ensemble, to obtain an accurate prediction of the true system dynamics. This learned model is then integrated into a novel learning-enhanced nonlinear MPC framework. We provide sufficient conditions that guarantees asymptotic stability of the closed-loop system and show that these conditions can be implemented in practice. We show that the KNODE ensemble provides more accurate predictions and illustrate the efficacy and closed-loop performance of the proposed nonlinear MPC framework using two case studies.


title: Spectral estimation for mixed causal-noncausal autoregressive models

abstract: This paper investigates new ways of estimating and identifying causal, noncausal, and mixed causal-noncausal autoregressive models driven by a non-Gaussian error sequence. We do not assume any parametric distribution function for the innovations. Instead, we use the information of higher-order cumulants, combining the spectrum and the bispectrum in a minimum distance estimation. We show how to circumvent the nonlinearity of the parameters and the multimodality in the noncausal and mixed models by selecting the appropriate initial values in the estimation. In addition, we propose a method of identification using a simple comparison criterion based on the global minimum of the estimation function. By means of a Monte Carlo study, we find unbiased estimated parameters and a correct identification as the data depart from normality. We propose an empirical application on eight monthly commodity prices, finding noncausal and mixed causal-noncausal dynamics.


title: Markov chains arising from biased random derangements

abstract: We explore the cycle types of a class of biased random derangements, described as a random game played by some children labeled $1,\cdots,n$. Children join the game one by one, in a random order, and randomly form some circles of size at least $2$, so that no child is left alone. The game gives rise to the cyclic decomposition of a random derangement, inducing an exchangeable random partition. The rate at which the circles are closed varies in time, and at each time $t$, depends on the number of individuals who have not played until t. A $\{0,1\}$-valued Markov chain $ X^n$ records the cycle type of the corresponding random derangement in that any $1$ represents a hand-grasping event that closes a circle. Using this, we study the cycle counts and sizes of the random derangements and their asymptotic behavior. We approximate the total variation distance between the reversed chain of $X^n$ and its weak limit $X^\infty$, as $n\to\infty$. We establish conditional (and push-forward) relations between $X^n$ and a generalization of the Feller coupling, given that no $11$-pattern ($1$-cycle) appears in the latter. We extend these relations to $X^\infty$ and apply them to investigate some asymptotic behaviors of $X^n$.


title: Particle current statistics in driven mesoscale conductors

abstract: We propose a highly-scalable method to compute the statistics of charge transfer in driven conductors. The framework can be applied in situations of non-zero temperature, strong coupling to terminals and in the presence of non-periodic light-matter interactions, away from equilibrium. The approach combines the so-called mesoscopic leads formalism with full counting statistics. It results in a generalised quantum master equation that dictates the dynamics of current fluctuations and higher order moments of the probability distribution function of charge exchange. For generic time-dependent quadratic Hamiltonians, we provide closed-form expressions for computing noise in the non-perturbative regime of the parameters of the system, reservoir or system-reservoir interactions. Having access to the full dynamics of the current and its noise, the method allows us to compute the variance of charge transfer over time in non-equilibrium configurations. The dynamics reveal that in driven systems, the average noise should be defined operationally with care over which period of time is covered.


title: Numerical study of SQUID array responses due to asymmetric junction parameters

abstract: Superconducting quantum interference device arrays have been extensively studied for their high magnetic field sensitivity. The performance of these devices strongly depends on the characteristic parameters of their Josephson junctions, i.e. their critical currents and shunt resistances. Using a resistively shunted junction model and including thermal noise, we perform a numerical investigation of the effects of asymmetric Josephson junctions by independently studying variations in the critical currents and junction resistances. We compare the voltage response of a dc-SQUID with a 1D parallel SQUID array and study the maximum transfer function dependence on the number of junctions in parallel, the screening parameter and thermal noise strength. Our results show that the maximum transfer function and linearity increase with the number of junctions in parallel for arrays with different junction resistances, in contrast to SQUID arrays with identical junctions or with spreads in the critical currents.


title: Gravitational susceptibility of QGP

abstract: We use ${\cal N}=2^*$ and cascading gauge theory holographic models to extract the general features of the gravitational susceptibility $\kappa$ of strongly coupled nonconformal quark-gluon plasma. We show that in theories with a relevant coupling constant the gravitational susceptibility is renormalization scheme dependent. We propose to use its temperature derivative, i.e., $\frac{d\kappa}{d\ln T}$, as a scheme-independent characteristic of a QGP. Although $\kappa$ is a thermodynamic quantity, its critical behavior can be drastically distinct in the vicinity of seemingly identical thermal phase transitions.


title: Detection of a bright burst from the repeating FRB 20201124A at 2 GHz

abstract: We present a detection of a bright burst from FRB 20201124A, which is one of the most active repeating FRBs, based on S-band observations with the 64-m radio telescope at the Usuda Deep Space Center/JAXA. This is the first FRB observed by using a Japanese facility. Our detection at 2 GHz in February 2022 is the highest frequency for this FRB and the fluence of $>$ 189 Jy ms is one of the brightest bursts from this FRB source. We place an upper limit on the spectral index $\alpha$ = -2.14 from the detection of the S band and non-detection of the X band at the same time. We compare an event rate of the detected burst with ones of the previous research, and suggest that the power-law of the luminosity function might be broken at lower fluence, and the fluences of bright FRBs distribute up to over 2 GHz with the power-law against frequency. In addition, we show the energy density of the burst detected in this work was comparable to the bright population of one-off FRBs. We propose that repeating FRBs can be as bright as one-off FRBs, and only their brightest bursts could be detected so some of repeating FRBs intrinsically might have been classified as one-off FRBs.


title: Classification of the vacua of the dimensionally reduced low-energy limit of the heterotic string over nearly-K\"ahler manifolds

abstract: We examine the vacua of the scalar potential of the effective 4-d action, obtained after the dimensional reduction of the 10-d $\mathcal{N}=1$ heterotic supergravity coupled to an $\mathcal{N}=1$ Yang-Mills sector. The (Coset Space) dimensional reduction takes place over the three 6-d nearly-K\"ahler manifolds, namely the homogeneous 6-d non-symmetric coset spaces, $G_2/SU(3)$, $Sp_4/SU(2)\times U(1)$ and $SU(3)/U(1)\times U(1)$. The current work consists a complete catalogue of the kinds of vacua of theories obtained after the reduction of the heterotic string over the 6-d non-symmetric coset spaces and, moreover, a contribution to the dialogue of the possibility to result with non-AdS vacua in the framework of string theories.


title: End-to-End Stochastic Optimization with Energy-Based Model

abstract: Decision-focused learning (DFL) was recently proposed for stochastic optimization problems that involve unknown parameters. By integrating predictive modeling with an implicitly differentiable optimization layer, DFL has shown superior performance to the standard two-stage predict-then-optimize pipeline. However, most existing DFL methods are only applicable to convex problems or a subset of nonconvex problems that can be easily relaxed to convex ones. Further, they can be inefficient in training due to the requirement of solving and differentiating through the optimization problem in every training iteration. We propose SO-EBM, a general and efficient DFL method for stochastic optimization using energy-based models. Instead of relying on KKT conditions to induce an implicit optimization layer, SO-EBM explicitly parameterizes the original optimization problem using a differentiable optimization layer based on energy functions. To better approximate the optimization landscape, we propose a coupled training objective that uses a maximum likelihood loss to capture the optimum location and a distribution-based regularizer to capture the overall energy landscape. Finally, we propose an efficient training procedure for SO-EBM with a self-normalized importance sampler based on a Gaussian mixture proposal. We evaluate SO-EBM in three applications: power scheduling, COVID-19 resource allocation, and non-convex adversarial security game, demonstrating the effectiveness and efficiency of SO-EBM.


title: Signed Binary Weight Networks

abstract: Efficient inference of Deep Neural Networks (DNNs) is essential to making AI ubiquitous. Two important algorithmic techniques have shown promise for enabling efficient inference - sparsity and binarization. These techniques translate into weight sparsity and weight repetition at the hardware-software level enabling the deployment of DNNs with critically low power and latency requirements. We propose a new method called signed-binary networks to improve efficiency further (by exploiting both weight sparsity and weight repetition together) while maintaining similar accuracy. Our method achieves comparable accuracy on ImageNet and CIFAR10 datasets with binary and can lead to 69% sparsity. We observe real speedup when deploying these models on general-purpose devices and show that this high percentage of unstructured sparsity can lead to a further reduction in energy consumption on ASICs.


title: Bivariate log-symmetric models: distributional properties, parameter estimation and an application to fatigue data analysis

abstract: The bivariate Gaussian distribution has been a key model for many developments in statistics. However, many real-world phenomena generate data that follow asymmetric distributions, and consequently bivariate normal model is inappropriate in such situations. Bidimensional log-symmetric models have attractive properties and can be considered as good alternatives in these cases. In this paper, we discuss bivariate log-symmetric distributions and their characterizations. We establish several distributional properties and obtain the maximum likelihood estimators of the model parameters. A Monte Carlo simulation study is performed for examining the performance of the developed parameter estimation method. A real data set is finally analyzed to illustrate the proposed model and the associated inferential method.


title: A sharp sparse domination of pseudodifferential operators

abstract: In this paper, we give a sharp sparse domination of pseudodifferential operators associated with symbols belonging to the H\"{o}rmander class, and fundamental solutions of dispersive equations. Furthermore, we give boundedness results of these operators on weighted Besov spaces by using the sparse domination.


title: Near-Infrared Spectroscopy of Ultracompact \ion{H}{2} regions in W51A with NIFS/ALTAIR

abstract: W51A is the most active star formation region of the Giant \ion{H}{2} region W51. It harbors the two massive proto-clusters W51e and W51\,IRS2, which are very rare in the Galaxy. We aim to identify the new born massive stars and UCHII regions to derive its distance and age. We performed IFU observations with NIFS+ALTAIR of nine targets in the W51A sub-region. The distance modulus was obtained using the spectral classification in the $K$-band and a reddening law appropriate to the inner Galactic plane. We derived the distance and the spectral types for five of them, ranging from O8 to O9.5, similar to those derived from radio continuum data, except for two sources that we assigned somewhat a later spectral type. We included another seven objects with precise spectral classification from other works, which allowed us to better constrain the distance estimate. Our spectrophotometric distance d=4.80\,$\pm$\,1.27\,kpc is in good agreement with those derived from the Galactic rotation model and trigonometric parallaxes, placing the region near the tangent point of the Sagittarius arm. We conclude that the stars studied in this work have an age spread of 1.5-4 Myr, substantially older than thought to date.


title: Tailoring Capture-Recapture Methods to Estimate Registry-Based Case Counts Based on Error-Prone Diagnostic Signals

abstract: Surveillance research is of great importance for effective and efficient epidemiological monitoring of case counts and disease prevalence. Taking specific motivation from ongoing efforts to identify recurrent cases based on the Georgia Cancer Registry, we extend recently proposed "anchor stream" sampling design and estimation methodology. Our approach offers a more efficient and defensible alternative to traditional capture-recapture (CRC) methods by leveraging a relatively small random sample of participants whose recurrence status is obtained through a principled application of medical records abstraction. This sample is combined with one or more existing signaling data streams, which may yield data based on arbitrarily non-representative subsets of the full registry population. The key extension developed here accounts for the common problem of false positive or negative diagnostic signals from the existing data stream(s). In particular, we show that the design only requires documentation of positive signals in these non-anchor surveillance streams, and permits valid estimation of the true case count based on an estimable positive predictive value (PPV) parameter. We borrow ideas from the multiple imputation paradigm to provide accompanying standard errors, and develop an adapted Bayesian credible interval approach that yields favorable frequentist coverage properties. We demonstrate the benefits of the proposed methods through simulation studies, and provide a data example targeting estimation of the breast cancer recurrence case count among Metro Atlanta area patients from the Georgia Cancer Registry-based Cancer Recurrence Information and Surveillance Program (CRISP) database.


title: Automated design of pneumatic soft grippers through design-dependent multi-material topology optimization

abstract: Soft robotic grasping has rapidly spread through the academic robotics community in recent years and pushed into industrial applications. At the same time, multimaterial 3D printing has become widely available, enabling the monolithic manufacture of devices containing rigid and elastic sections. We propose a novel design technique that leverages both technologies and can automatically design bespoke soft robotic grippers for fruit-picking and similar applications. We demonstrate the novel topology optimisation formulation that generates multi-material soft grippers, can solve internal and external pressure boundaries, and investigate methods to produce air-tight designs. Compared to existing methods, it vastly expands the searchable design space while increasing simulation accuracy.


title: Ladder Siamese Network: a Method and Insights for Multi-level Self-Supervised Learning

abstract: Siamese-network-based self-supervised learning (SSL) suffers from slow convergence and instability in training. To alleviate this, we propose a framework to exploit intermediate self-supervisions in each stage of deep nets, called the Ladder Siamese Network. Our self-supervised losses encourage the intermediate layers to be consistent with different data augmentations to single samples, which facilitates training progress and enhances the discriminative ability of the intermediate layers themselves. While some existing work has already utilized multi-level self supervisions in SSL, ours is different in that 1) we reveal its usefulness with non-contrastive Siamese frameworks in both theoretical and empirical viewpoints, and 2) ours improves image-level classification, instance-level detection, and pixel-level segmentation simultaneously. Experiments show that the proposed framework can improve BYOL baselines by 1.0% points in ImageNet linear classification, 1.2% points in COCO detection, and 3.1% points in PASCAL VOC segmentation. In comparison with the state-of-the-art methods, our Ladder-based model achieves competitive and balanced performances in all tested benchmarks without causing large degradation in one.


title: Derived quot schemes

abstract: We define a derived enhancement of the classical quot functor of quotients associated to a coherent sheaf on a nonsingular quasiprojective variety. We prove its representability and show that it has the expected tangent complex. The derived quot scheme of points can be covered by affine charts obtained as spectra of commutative graded differential algebras (cdgas) and we compute an example. As a demonstration of the usefulness of this presentation, we write down an explicit shifted form on this example and conjecture that it agrees with the shifted symplectic structure on the derived stack of perfect complexes constructed by Pantev-To\"en-Vaqui\'e-Vezzosi (arXiv:1111.3209) and Brav-Dyckerhoff (arXiv:1812.11913).


title: Asynchronous Event-Triggered Control for Non-Linear Systems

abstract: With the increasing ubiquity of networked control systems, various strategies for sampling constituent subsystems' outputs have emerged. In contrast with periodic sampling, event-triggered control provides a way to efficiently sample a subsystem and conserve network resource usage, by triggering an update only when a state-dependent error threshold is satisfied. Herein we describe a novel scheme for asynchronous event-triggered measurement and control (ETC) of a nonlinear plant using sampler subsystems with hybrid dynamics. We extend existing ETC literature by adopting a more general representation of the sampler subsystem dynamics that do not require trigger periodicity or simultaneity, thus accommodating different sampling schemes for both synchronous and asynchronous ETC applications. We ensure that the plant and controller trigger rules are not susceptible to Zeno behavior by employing auxiliary timer variables in conjunction with state-dependent error thresholds. We conclude with a numerical example in order to illustrate important practical considerations when applying such schemes.


title: Zero-Sum Stochastic Stackelberg Games

abstract: Zero-sum stochastic games have found important applications in a variety of fields, from machine learning to economics. Work on this model has primarily focused on the computation of Nash equilibrium due to its effectiveness in solving adversarial board and video games. Unfortunately, a Nash equilibrium is not guaranteed to exist in zero-sum stochastic games when the payoffs at each state are not convex-concave in the players' actions. A Stackelberg equilibrium, however, is guaranteed to exist. Consequently, in this paper, we study zero-sum stochastic Stackelberg games. Going beyond known existence results for (non-stationary) Stackelberg equilibria, we prove the existence of recursive (i.e., Markov perfect) Stackelberg equilibria (recSE) in these games, provide necessary and sufficient conditions for a policy profile to be a recSE, and show that recSE can be computed in (weakly) polynomial time via value iteration. Finally, we show that zero-sum stochastic Stackelberg games can model the problem of pricing and allocating goods across agents and time. More specifically, we propose a zero-sum stochastic Stackelberg game whose recSE correspond to the recursive competitive equilibria of a large class of stochastic Fisher markets. We close with a series of experiments that showcase how our methodology can be used to solve the consumption-savings problem in stochastic Fisher markets.


title: GLM for partially pooled categorical predictors with a case study in biosecurity

abstract: National governments use border information to efficiently manage the biosecurity risk presented by travel and commerce. In the Australian border biosecurity system, data about cargo consignments are collected from records of directions: that is, the records of actions taken by the biosecurity regulator. This data collection is complicated by the way directions for a given entry are recorded. An entry is a collection of import lines where each line is a single type of item or commodity. Analysis is simple when the data are recorded in line mode: the directions are recorded individually for each line. The challenge comes when data are recorded in container mode, because the same direction is recorded against each line in the entry. In other words, if at least one line in an entry has a non-compliant inspection result, then all lines in that entry are recorded as non-compliant. Therefore, container mode data creates a challenge for estimating the probability that certain items are non-compliant, because matching the records of non-compliance to the line information is impossible. We develop a statistical model to use container mode data to help inform biosecurity risk of items. We use asymptotic analysis to estimate the value of container mode data compared to line mode data, do a simulation study to verify that we can accurately estimate parameters in a large dataset, and we apply our methods to a real dataset, for which important information about the risk of non-compliance is recovered using the new model.


title: Optimizing the transport of Majorana zero modes in one-dimensional topological superconductors

abstract: Topological quantum computing is based on the notion of braiding non-Abelian anyons, such as Majorana zero modes (MZMs), to perform gate operations. A crucial building block of these protocols is the adiabatic shuttling of MZMs through topological superconductors. Here, we consider the "piano key" approach, where MZMs are transported using local electric gates to tune sections ("keys") of a wire between topologically trivial and nontrivial phases. We numerically simulate this transport on a single wire and calculate the diabatic error corresponding to exciting the system. We find that this error is typically reduced when transport is facilitated by using multiple keys as one may expect from modeling each piano key press as an effective Landau-Zener process. However, further increasing the number of keys increases errors; thus, there exists a nontrivial optimal number of keys that minimizes the diabatic error given a fixed total shuttle time. As we show, this optimal number of keys can be explained by modeling each key press as an effective Landau-Zener process while paying careful attention to power-law corrections that arise due to the nonanalytic behavior of the time-dependent modulation of the chemical potential at the beginning and end of each key press.


title: Cohomology and $K$-theory rings of the space of commuting elements in $SU(2)$

abstract: In this paper, we compute explicitly both the $K$-theory and integral cohomology rings of the space of commuting elements in $SU(2)$ via the $K$-theory of its desingularization. We also briefly discuss the different behavior of its cohomology with complex and $\mathbb{Z}_2$ coefficients in the context of representation stability and FI-modules.


title: Mixed Leadership Stochastic Differential Game in Feedback Information Pattern with Applications

abstract: This paper is devoted to a high-dimensional mixed leadership stochastic differential game on a finite horizon in feedback information mode, where the control variables enter into the diffusion term of state equation. A verification theorem for the feedback Stackelberg-Nash equilibrium is obtained by using a system of coupled and fully nonlinear parabolic partial differential equations. We apply the verification theorem to deal with a dynamic innovation and pricing decision problem where the buyer acts as the leader in the pricing decisions and the dynamic model is stochastic. Via the solutions of coupled Riccati equations, we explicitly express the feedback equilibrium strategies of innovation and pricing. And by analysis, the local existence and uniqueness of the solutions of the coupled Riccati equations is derived. We also conduct some numerical analyses to discuss the effects of model parameters on the feedback equilibrium strategies.


title: Adaptive Attention Link-based Regularization for Vision Transformers

abstract: Although transformer networks are recently employed in various vision tasks with outperforming performance, extensive training data and a lengthy training time are required to train a model to disregard an inductive bias. Using trainable links between the channel-wise spatial attention of a pre-trained Convolutional Neural Network (CNN) and the attention head of Vision Transformers (ViT), we present a regularization technique to improve the training efficiency of ViT. The trainable links are referred to as the attention augmentation module, which is trained simultaneously with ViT, boosting the training of ViT and allowing it to avoid the overfitting issue caused by a lack of data. From the trained attention augmentation module, we can extract the relevant relationship between each CNN activation map and each ViT attention head, and based on this, we also propose an advanced attention augmentation module. Consequently, even with a small amount of data, the suggested method considerably improves the performance of ViT while achieving faster convergence during training.


title: Extreme Acceleration of Graph Neural Network-based Prediction Models for Quantum Chemistry

abstract: Molecular property calculations are the bedrock of chemical physics. High-fidelity \textit{ab initio} modeling techniques for computing the molecular properties can be prohibitively expensive, and motivate the development of machine-learning models that make the same predictions more efficiently. Training graph neural networks over large molecular databases introduces unique computational challenges such as the need to process millions of small graphs with variable size and support communication patterns that are distinct from learning over large graphs such as social networks. This paper demonstrates a novel hardware-software co-design approach to scale up the training of graph neural networks for molecular property prediction. We introduce an algorithm to coalesce the batches of molecular graphs into fixed size packs to eliminate redundant computation and memory associated with alternative padding techniques and improve throughput via minimizing communication. We demonstrate the effectiveness of our co-design approach by providing an implementation of a well-established molecular property prediction model on the Graphcore Intelligence Processing Units (IPU). We evaluate the training performance on multiple molecular graph databases with varying degrees of graph counts, sizes and sparsity. We demonstrate that such a co-design approach can reduce the training time of such molecular property prediction models from days to less than two hours, opening new possibilities for AI-driven scientific discovery.


title: ComCLIP: Training-Free Compositional Image and Text Matching

abstract: Contrastive Language-Image Pretraining (CLIP) has demonstrated great zero-shot performance for matching images and text. However, it is still challenging to adapt vision-lanaguage pretrained models like CLIP to compositional image and text matching -- a more challenging image and text matching task requiring the model understanding of compositional word concepts and visual components. Towards better compositional generalization in zero-shot image and text matching, in this paper, we study the problem from a causal perspective: the erroneous semantics of individual entities are essentially confounders that cause the matching failure. Therefore, we propose a novel \textbf{\textit{training-free}} compositional CLIP model (ComCLIP). ComCLIP disentangles input images into subjects, objects, and action sub-images and composes CLIP's vision encoder and text encoder to perform evolving matching over compositional text embedding and sub-image embeddings. In this way, ComCLIP can mitigate spurious correlations introduced by the pretrained CLIP models and dynamically evaluate the importance of each component. Experiments on four compositional image-text matching datasets: SVO, ComVG, Winoground, and VL-checklist, and two general image-text retrieval datasets: Flick30K, and MSCOCO demonstrate the effectiveness of our plug-and-play method, which boosts the \textbf{\textit{zero-shot}} inference ability of CLIP, SLIP, and BLIP2 even without further training or fine-tuning. Our codes can be found at https://github.com/eric-ai-lab/ComCLIP.


title: Condensed Sets on Compact Hausdorff Spaces

abstract: A condensed set is a sheaf on the site of Stone spaces and continuous maps. We prove that condensed sets are equivalent to sheaves on the site of compact Hausdorff spaces and continuous maps. As an application, we show that there exists a model structure on the category of condensed sets.


title: WSSL: Weighted Self-supervised Learning Framework For Image-inpainting

abstract: Image inpainting is the process of regenerating lost parts of the image. Supervised algorithm-based methods have shown excellent results but have two significant drawbacks. They do not perform well when tested with unseen data. They fail to capture the global context of the image, resulting in a visually unappealing result. We propose a novel self-supervised learning framework for image-inpainting: Weighted Self-Supervised Learning (WSSL) to tackle these problems. We designed WSSL to learn features from multiple weighted pretext tasks. These features are then utilized for the downstream task, image-inpainting. To improve the performance of our framework and produce more visually appealing images, we also present a novel loss function for image inpainting. The loss function takes advantage of both reconstruction loss and perceptual loss functions to regenerate the image. Our experimentation shows WSSL outperforms previous methods, and our loss function helps produce better results.


title: Generative Modeling in Structural-Hankel Domain for Color Image Inpainting

abstract: In recent years, some researchers focused on using a single image to obtain a large number of samples through multi-scale features. This study intends to a brand-new idea that requires only ten or even fewer samples to construct the low-rank structural-Hankel matrices-assisted score-based generative model (SHGM) for color image inpainting task. During the prior learning process, a certain amount of internal-middle patches are firstly extracted from several images and then the structural-Hankel matrices are constructed from these patches. To better apply the score-based generative model to learn the internal statistical distribution within patches, the large-scale Hankel matrices are finally folded into the higher dimensional tensors for prior learning. During the iterative inpainting process, SHGM views the inpainting problem as a conditional generation procedure in low-rank environment. As a result, the intermediate restored image is acquired by alternatively performing the stochastic differential equation solver, alternating direction method of multipliers, and data consistency steps. Experimental results demonstrated the remarkable performance and diversity of SHGM.


title: Far3Det: Towards Far-Field 3D Detection

abstract: We focus on the task of far-field 3D detection (Far3Det) of objects beyond a certain distance from an observer, e.g., $>$50m. Far3Det is particularly important for autonomous vehicles (AVs) operating at highway speeds, which require detections of far-field obstacles to ensure sufficient braking distances. However, contemporary AV benchmarks such as nuScenes underemphasize this problem because they evaluate performance only up to a certain distance (50m). One reason is that obtaining far-field 3D annotations is difficult, particularly for lidar sensors that produce very few point returns for far-away objects. Indeed, we find that almost 50% of far-field objects (beyond 50m) contain zero lidar points. Secondly, current metrics for 3D detection employ a "one-size-fits-all" philosophy, using the same tolerance thresholds for near and far objects, inconsistent with tolerances for both human vision and stereo disparities. Both factors lead to an incomplete analysis of the Far3Det task. For example, while conventional wisdom tells us that high-resolution RGB sensors should be vital for 3D detection of far-away objects, lidar-based methods still rank higher compared to RGB counterparts on the current benchmark leaderboards. As a first step towards a Far3Det benchmark, we develop a method to find well-annotated scenes from the nuScenes dataset and derive a well-annotated far-field validation set. We also propose a Far3Det evaluation protocol and explore various 3D detection methods for Far3Det. Our result convincingly justifies the long-held conventional wisdom that high-resolution RGB improves 3D detection in the far-field. We further propose a simple yet effective method that fuses detections from RGB and lidar detectors based on non-maximum suppression, which remarkably outperforms state-of-the-art 3D detectors in the far-field.


title: DATE: Dual Assignment for End-to-End Fully Convolutional Object Detection

abstract: Fully convolutional detectors discard the one-to-many assignment and adopt a one-to-one assigning strategy to achieve end-to-end detection but suffer from the slow convergence issue. In this paper, we revisit these two assignment methods and find that bringing one-to-many assignment back to end-to-end fully convolutional detectors helps with model convergence. Based on this observation, we propose {\em \textbf{D}ual \textbf{A}ssignment} for end-to-end fully convolutional de\textbf{TE}ction (DATE). Our method constructs two branches with one-to-many and one-to-one assignment during training and speeds up the convergence of the one-to-one assignment branch by providing more supervision signals. DATE only uses the branch with the one-to-one matching strategy for model inference, which doesn't bring inference overhead. Experimental results show that Dual Assignment gives nontrivial improvements and speeds up model convergence upon OneNet and DeFCN. Code: https://github.com/YiqunChen1999/date.


title: Fast and Efficient Malware Detection with Joint Static and Dynamic Features Through Transfer Learning

abstract: In malware detection, dynamic analysis extracts the runtime behavior of malware samples in a controlled environment and static analysis extracts features using reverse engineering tools. While the former faces the challenges of anti-virtualization and evasive behavior of malware samples, the latter faces the challenges of code obfuscation. To tackle these drawbacks, prior works proposed to develop detection models by aggregating dynamic and static features, thus leveraging the advantages of both approaches. However, simply concatenating dynamic and static features raises an issue of imbalanced contribution due to the heterogeneous dimensions of feature vectors to the performance of malware detection models. Yet, dynamic analysis is a time-consuming task and requires a secure environment, leading to detection delays and high costs for maintaining the analysis infrastructure. In this paper, we first introduce a method of constructing aggregated features via concatenating latent features learned through deep learning with equally-contributed dimensions. We then develop a knowledge distillation technique to transfer knowledge learned from aggregated features by a teacher model to a student model trained only on static features and use the trained student model for the detection of new malware samples. We carry out extensive experiments with a dataset of 86709 samples including both benign and malware samples. The experimental results show that the teacher model trained on aggregated features constructed by our method outperforms the state-of-the-art models with an improvement of up to 2.38% in detection accuracy. The distilled student model not only achieves high performance (97.81% in terms of accuracy) as that of the teacher model but also significantly reduces the detection time (from 70046.6 ms to 194.9 ms) without requiring dynamic analysis.


title: Higher-group structure in $2n$-dimensional axion-electrodynamics

abstract: We investigate $2n$-dimensional axion electrodynamics for the purpose of exploring a higher-group structure underlying it. This is manifested as a Green-Schwarz transformation of the background gauge fields that couple minimally to the conserved currents. The $n=3$ case is studied most intensively. We derive the identities of correlation functions among the global symmetry generators by using a gauge transformation that maps two correlation functions with each other. A key ingredient in this computation is given by the Green-Schwarz transformation and the 't Hooft anomalies associated with the gauge transformation. The algebraic structure of these results and its physical interpretations are discussed in detail. In particular, we find that the higher-group structure for $n=3$ is endowed with a multi-ary operation among the symmetry generators.


title: Generalized Convolution Quadrature for non smooth sectorial problems

abstract: We consider the application of the generalized Convolution Quadrature (gCQ) to approximate the solution of an important class of sectorial problems. The gCQ is a generalization of Lubich's Convolution Quadrature (CQ) that allows for variable steps. The available stability and convergence theory for the gCQ requires non realistic regularity assumptions on the data, which do not hold in many applications of interest, such as the approximation of subdiffusion equations. It is well known that for non smooth enough data the original CQ, with uniform steps, presents an order reduction close to the singularity. We generalize the analysis of the gCQ to data satisfying realistic regularity assumptions and provide sufficient conditions for stability and convergence on arbitrary sequences of time points. We consider the particular case of graded meshes and show how to choose them optimally, according to the behaviour of the data. An important advantage of the gCQ method is that it allows for a fast and memory reduced implementation. We describe how the fast and oblivious gCQ can be implemented and illustrate our theoretical results with several numerical experiments.


title: Spacetime-emergent ring toward tabletop quantum gravity experiments

abstract: We propose a way to discover, in tabletop experiments, spacetime-emergent materials, that is, materials holographically dual to higher-dimensional quantum gravity systems under the AdS/CFT correspondence. The emergence of the holographic spacetime is verified by a mathematical imaging transform of the response function on the material. We consider theories on a 1-dimensional ring-shaped material, and compute the response to a scalar source locally put at a point on the ring. When the theory on the material has a gravity dual, the imaging in the low temperature phase exhibits a distinct difference from the ordinary materials: the spacetime-emergent material can look into the holographically emergent higher-dimensional curved spacetime and provides an image as if a wave had propagated there. Therefore the image is an experimental signature of the spacetime emergence. We also estimate temperature, ring size and source frequency usable in experiments, with an example of a quantum critical material, TlCuCl$_3$.


title: The B(G)-parametrization of the local Langlands correspondence

abstract: This article is on the parametrization of the local Langlands correspondence over local fields for non-quasi-split groups according to the philosophy of Vogan. We show that a parametrization indexed by the basic part of the Kottwitz set (which is an extension of the set of pure inner twists) implies a parametrization indexed by the full Kottwitz set. On the Galois side, we consider irreducible algebraic representations of the full centralizer group of the $L$-parameter (i.e not a component group). When $F$ is a $p$-adic field, we discuss a generalization of the endoscopic character identity.


title: Competency-Aware Neural Machine Translation: Can Machine Translation Know its Own Translation Quality?

abstract: Neural machine translation (NMT) is often criticized for failures that happen without awareness. The lack of competency awareness makes NMT untrustworthy. This is in sharp contrast to human translators who give feedback or conduct further investigations whenever they are in doubt about predictions. To fill this gap, we propose a novel competency-aware NMT by extending conventional NMT with a self-estimator, offering abilities to translate a source sentence and estimate its competency. The self-estimator encodes the information of the decoding procedure and then examines whether it can reconstruct the original semantics of the source sentence. Experimental results on four translation tasks demonstrate that the proposed method not only carries out translation tasks intact but also delivers outstanding performance on quality estimation. Without depending on any reference or annotated data typically required by state-of-the-art metric and quality estimation methods, our model yields an even higher correlation with human quality judgments than a variety of aforementioned methods, such as BLEURT, COMET, and BERTScore. Quantitative and qualitative analyses show better robustness of competency awareness in our model.


title: Minimal Width for Universal Property of Deep RNN

abstract: A recurrent neural network (RNN) is a widely used deep-learning network for dealing with sequential data. Imitating a dynamical system, an infinite-width RNN can approximate any open dynamical system in a compact domain. In general, deep networks with bounded widths are more effective than wide networks in practice; however, the universal approximation theorem for deep narrow structures has yet to be extensively studied. In this study, we prove the universality of deep narrow RNNs and show that the upper bound of the minimum width for universality can be independent of the length of the data. Specifically, we show that a deep RNN with ReLU activation can approximate any continuous function or $L^p$ function with the widths $d_x+d_y+2$ and $\max\{d_x+1,d_y\}$, respectively, where the target function maps a finite sequence of vectors in $\mathbb{R}^{d_x}$ to a finite sequence of vectors in $\mathbb{R}^{d_y}$. We also compute the additional width required if the activation function is $\tanh$ or more. In addition, we prove the universality of other recurrent networks, such as bidirectional RNNs. Bridging a multi-layer perceptron and an RNN, our theory and proof technique can be an initial step toward further research on deep RNNs.


title: Spot Focusing Coma Correction by Linearly Polarized Dual-Transmitarray Antenna in the Terahertz Region

abstract: Focus scanning is critically important in many terahertz (THz) imaging and sensing applications. A traditional single focusing transmitarray can achieve a good focus when the source is on-axis but moving the source off-axis produces a significant aberration. This paper presents a novel approach to reducing coma in off-axis scanning in the THz region. Here, a dual transmitarray solution is proposed, in which a transmitarray with an optimized phase profile is placed behind a regular phase profile transmitarray. A linearly polarized, dual-transmitarray antenna was fabricated for validation, and the focusing performances were experimentally characterized. The measured results are in good agreement with the theoretical ones. The generated spot of the dual-transmitarray antenna remains focused on an angle up to 50deg, with a -3 dB spot size of less than 4 mm at 290 GHz. The measured near-field sidelobes are all below -10 dB within the whole scanning range.


title: Can Knowledge of End-to-End Text-to-Speech Models Improve Neural MIDI-to-Audio Synthesis Systems?

abstract: With the similarity between music and speech synthesis from symbolic input and the rapid development of text-to-speech (TTS) techniques, it is worthwhile to explore ways to improve the MIDI-to-audio performance by borrowing from TTS techniques. In this study, we analyze the shortcomings of a TTS-based MIDI-to-audio system and improve it in terms of feature computation, model selection, and training strategy, aiming to synthesize highly natural-sounding audio. Moreover, we conducted an extensive model evaluation through listening tests, pitch measurement, and spectrogram analysis. This work demonstrates not only synthesis of highly natural music but offers a thorough analytical approach and useful outcomes for the community. Our code, pre-trained models, supplementary materials, and audio samples are open sourced at https://github.com/nii-yamagishilab/midi-to-audio.


title: A Chemical Study of Nine Star-forming Regions with Evidence of Infall Motion

abstract: The study of the physical and chemical properties of gas infall motion in the molecular clumps helps us understand the initial stages of star formation. We used the FTS wide-sideband mode of the IRAM 30-m telescope to observe nine infall sources with significant double peaked blue line profile. The observation frequency range are 83.7 - 91.5 GHz and 99.4 - 107.2 GHz. We have obtained numbers of molecular line data. Using XCLASS, a total of 7 to 27 different molecules and isotopic transition lines have been identified in these nine sources, including carbon chain molecules such as CCH, c-C3H2 and HC3N. According to the radiation transfer model, we estimated the rotation temperatures and column densities of these sources. Chemical simulations adopting a physical model of HMSFRs are used to fit the observed molecular abundances. The comparison shows that most sources are in the early HMPO stage, with the inner temperature around several ten K.


title: Removal of point source leakage from time-order data filtering

abstract: Time-ordered data (TOD) from ground-based CMB experiments are generally filtered before map-making to remove or reduce the contamination from the ground and the atmospheric emissions. However, when the observation region contains strong point sources, the filtering process will result in considerable leakage around the point sources in a measured CMB map, and leave spurious polarization signals. Therefore, such signals need to be assessed and removed before CMB science exploitation. In this work, we present a new method that we call "template fitting" and can effectively remove these leakage signals in pixel domain, not only satisfying the requirement for measuring primordial gravitational waves from CMB-$B$ modes, but also avoiding time-consuming operations on TOD.


title: Quasi-maximum likelihood estimation and penalized estimation under non-standard conditions

abstract: The purpose of this article is to develop a general parametric estimation theory that allows the derivation of the limit distribution of estimators in non-regular models where the true parameter value may lie on the boundary of the parameter space or where even identifiability fails. For that, we propose a more general local approximation of the parameter space (at the true value) than previous studies. This estimation theory is comprehensive in that it can handle penalized estimation as well as quasi-maximum likelihood estimation under such non-regular models. Besides, our results can apply to the so-called non-ergodic statistics, where the Fisher information is random in the limit, including the regular experiment that is locally asymptotically mixed normal. In penalized estimation, depending on the boundary constraint, even the Bridge estimator with $q<1$ does not necessarily give selection consistency. Therefore, some sufficient condition for selection consistency is described, precisely evaluating the balance between the boundary constraint and the form of the penalty. Examples handled in the paper are: (i) ML estimation of the generalized inverse Gaussian distribution, (ii) quasi-ML estimation of the diffusion parameter in a non-ergodic It\^o process whose parameter space consists of positive semi-definite symmetric matrices, while the drift parameter is treated as nuisance and (iii) penalized ML estimation of variance components of random effects in linear mixed models.


title: Velocity blow-up in $C^1\cap H^2$ for the 2D Euler equations

abstract: We give a vorticity-dynamical proof of $C^1\cap H^2$-illposedness of the 2D Euler equations. Our construction shows that the unique Yudovich solution escapes both $C^1$ and $H^2$ instantaneously.


title: Global and Local Hierarchy-aware Contrastive Framework for Implicit Discourse Relation Recognition

abstract: Due to the absence of explicit connectives, implicit discourse relation recognition (IDRR) remains a challenging task in discourse analysis. The critical step for IDRR is to learn high-quality discourse relation representations between two arguments. Recent methods tend to integrate the whole hierarchical information of senses into discourse relation representations for multi-level sense recognition. Nevertheless, they insufficiently incorporate the static hierarchical structure containing all senses (defined as global hierarchy), and ignore the hierarchical sense label sequence corresponding to each instance (defined as local hierarchy). For the purpose of sufficiently exploiting global and local hierarchies of senses to learn better discourse relation representations, we propose a novel GlObal and Local Hierarchy-aware Contrastive Framework (GOLF), to model two kinds of hierarchies with the aid of multi-task learning and contrastive learning. Experimental results on PDTB 2.0 and PDTB 3.0 datasets demonstrate that our method remarkably outperforms current state-of-the-art models at all hierarchical levels. Our code is publicly available at https://github.com/YJiangcm/GOLF_for_IDRR


title: FFHQ-UV: Normalized Facial UV-Texture Dataset for 3D Face Reconstruction

abstract: We present a large-scale facial UV-texture dataset that contains over 50,000 high-quality texture UV-maps with even illuminations, neutral expressions, and cleaned facial regions, which are desired characteristics for rendering realistic 3D face models under different lighting conditions. The dataset is derived from a large-scale face image dataset namely FFHQ, with the help of our fully automatic and robust UV-texture production pipeline. Our pipeline utilizes the recent advances in StyleGAN-based facial image editing approaches to generate multi-view normalized face images from single-image inputs. An elaborated UV-texture extraction, correction, and completion procedure is then applied to produce high-quality UV-maps from the normalized face images. Compared with existing UV-texture datasets, our dataset has more diverse and higher-quality texture maps. We further train a GAN-based texture decoder as the nonlinear texture basis for parametric fitting based 3D face reconstruction. Experiments show that our method improves the reconstruction accuracy over state-of-the-art approaches, and more importantly, produces high-quality texture maps that are ready for realistic renderings. The dataset, code, and pre-trained texture decoder are publicly available at https://github.com/csbhr/FFHQ-UV.


title: Counting Involutions on Multicomplex Numbers

abstract: We show that there is a bijection between real-linear automorphisms of the multicomplex numbers of order $n$ and signed permutations of length $2^{n-1}$. This allows us to deduce a number of results on the multicomplex numbers, including a formula for the number of involutions on multicomplex spaces which generalizes a recent result on the bicomplex numbers and contrasts drastically with the quaternion case. We also generalize this formula to $r$-involutions and obtain a formula for the number of involutions preserving elementary imaginary units. The proofs rely on new elementary results pertaining to multicomplex numbers that are surprisingly unknown in the literature, including a count and a representation theorem for numbers squaring to $\pm 1$.


title: Computing Embedded Contact Homology in Morse-Bott Settings

abstract: Given a contact three manifold $Y$ with a nondegenerate contact form $\lambda$, and an almost complex structure $J$ compatible with $\lambda$, its embedded contact homology $ECH(Y,\lambda)$ is defined (arXiv:1303.5789) and only depends on the contact structure. In this paper we explain how to compute ECH for Morse-Bott contact forms whose Reeb orbits appear in $S^1$ families, assuming the almost complex structure $J$ can be chosen to satisfy certain transversality conditions (this is the case for instance for boundaries of concave or convex toric domains, or if all the curves of ECH index one have genus zero). We define the ECH chain complex for a Morse-Bott contact form via an enumeration of ECH index one cascades. We prove using gluing results from arXiv:2206.04334 that this chain complex computes the ECH of the contact manifold. This paper and arXiv:2206.04334 fill in some technical foundations for previous calculations in the literature (arXiv:1608.07988, arXiv:math/0410061).


title: Asymmetry in the number of L4 and L5 Jupiter Trojans driven by jumping Jupiter

abstract: Context. More than 10000 Jupiter Trojans have been detected so far. They are moving around the L4 and L5 triangular Lagrangian points of the Sun-Jupiter system and their distributions can provide important clues to the early evolution of the Solar System. Aims. The number asymmetry of the L4 and L5 Jupiter Trojans is a longstanding problem. We aim to test a new mechanism in order to explain this anomalous feature by invoking the jumping-Jupiter scenario. Methods. First, we introduce the orbital evolution of Jupiter caused by the giant planet instability in the early Solar System. In this scenario, Jupiter could undergo an outward migration at a very high speed. We then investigate how such a jump changes the numbers of the L4 (N4) and L5 (N5) Trojans. Results. The outward migration of Jupiter can distort the co-orbital orbits near the Lagrangian points, resulting in L4 Trojans being more stable than the L5 ones. We find that, this mechanism could potentially explain the unbiased number asymmetry of N4/N5~1.6 for the known Jupiter Trojans. The uncertainties of the system parameters, e.g. Jupiter's eccentricity and inclination, the inclination distribution of Jupiter Trojans, are also taken into account and our results about the L4/L5 asymmetry have been further validated. However, the resonant amplitudes of the simulated Trojans are excited to higher values compared to the current population. A possible solution is that collisions among the Trojans may reduce their resonant amplitudes.


title: Galvatron: Efficient Transformer Training over Multiple GPUs Using Automatic Parallelism

abstract: Transformer models have achieved state-of-the-art performance on various domains of applications and gradually becomes the foundations of the advanced large deep learning (DL) models. However, how to train these models over multiple GPUs efficiently is still challenging due to a large number of parallelism choices. Existing DL systems either rely on manual efforts to make distributed training plans or apply parallelism combinations within a very limited search space. In this approach, we propose Galvatron, a new system framework that incorporates multiple popular parallelism dimensions and automatically finds the most efficient hybrid parallelism strategy. To better explore such a rarely huge search space, we 1) involve a decision tree to make decomposition and pruning based on some reasonable intuitions, and then 2) design a dynamic programming search algorithm to generate the optimal plan. Evaluations on four representative Transformer workloads show that Galvatron could perform automatically distributed training with different GPU memory budgets. Among all evluated scenarios, Galvatron always achieves superior system throughput compared to previous work with limited parallelism.


title: Sensitivity Analyses of Resilience-oriented Risk-averse Active Distribution Systems Planning

abstract: This paper presents sensitivity analyses of resilience-based active distribution system planning solutions with respect to different parameters. The distribution system planning problem is formulated as a two-stage risk-averse stochastic optimization model with conditional value-at-risk (CVaR) as the risk measure. The probabilistic scenarios are obtained using regional wind profiles, and Monte Carlo simulations are conducted to obtain failure scenarios based on component fragility models. The planning measure includes advanced distribution grid operations with intentional islanding measures. The three main parameters used in this work for sensitivity analysis are the number of scenarios, risk preference, and planning budget allocation. Such analysis can provide additional information to system operators on dispatching the planning budget and available resources properly to enhance the grid's resilience.


title: Single-walled Ising nanotube with opposite sign of interactions using Wang-Landau algorithm

abstract: The effect of opposite sign of interactions in a single-walled Ising nanotube is investigated using the Wang-Landau algorithm. The thermodynamic observables are calculated from the estimated density of states (DOS) with and without the presence of an external magnetic field. Irrespective of the applied magnetic field, a symmetric trend of DOS is observed for opposite sign of interactions which is in contrast to the asymmetric trend for same sign of interactions. Further, two types of anti-ferromagnetic (AFM) orderings, namely A-type and C-type anti-ferromagnetic order, are observed for opposite sign of interactions. These AFM spin orientations are switched to ferromagnetic (FM) phase by increasing the applied magnetic field ($B$). However, the spin ordering changes from the ordered AFM/FM phase to a disordered paramagnetic phase by increasing the temperature. Phase diagram shows that these three phases coexist around $B=2.0$. This study indicates that, by properly tuning the magnetic properties, the single-walled nanotube can be used for fabrication of new types of magnetic storage nano materials.


title: Classification of solutions for some mixed order elliptic system

abstract: In this paper, we classify the solution of the following mixed-order conformally invariant system with coupled nonlinearity in $ \mathbb{R}^4$: \begin{equation}\left\{ \begin{aligned} & -\Delta u(x) = u^{p_1}(x) e^{q_1v(x)}, \quad x\in \mathbb{R}^4,\\ & (-\Delta)^2 v(x) = u^{p_2}(x) e^{q_2v(x)}, \quad x\in \mathbb{R}^4, \end{aligned} \right. \end{equation} where $ 0\leq p_1 < 1$, $ p_2 >0$, $ q_1 > 0$, $ q_2 \geq 0$, $ u>0$ and satisfies $$ \int_{\mathbb{R}^4} u^{p_1}(x) e^{q_1v(x)} dx < \infty,\quad \int_{\mathbb{R}^4} u^{p_2}(x) e^{q_2 v(x)} dx < \infty.$$ Under additional assumptions (H1) or (H2), we study the asymptotic behavior of the solutions to the system and we establish the equivalent integral formula for the system. By using the method of moving spheres, we obtain the classification results of the solutions in the system.


title: Towards Better Bounds for Finding Quasi-Identifiers

abstract: We revisit the problem of finding small $\epsilon$-separation keys introduced by Motwani and Xu (2008). In this problem, the input is $m$-dimensional tuples $x_1,x_2,\ldots,x_n $. The goal is to find a small subset of coordinates that separates at least $(1-\epsilon){n \choose 2}$ pairs of tuples. They provided a fast algorithm that runs on $\Theta(m/\epsilon)$ tuples sampled uniformly at random. We show that the sample size can be improved to $\Theta(m/\sqrt{\epsilon})$. Our algorithm also enjoys a faster running time. To obtain this result, we provide upper and lower bounds on the sample size to solve the following decision problem. Given a subset of coordinates $A$, reject if $A$ separates fewer than $(1-\epsilon){n \choose 2}$ pairs, and accept if $A$ separates all pairs. The algorithm must be correct with probability at least $1-\delta$ for all $A$. We show that for algorithms based on sampling: - $\Theta(m/\sqrt{\epsilon})$ samples are sufficient and necessary so that $\delta \leq e^{-m}$ and - $\Omega(\sqrt{\frac{\log m}{\epsilon}})$ samples are necessary so that $\delta$ is a constant. Our analysis is based on a constrained version of the balls-into-bins problem. We believe our analysis may be of independent interest. We also study a related problem that asks for the following sketching algorithm: with given parameters $\alpha,k$ and $\epsilon$, the algorithm takes a subset of coordinates $A$ of size at most $k$ and returns an estimate of the number of unseparated pairs in $A$ up to a $(1\pm\epsilon)$ factor if it is at least $\alpha {n \choose 2}$. We show that even for constant $\alpha$ and success probability, such a sketching algorithm must use $\Omega(mk \log \epsilon^{-1})$ bits of space; on the other hand, uniform sampling yields a sketch of size $\Theta(\frac{mk \log m}{\alpha \epsilon^2})$ for this purpose.


title: Learning with Silver Standard Data for Zero-shot Relation Extraction

abstract: The superior performance of supervised relation extraction (RE) methods heavily relies on a large amount of gold standard data. Recent zero-shot relation extraction methods converted the RE task to other NLP tasks and used off-the-shelf models of these NLP tasks to directly perform inference on the test data without using a large amount of RE annotation data. A potentially valuable by-product of these methods is the large-scale silver standard data. However, there is no further investigation on the use of potentially valuable silver standard data. In this paper, we propose to first detect a small amount of clean data from silver standard data and then use the selected clean data to finetune the pretrained model. We then use the finetuned model to infer relation types. We also propose a class-aware clean data detection module to consider class information when selecting clean data. The experimental results show that our method can outperform the baseline by 12% and 11% on TACRED and Wiki80 dataset in the zero-shot RE task. By using extra silver standard data of different distributions, the performance can be further improved.


title: Non-local spin correlation as a signature of Ising anyons trapped in vacancies of the Kitaev spin liquid

abstract: In the Kitaev chiral spin liquid, Ising anyons are realized as $Z_2$ fluxes binding Majorana zero modes, which, however, are thermal excitations with finite decay rates. On the other hand, a lattice vacancy traps a $Z_2$ flux even in the ground state, resulting in the stable realization of a Majorana zero mode in a vacancy. We demonstrate that spin-spin correlation functions between two vacancy sites exhibit long-range correlation arising from the fractionalized character of Majorana zero modes, in spite of the strong decay of bulk spin correlations. Remarkably, this non-local spin correlation does not decrease as the distance between two vacancy sites increases, signaling Majorana teleportation. Furthermore, we clarify that the non-local correlation can be detected electrically via the measurement of non-local conductance between two vacancy sites, which is straightforwardly utilized for the readout of Majorana qubits. These findings pave the way to the measurement-based quantum computation with Ising anyons trapped in vacancies of the Kitaev spin liquid.


title: Pulsar Glitches: A Review

abstract: $\sim 6\%$ of all known pulsars have been observed to exhibit sudden spin-up events, known as glitches. For more than fifty years, these phenomena have played an important role in helping to understand pulsar (astro)physics. Based on the review of pulsar glitches search method, the progress made in observations in recent years is summarized, including the achievements obtained by Chinese telescopes. Glitching pulsars demonstrate great diversity of behaviours, which can be broadly classified into four categories: normal glitches, slow glitches, glitches with delayed spin-ups, and anti-glitches. The main models of glitches that have been proposed are reviewed and their implications for neutron star structure are critically examined regarding our current understanding. Furthermore, the correlations between glitches and emission changes, which suggest that magnetospheric state-change is linked to the pulsar-intrinsic processes, are also described and discussed in some detail.


title: Rotation of the dislocation grid in multilayer FeSe films and visualization of electronic nematic domains via orbital-selective tunneling

abstract: Understanding the interplay of structural and electronic symmetry breaking in Fe-based high temperature superconductors remains of high interest. In this work we grow strain-patterned multilayer FeSe thin films in a range of thicknesses using molecular beam epitaxy. We study the formation of electronic nematic domains and spatially-varying strain using scanning tunneling microscopy and spectroscopy. We directly visualize the formation of edge dislocations that give rise to a two-dimensional edge dislocation network in the films. Interestingly, we observe a 45 degree in-plane rotation of the dislocation network as a function of film thickness, yielding antisymmetric strain along different directions. This results in different coupling ratios between electronic nematic domains and antisymmetric strain. Lastly, we are able to distinguish between different orthogonal nematic domains by revealing a small energy-dependent difference in differential conductance maps between the two regions. This could be explained by orbital-selective tip-sample tunneling. Our observations bring new insights into the dislocation network formation in epitaxial thin films and provide another nanoscale tool to explore electronic nematicity in Fe-based superconductors.


title: TPA-Net: Generate A Dataset for Text to Physics-based Animation

abstract: Recent breakthroughs in Vision-Language (V&L) joint research have achieved remarkable results in various text-driven tasks. High-quality Text-to-video (T2V), a task that has been long considered mission-impossible, was proven feasible with reasonably good results in latest works. However, the resulting videos often have undesired artifacts largely because the system is purely data-driven and agnostic to the physical laws. To tackle this issue and further push T2V towards high-level physical realism, we present an autonomous data generation technique and a dataset, which intend to narrow the gap with a large number of multi-modal, 3D Text-to-Video/Simulation (T2V/S) data. In the dataset, we provide high-resolution 3D physical simulations for both solids and fluids, along with textual descriptions of the physical phenomena. We take advantage of state-of-the-art physical simulation methods (i) Incremental Potential Contact (IPC) and (ii) Material Point Method (MPM) to simulate diverse scenarios, including elastic deformations, material fractures, collisions, turbulence, etc. Additionally, high-quality, multi-view rendering videos are supplied for the benefit of T2V, Neural Radiance Fields (NeRF), and other communities. This work is the first step towards fully automated Text-to-Video/Simulation (T2V/S). Live examples and subsequent work are at https://sites.google.com/view/tpa-net.


title: Modelling the response of a turbulent jet flame to acoustic forcing in a linearized framework using an active flame approach

abstract: This study performs a linear analysis of a turbulent reacting methane-air jet flame, with the goal of predicting the response of the reacting flow to upstream acoustic actuation. Accounting for heat release fluctuations is a vital component when investigating thermoacoustic instabilities and flame noise in a linearized framework. Unlike previous studies this work develops and applies an active flame approach, meaning the heat release oscillations of the flame resulting from the acoustic fluctuations are taken into account. To yield an active flame approach in the linear framework, a combustion model needs to be linearized. It is demonstrated that linearizing Large Eddy Simulation (LES) and Direct Numerical Simulation (DNS) combustion models leads to closure problems, making their application in the linearized framework troublesome. Reynolds-averaged Navier Stokes (RANS) combustion models, however, prove to circumvent this problem, which makes them suitable candidates for this purpose. The RANS combustion models are linearized around the temporal mean flow of the turbulent jet flame, which is obtained by LES. An a priori analysis shows that a linearized RANS-Eddy Break Up (EBU) model is the best suited among all investigated combustion models for the investigated set-up and reproduces with high accuracy the fluctuations in reaction rate obtained in the LES. Furthermore, the linearized governing equations of the flow including the linearized EBU model for the reaction rate are solved for incoming acoustic perturbations. The response modes show that the reaction rate oscillations are caused by Kelvin-Helmholtz vortex rings, which perturb the jet flame. The results are in good agreement with the LES simulations in terms of the mode shapes of both reaction rate and velocity fluctuations.


title: An Empirical Bayes Regression for Multi-tissue eQTL Data Analysis

abstract: The Genotype-Tissue Expression (GTEx) project collects samples from multiple human tissues to study the relationship between genetic variation or single nucleotide polymorphisms (SNPs) and gene expression in each tissue. However, most existing eQTL analyses only focus on single tissue information. In this paper, we develop a multi-tissue eQTL analysis that improves the single tissue cis-SNP gene expression association analysis by borrowing information across tissues. Specifically, we propose an empirical Bayes regression model for SNP-expression association analysis using data across multiple tissues. To allow the effects of SNPs to vary greatly among tissues, we use a mixture distribution as the prior, which is a mixture of a multivariate Gaussian distribution and a Dirac mass at zero. The model allows us to assess the cis-SNP gene expression association in each tissue by calculating the Bayes factors. We show that the proposed estimator of the cis-SNP effects on gene expression achieves the minimum Bayes risk among all estimators. Analyses of the GTEx data show that our proposed method is superior to traditional simple regression methods in terms of predicting accuracy for gene expression levels using cis-SNPs in testing data sets. Moreover, we find that although genetic effects on expression are extensively shared among tissues, effect sizes still vary greatly across tissues.


title: Option Pricing under Multifactor Black-Scholes Model Using Orthogonal Spline Wavelets

abstract: The paper focuses on pricing European-style options on several underlying assets under the Black-Scholes model represented by a nonstationary partial differential equation. The proposed method combines the Galerkin method with $L^2$-orthogonal sparse grid spline wavelets and the Crank-Nicolson scheme with Rannacher time-stepping. To this end, we construct an orthogonal cubic spline wavelet basis on the interval satisfying homogeneous Dirichlet boundary conditions and design a wavelet basis on the unit cube using the sparse tensor product. The method brings the following advantages. First, the number of basis functions is significantly smaller than for the full grid, which makes it possible to overcome the so-called curse of dimensionality. Second, some matrices involved in the computation are identity matrices, which significantly simplifies and streamlines the algorithm, especially in higher dimensions. Further, we prove that discretization matrices have uniformly bounded condition numbers, even without preconditioning, and that the condition numbers do not depend on the dimension of the problem. Due to the use of cubic spline wavelets, the method is higher-order convergent. Numerical experiments are presented for options on the geometric average.


title: Modeling Hadronic Gamma-ray Emissions from Solar Flares and Prospects for Detecting Non-thermal Signatures from Protostars

abstract: We investigate gamma-ray emission in the impulsive phase of solar flares and the detectability of non-thermal signatures from protostellar flares. Energetic solar flares emit high-energy gamma rays of GeV energies, but their production mechanism and emission site are still unknown. Young stellar objects, including protostars, also exhibit luminous X-ray flares, but the triggering mechanism of the flaring activity is still unclear due to the strong obscuration. Non-thermal signatures in mm/sub-mm and gamma-ray bands are useful to probe protostellar flares owing to their strong penetration power. We develop a non-thermal emission model of the impulsive phase of solar flares, where cosmic-ray protons accelerated at the termination shock produce high-energy gamma rays via hadronuclear interaction with the evaporation plasma. This model can reproduce gamma-ray data in the impulsive phase of a solar flare. We apply our model to protostellar flares and show that Cherenkov Telescope Array will be able to detect gamma rays of TeV energies if particle acceleration in protostellar flares is efficient. Non-thermal electrons accelerated together with protons can emit strong mm and sub-mm signals via synchrotron radiation, whose power is consistent with the energetic mm/sub-mm transients observed from young stars. Future gamma-ray and mm/sub-mm observations from protostars, coordinated with a hard X-ray observation, will unravel the non-thermal particle production and triggering mechanism of protostellar flares.


title: Complementary Explanations for Effective In-Context Learning

abstract: Large language models (LLMs) have exhibited remarkable capabilities in learning from explanations in prompts, but there has been limited understanding of exactly how these explanations function or why they are effective. This work aims to better understand the mechanisms by which explanations are used for in-context learning. We first study the impact of two different factors on the performance of prompts with explanations: the computation trace (the way the solution is decomposed) and the natural language used to express the prompt. By perturbing explanations on three controlled tasks, we show that both factors contribute to the effectiveness of explanations. We further study how to form maximally effective sets of explanations for solving a given test query. We find that LLMs can benefit from the complementarity of the explanation set: diverse reasoning skills shown by different exemplars can lead to better performance. Therefore, we propose a maximal marginal relevance-based exemplar selection approach for constructing exemplar sets that are both relevant as well as complementary, which successfully improves the in-context learning performance across three real-world tasks on multiple LLMs.


title: Scalable multiscale-spectral GFEM with an application to composite aero-structures

abstract: In this paper, the first large-scale application of multiscale-spectral generalized finite element methods (MS-GFEM) to composite aero-structures is presented. The crucial novelty lies in the introduction of A-harmonicity in the local approximation spaces, which in contrast to [Babuska, Lipton, Multiscale Model. Simul. 9, 2011] is enforced more efficiently via a constraint in the local eigenproblems. This significant modification leads to excellent approximation properties, which turn out to be essential to capture accurately material strains and stresses with a low dimensional approximation space, hence maximising model order reduction. The implementation of the framework in the DUNE software package, as well as a detailed description of all components of the method are presented and exemplified on a composite laminated beam under compressive loading. The excellent parallel scalability of the method, as well as its superior performance compared to the related, previously introduced GenEO method are demonstrated on two realistic application cases, including a C-shaped wing spar with complex geometry. Further, by allowing low-cost approximate solves for closely related models or geometries this efficient, novel technology provides the basis for future applications in optimisation or uncertainty quantification on challenging problems in composite aero-structures.


title: A Generalized Analytical Model For Thermal And Bulk Comptonization In Accretion-Powered X-Ray Pulsars

abstract: We develop a new theoretical model describing the formation of the radiation spectrum in accretion-powered X-ray pulsars as a result of bulk and thermal Comptonization of photons in the accretion column. The new model extends the previous model developed by the authors in four ways: (1) we utilize a conical rather than cylindrical geometry; (2) the radiation components emitted from the column wall and the column top are computed separately; (3) the model allows for a non-zero impact velocity at the stellar surface; and (4) the velocity profile of the gas merges with Newtonian free-fall far from the star. We show that these extensions allow the new model to simulate sources over a wide range of accretion rates. The model is based on a rigorous mathematical approach in which we obtain an exact series solution for the Green's function describing the reprocessing of monochromatic seed photons. Emergent spectra are then computed by convolving the Green's function with bremsstrahlung, cyclotron, and blackbody photon sources. The range of the new model is demonstrated via applications to the high-luminosity source Her X-1, and the low-luminosity source X Per. The new model suggests that the observed increase in spectral hardness associated with increasing luminosity in Her X-1 may be due to a decrease in the surface impact velocity, which increases the $P$d$V$ work done on the radiation field by the gas.


title: Identifying Incorrect Annotations in Multi-Label Classification Data

abstract: In multi-label classification, each example in a dataset may be annotated as belonging to one or more classes (or none of the classes). Example applications include image (or document) tagging where each possible tag either applies to a particular image (or document) or not. With many possible classes to consider, data annotators are likely to make errors when labeling such data in practice. Here we consider algorithms for finding mislabeled examples in multi-label classification datasets. We propose an extension of the Confident Learning framework to this setting, as well as a label quality score that ranks examples with label errors much higher than those which are correctly labeled. Both approaches can utilize any trained classifier. After demonstrating that our methodology empirically outperforms other algorithms for label error detection, we apply our approach to discover many label errors in the CelebA image tagging dataset.


title: MUSIED: A Benchmark for Event Detection from Multi-Source Heterogeneous Informal Texts

abstract: Event detection (ED) identifies and classifies event triggers from unstructured texts, serving as a fundamental task for information extraction. Despite the remarkable progress achieved in the past several years, most research efforts focus on detecting events from formal texts (e.g., news articles, Wikipedia documents, financial announcements). Moreover, the texts in each dataset are either from a single source or multiple yet relatively homogeneous sources. With massive amounts of user-generated text accumulating on the Web and inside enterprises, identifying meaningful events in these informal texts, usually from multiple heterogeneous sources, has become a problem of significant practical value. As a pioneering exploration that expands event detection to the scenarios involving informal and heterogeneous texts, we propose a new large-scale Chinese event detection dataset based on user reviews, text conversations, and phone conversations in a leading e-commerce platform for food service. We carefully investigate the proposed dataset's textual informality and multi-source heterogeneity characteristics by inspecting data samples quantitatively and qualitatively. Extensive experiments with state-of-the-art event detection methods verify the unique challenges posed by these characteristics, indicating that multi-source informal event detection remains an open problem and requires further efforts. Our benchmark and code are released at \url{https://github.com/myeclipse/MUSIED}.


title: AFR-Net: Attention-Driven Fingerprint Recognition Network

abstract: The use of vision transformers (ViT) in computer vision is increasing due to limited inductive biases (e.g., locality, weight sharing, etc.) and increased scalability compared to other deep learning methods. This has led to some initial studies on the use of ViT for biometric recognition, including fingerprint recognition. In this work, we improve on these initial studies for transformers in fingerprint recognition by i.) evaluating additional attention-based architectures, ii.) scaling to larger and more diverse training and evaluation datasets, and iii.) combining the complimentary representations of attention-based and CNN-based embeddings for improved state-of-the-art (SOTA) fingerprint recognition (both authentication and identification). Our combined architecture, AFR-Net (Attention-Driven Fingerprint Recognition Network), outperforms several baseline transformer and CNN-based models, including a SOTA commercial fingerprint system, Verifinger v12.3, across intra-sensor, cross-sensor, and latent to rolled fingerprint matching datasets. Additionally, we propose a realignment strategy using local embeddings extracted from intermediate feature maps within the networks to refine the global embeddings in low certainty situations, which boosts the overall recognition accuracy significantly across each of the models. This realignment strategy requires no additional training and can be applied as a wrapper to any existing deep learning network (including attention-based, CNN-based, or both) to boost its performance.


title: Synthesis Cost-Optimal Targeted Mutant Protein Libraries

abstract: Protein variant libraries produced by site-directed mutagenesis are a useful tool utilized by protein engineers to explore variants with potentially improved properties, such as activity and stability. These libraries are commonly built by selecting residue positions and alternative beneficial mutations for each position. All possible combinations are then constructed and screened, by incorporating degenerate codons at mutation sites. These degenerate codons often encode additional unwanted amino acids or even STOP codons. Our study aims to take advantage of annealing based recombination of oligonucleotides during synthesis and utilize multiple degenerate codons per mutation site to produce targeted protein libraries devoid of unwanted variants. Toward this goal we created an algorithm to calculate the minimum number of degenerate codons necessary to specify any given amino acid set, and a dynamic programming method that uses this algorithm to optimally partition a DNA target sequence with degeneracies into overlapping oligonucleotides, such that the total cost of synthesis of the target mutant protein library is minimized. Computational experiments show that, for a modest increase in DNA synthesis costs, beneficial variant yields in produced mutant libraries are increased by orders of magnitude, an effect particularly pronounced in large combinatorial libraries.


title: Comparison Study Between Token Classification and Sequence Classification In Text Classification

abstract: Unsupervised Machine Learning techniques have been applied to Natural Language Processing tasks and surpasses the benchmarks such as GLUE with great success. Building language models approach achieves good results in one language and it can be applied to multiple NLP task such as classification, summarization, generation and etc as an out of box model. Among all the of the classical approaches used in NLP, the masked language modeling is the most used. In general, the only requirement to build a language model is presence of the large corpus of textual data. Text classification engines uses a variety of models from classical and state of art transformer models to classify texts for in order to save costs. Sequence Classifiers are mostly used in the domain of text classification. However Token classifiers also are viable candidate models as well. Sequence Classifiers and Token Classifier both tend to improve the classification predictions due to the capturing the context information differently. This work aims to compare the performance of Sequence Classifier and Token Classifiers and evaluate each model on the same set of data. In this work, we are using a pre-trained model as the base model and Token Classifier and Sequence Classier heads results of these two scoring paradigms with be compared..


title: A Deep Learning Anomaly Detection Method in Textual Data

abstract: In this article, we propose using deep learning and transformer architectures combined with classical machine learning algorithms to detect and identify text anomalies in texts. Deep learning model provides a very crucial context information about the textual data which all textual context are converted to a numerical representation. We used multiple machine learning methods such as Sentence Transformers, Auto Encoders, Logistic Regression and Distance calculation methods to predict anomalies. The method are tested on the texts data and we used syntactic data from different source injected into the original text as anomalies or use them as target. Different methods and algorithm are explained in the field of outlier detection and the results of the best technique is presented. These results suggest that our algorithm could potentially reduce false positive rates compared with other anomaly detection methods that we are testing.