title: An unusual pulse shape change event in PSR J1713+0747 observed with the Green Bank Telescope and CHIME

abstract: The millisecond pulsar J1713+0747 underwent a sudden and significant pulse shape change between April 16 and 17, 2021 (MJDs 59320 and 59321). Subsequently, the pulse shape gradually recovered over the course of several months. We report the results of continued multi-frequency radio observations of the pulsar made using the Canadian Hydrogen Intensity Mapping Experiment (CHIME) and the 100-meter Green Bank Telescope (GBT) in a three-year period encompassing the shape change event, between February 2020 and February 2023. As of February 2023, the pulse shape had returned to a state similar to that seen before the event, but with measurable changes remaining. The amplitude of the shape change and the accompanying TOA residuals display a strong non-monotonic dependence on radio frequency, demonstrating that the event is neither a glitch (the effects of which should be independent of radio frequency, $\nu$) nor a change in dispersion measure (DM) alone (which would produce a delay proportional to $\nu^{-2}$). However, it does bear some resemblance to the two previous "chromatic timing events" observed in J1713+0747 (Demorest et al. 2013; Lam et al. 2016), as well as to a similar event observed in PSR J1643-1224 in 2015 (Shannon et al. 2016).


title: Electromagnetic Force and Momentum in Classical Macroscopic Dipolar Media

abstract: Using realistic classical models of microscopic electric-charge electric dipoles and electric-current (Amperian) magnetic dipoles, it is proven that the Einstein-Laub macroscopic electromagnetic force on a macroscopic-continuum volume of these classical dipoles equals the sum of the microscopic electromagnetic forces on the discrete classical dipoles in that volume. The internal (hidden) momentum of the discrete Amperian magnetic dipoles is rigorously derived and properly included in the determination of the macroscopic force from the spatial averaging of the microscopic forces. Consequently, the Abraham/Einstein-Laub rather than the Minkowski macroscopic electromagnetic-field momentum density gives the total microscopic electromagnetic-field momentum in that volume. The kinetic momentum is found for the volume of the macroscopic continuum from Newton's relativistic equation of motion. It is shown that the difference between the kinetic and canonical momenta in a volume of the macroscopic continuum is equal to the sum of the "hidden electromagnetic momenta" within the electric-current magnetic dipoles and within hypothetical magnetic-current electric dipoles replacing the electric-charge electric dipoles in the classical macroscopic continuum. To obtain the correct unambiguous value of the force on a volume inside the continuum from the force-momentum expression, it is mandatory that the surface of that volume be hypothetically separated from the rest of the continuum by a thin free-space shell. Two definitive experiments performed in the past with time varying fields and forces are shown to conclusively confirm the Einstein-Laub/Abraham formulation over the Minkowski formulation.


title: An Exploration of Neural Radiance Field Scene Reconstruction: Synthetic, Real-world and Dynamic Scenes

abstract: This project presents an exploration into 3D scene reconstruction of synthetic and real-world scenes using Neural Radiance Field (NeRF) approaches. We primarily take advantage of the reduction in training and rendering time of neural graphic primitives multi-resolution hash encoding, to reconstruct static video game scenes and real-world scenes, comparing and observing reconstruction detail and limitations. Additionally, we explore dynamic scene reconstruction using Neural Radiance Fields for Dynamic Scenes(D-NeRF). Finally, we extend the implementation of D-NeRF, originally constrained to handle synthetic scenes to also handle real-world dynamic scenes.


title: Variations on the Missionaries and Cannibals Problem

abstract: We explore both automated and human approaches to the generalized Missionaries and Cannibals problem.


title: Investigating Input Modality and Task Geometry on Precision-first 3D Drawing in Virtual Reality

abstract: Accurately drawing non-planar 3D curves in immersive Virtual Reality (VR) is indispensable for many precise 3D tasks. However, due to lack of physical support, limited depth perception, and the non-planar nature of 3D curves, it is challenging to adjust mid-air strokes to achieve high precision. Instead of creating new interaction techniques, we investigated how task geometric shapes and input modalities affect precision-first drawing performance in a within-subject study (n = 12) focusing on 3D target tracing in commercially available VR headsets. We found that compared to using bare hands, VR controllers and pens yield nearly 30% of precision gain, and that the tasks with large curvature, forward-backward or left-right orientations perform best. We finally discuss opportunities for designing novel interaction techniques for precise 3D drawing. We believe that our work will benefit future research aiming to create usable toolboxes for precise 3D drawing.


title: Inequalities for $f^*$-vectors of Lattice Polytopes

abstract: The Ehrhart polynomial $\text{ehr}_P(n)$ of a lattice polytope $P$ counts the number of integer points in the $n$-th integral dilate of $P$. The $f^*$-vector of $P$, introduced by Felix Breuer in 2012, is the vector of coefficients of $\text{ehr}_P(n)$ with respect to the binomial coefficient basis $ \left\{\binom{n-1}{0},\binom{n-1}{1},...,\binom{n-1}{d}\right\}$, where $d = \dim P$. Similarly to $h/h^*$-vectors, the $f^*$-vector of $P$ coincides with the $f$-vector of its unimodular triangulations (if they exist). We present several inequalities that hold among the coefficients of $f^*$-vectors of polytopes. These inequalities resemble striking similarities with existing inequalities for the coefficients of $f$-vectors of simplicial polytopes; e.g., the first half of the $f^*$-coefficients increases and the last quarter decreases. Even though $f^*$-vectors of polytopes are not always unimodal, there are several families of polytopes that carry the unimodality property. We also show that for any polytope with a given Ehrhart $h^*$-vector, there is a polytope with the same $h^*$-vector whose $f^*$-vector is unimodal.


title: Implicit Offline Reinforcement Learning via Supervised Learning

abstract: Offline Reinforcement Learning (RL) via Supervised Learning is a simple and effective way to learn robotic skills from a dataset collected by policies of different expertise levels. It is as simple as supervised learning and Behavior Cloning (BC), but takes advantage of return information. On datasets collected by policies of similar expertise, implicit BC has been shown to match or outperform explicit BC. Despite the benefits of using implicit models to learn robotic skills via BC, offline RL via Supervised Learning algorithms have been limited to explicit models. We show how implicit models can leverage return information and match or outperform explicit algorithms to acquire robotic skills from fixed datasets. Furthermore, we show the close relationship between our implicit methods and other popular RL via Supervised Learning algorithms to provide a unified framework. Finally, we demonstrate the effectiveness of our method on high-dimension manipulation and locomotion tasks.


title: Graphemic Normalization of the Perso-Arabic Script

abstract: Since its original appearance in 1991, the Perso-Arabic script representation in Unicode has grown from 169 to over 440 atomic isolated characters spread over several code pages representing standard letters, various diacritics and punctuation for the original Arabic and numerous other regional orthographic traditions. This paper documents the challenges that Perso-Arabic presents beyond the best-documented languages, such as Arabic and Persian, building on earlier work by the expert community. We particularly focus on the situation in natural language processing (NLP), which is affected by multiple, often neglected, issues such as the use of visually ambiguous yet canonically nonequivalent letters and the mixing of letters from different orthographies. Among the contributing conflating factors are the lack of input methods, the instability of modern orthographies, insufficient literacy, and loss or lack of orthographic tradition. We evaluate the effects of script normalization on eight languages from diverse language families in the Perso-Arabic script diaspora on machine translation and statistical language modeling tasks. Our results indicate statistically significant improvements in performance in most conditions for all the languages considered when normalization is applied. We argue that better understanding and representation of Perso-Arabic script variation within regional orthographic traditions, where those are present, is crucial for further progress of modern computational NLP techniques especially for languages with a paucity of resources.


title: DeGroot-based opinion formation under a global steering mechanism

abstract: This paper investigates how interacting agents arrive to a consensus or a polarized state. We study the opinion formation process under the effect of a global steering mechanism (GSM), which aggregates the opinion-driven stochastic agent states at the network level and feeds back to them a form of global information. We also propose a new two-layer agent-based opinion formation model, called GSM-DeGroot, that captures the coupled dynamics between agent-to-agent local interactions and the GSM's steering effect. This way, agents are subject to the effects of a DeGroot-like local opinion propagation, as well as to a wide variety of possible aggregated information that can affect their opinions, such as trending news feeds, press coverage, polls, elections, etc. Contrary to the standard DeGroot model, our model allows polarization to emerge by letting agents react to the global information in a stubborn differential way. Moreover, the introduced stochastic agent states produce event stream dynamics that can fit to real event data. We explore numerically the model dynamics to find regimes of qualitatively different behavior. We also challenge our model by fitting it to the dynamics of real topics that attracted the public attention and were recorded on Twitter. Our experiments show that the proposed model holds explanatory power, as it evidently captures real opinion formation dynamics via a relatively small set of interpretable parameters.


title: ALMA Observations of the HD~110058 debris disk

abstract: We present Atacama Large Millimeter Array (ALMA) observations of the young, gas-rich debris disk around HD110058 at 0.3-0.6\arcsec resolution. The disk is detected in the 0.85 and 1.3~mm continuum, as well as in the J=2-1 and J=3-2 transitions of $^{12}$CO and $^{13}$CO. The observations resolve the dust and gas distributions and reveal that this is the smallest debris disk around stars of similar luminosity observed by ALMA. The new ALMA data confirm the disk is very close to edge-on, as shown previously in scattered light images. We use radiative transfer modeling to constrain the physical properties of dust and gas disks. The dust density peaks at around 31~au and has a smooth outer edge that extends out to $\sim70$~au. Interestingly, the dust emission is marginally resolved along the minor axis, which indicates that it is vertically thick if truly close to edge-on with an aspect ratio between 0.13 and 0.28. We also find that the CO gas distribution is more compact than the dust \ah{(similarly to the disk around 49 Ceti)}, which could be due to a low viscosity and a higher gas release rate at small radii. Using simulations of the gas evolution taking into account the CO photodissociation, shielding, and viscous evolution, we find that HD~110058's CO gas mass and distribution are consistent with a secondary origin scenario. Finally, we find that the gas densities may be high enough to cause the outward drift of small dust grains in the disk.


title: Text Editing as Imitation Game

abstract: Text editing, such as grammatical error correction, arises naturally from imperfect textual data. Recent works frame text editing as a multi-round sequence tagging task, where operations -- such as insertion and substitution -- are represented as a sequence of tags. While achieving good results, this encoding is limited in flexibility as all actions are bound to token-level tags. In this work, we reformulate text editing as an imitation game using behavioral cloning. Specifically, we convert conventional sequence-to-sequence data into state-to-action demonstrations, where the action space can be as flexible as needed. Instead of generating the actions one at a time, we introduce a dual decoders structure to parallel the decoding while retaining the dependencies between action tokens, coupled with trajectory augmentation to alleviate the distribution shift that imitation learning often suffers. In experiments on a suite of Arithmetic Equation benchmarks, our model consistently outperforms the autoregressive baselines in terms of performance, efficiency, and robustness. We hope our findings will shed light on future studies in reinforcement learning applying sequence-level action generation to natural language processing.


title: The Stochastic Proximal Distance Algorithm

abstract: Stochastic versions of proximal methods have gained much attention in statistics and machine learning. These algorithms tend to admit simple, scalable forms, and enjoy numerical stability via implicit updates. In this work, we propose and analyze a stochastic version of the recently proposed proximal distance algorithm, a class of iterative optimization methods that recover a desired constrained estimation problem as a penalty parameter $\rho \rightarrow \infty$. By uncovering connections to related stochastic proximal methods and interpreting the penalty parameter as the learning rate, we justify heuristics used in practical manifestations of the proximal distance method, establishing their convergence guarantees for the first time. Moreover, we extend recent theoretical devices to establish finite error bounds and a complete characterization of convergence rates regimes. We validate our analysis via a thorough empirical study, also showing that unsurprisingly, the proposed method outpaces batch versions on popular learning tasks.


title: Sample Efficient Robot Learning with Structured World Models

abstract: Reinforcement learning has been demonstrated as a flexible and effective approach for learning a range of continuous control tasks, such as those used by robots to manipulate objects in their environment. But in robotics particularly, real-world rollouts are costly, and sample efficiency can be a major limiting factor when learning a new skill. In game environments, the use of world models has been shown to improve sample efficiency while still achieving good performance, especially when images or other rich observations are provided. In this project, we explore the use of a world model in a deformable robotic manipulation task, evaluating its effect on sample efficiency when learning to fold a cloth in simulation. We compare the use of RGB image observation with a feature space leveraging built-in structure (keypoints representing the cloth configuration), a common approach in robot skill learning, and compare the impact on task performance and learning efficiency with and without the world model. Our experiments showed that the usage of keypoints increased the performance of the best model on the task by 50%, and in general, the use of a learned or constructed reduced feature space improved task performance and sample efficiency. The use of a state transition predictor(MDN-RNN) in our world models did not have a notable effect on task performance.


title: Shape stability of a quadrature surface problem in infinite Riemannian manifolds

abstract: In this paper, we give a simple control on how an optimal shape can be characterized. The framework of Riemannian manifold of infinite dimension is essential. And the covariant derivative plays a key role in the computation and in the analysis of qualitative properties from the shape hessian. The control depends only on the mean curvature of the domain which is a minimum or a critical point.


title: KaRMMa 2.0 -- Kappa Reconstruction for Mass Mapping

abstract: We present KaRMMa 2.0, an updated version of the mass map reconstruction code introduced in Fiedorowicz et al. (2022). KaRMMa is a full-sky Bayesian algorithm for reconstructing weak lensing mass maps from shear data. It forward-models the convergence field as a realization of a lognormal field. The corresponding shear map is calculated using the standard Kaiser-Squires transformation, and compared to observations at the field level. The posterior distribution of maps given the shear data is sampled using Hamiltonian Monte Carlo chains. Our work improves on the original algorithm by making it numerically efficient, enabling full-sky reconstructions at $\approx$ 7 arcmin resolution with modest computational resources. These gains are made with no loss in accuracy or precision relative to KaRMMa 1.0. We compare the KaRMMa 2.0 posteriors against simulations across a variety of summary statistics (one-point function, two-point functions, and peak/void counts) to demonstrate our updated algorithm provides an accurate reconstruction of the convergence field at mildly non-linear scales. Unsurprisingly, the lognormal model fails as we approach non-linear scales ($\ell \gtrsim 200$), which in turn biases the map posteriors. These biases are at the 2% level in the recovered power spectrum, and at the 5% to 15% level for other statistics, depending on the resolution.


title: Instantaneous convexity breaking for the quasi-static droplet model

abstract: We consider a well-known quasi-static model for the shape of a liquid droplet. The solution can be described in terms of time-evolving domains in $\mathbb{R}^n$. We give an example to show that convexity of the domain can be instantaneously broken.


title: Bridging the Gap Between Target Networks and Functional Regularization

abstract: Bootstrapping is behind much of the successes of Deep Reinforcement Learning. However, learning the value function via bootstrapping often leads to unstable training due to fast-changing target values. Target Networks are employed to stabilize training by using an additional set of lagging parameters to estimate the target values. Despite the popularity of Target Networks, their effect on the optimization is still misunderstood. In this work, we show that they act as an implicit regularizer. This regularizer has disadvantages such as being inflexible and non convex. To overcome these issues, we propose an explicit Functional Regularization that is a convex regularizer in function space and can easily be tuned. We analyze the convergence of our method theoretically and empirically demonstrate that replacing Target Networks with the more theoretically grounded Functional Regularization approach leads to better sample efficiency and performance improvements.


title: Draft, Sketch, and Prove: Guiding Formal Theorem Provers with Informal Proofs

abstract: The formalization of existing mathematical proofs is a notoriously difficult process. Despite decades of research on automation and proof assistants, writing formal proofs remains arduous and only accessible to a few experts. While previous studies to automate formalization focused on powerful search algorithms, no attempts were made to take advantage of available informal proofs. In this work, we introduce Draft, Sketch, and Prove (DSP), a method that maps informal proofs to formal proof sketches, and uses the sketches to guide an automated prover by directing its search to easier sub-problems. We investigate two relevant setups where informal proofs are either written by humans or generated by a language model. Our experiments and ablation studies show that large language models are able to produce well-structured formal sketches that follow the same reasoning steps as the informal proofs. Guiding an automated prover with these sketches enhances its performance from 20.9% to 39.3% on a collection of mathematical competition problems.


title: Scalable Measurement Error Mitigation via Iterative Bayesian Unfolding

abstract: Measurement error mitigation (MEM) techniques are postprocessing strategies to counteract systematic read-out errors on quantum computers (QC). Currently used MEM strategies face a tradeoff: methods that scale well with the number of qubits return negative probabilities, while those that guarantee a valid probability distribution are not scalable. Here, we present a scheme that addresses both of these issues. In particular, we present a scalable implementation of iterative Bayesian unfolding, a standard mitigation technique used in high-energy physics experiments. We demonstrate our method by mitigating QC data from experimental preparation of Greenberger-Horne-Zeilinger (GHZ) states up to 127 qubits and implementation of the Bernstein-Vazirani algorithm on up to 26 qubits.


title: Exploring Representation-Level Augmentation for Code Search

abstract: Code search, which aims at retrieving the most relevant code fragment for a given natural language query, is a common activity in software development practice. Recently, contrastive learning is widely used in code search research, where many data augmentation approaches for source code (e.g., semantic-preserving program transformation) are proposed to learn better representations. However, these augmentations are at the raw-data level, which requires additional code analysis in the preprocessing stage and additional training costs in the training stage. In this paper, we explore augmentation methods that augment data (both code and query) at representation level which does not require additional data processing and training, and based on this we propose a general format of representation-level augmentation that unifies existing methods. Then, we propose three new augmentation methods (linear extrapolation, binary interpolation, and Gaussian scaling) based on the general format. Furthermore, we theoretically analyze the advantages of the proposed augmentation methods over traditional contrastive learning methods on code search. We experimentally evaluate the proposed representation-level augmentation methods with state-of-the-art code search models on a large-scale public dataset consisting of six programming languages. The experimental results show that our approach can consistently boost the performance of the studied code search models. Our source code is available at https://github.com/Alex-HaochenLi/RACS.


title: On Pointwise convergence of the non-linear Fourier transform

abstract: A. Poltotaski proved an analog of Carleson's Theorem on almost everywhere convergence of Fourier series for a version of the non-linear Fourier transform. We aim to present his proof in full detail and elaborate on the ideas behind each step.


title: Searching for structure in the binary black hole spin distribution

abstract: The spins of black holes in merging binaries can reveal information related to the formation and evolution of these systems through their gravitational wave emission. Combining events to infer the astrophysical distribution of black hole spins allows us to determine the relative contribution from different formation scenarios to the population. Many previous works have modeled spin population distributions using parametric models. While these are valuable approaches when the observed population is small, they make strong assumptions about the shape of the underlying distribution and are highly susceptible to biases due to mismodeling. The results obtained with such parametric models are only valid if the allowed shape of the distribution is well-motivated (i.e. for astrophysical reasons). In this work, we relax these prior assumptions and model the spin distributions using a more data-driven approach, modeling these distributions with flexible cubic spline interpolants in order to allow for capturing structures that the parametric models cannot. We find that adding this flexibility to the model substantially increases the uncertainty in the inferred distributions, but find a general trend for lower support at high spin magnitude and a spin tilt distribution consistent with isotropic orientations. We infer that 62 - 87% of black holes have spin magnitudes less than a = 0.5, and 27- 50% of black holes exhibit negative $\chi_{\rm eff}$. Using the inferred $\chi_{\rm eff}$ distribution, we place a conservative upper limit of 37% for the contribution of hierarchical mergers to the astrophysical BBH population. Additionally, we find that artifacts from unconverged Monte Carlo integrals in the likelihood can manifest as spurious peaks and structures in inferred distributions, mandating the use of a sufficient number of samples when using Monte Carlo integration for population inference.


title: Learning Ultrametric Trees for Optimal Transport Regression

abstract: Optimal transport provides a metric which quantifies the dissimilarity between probability measures. For measures supported in discrete metric spaces, finding the optimal transport distance has cubic time complexity in the size of the space. However, measures supported on trees admit a closed-form optimal transport that can be computed in linear time. In this paper, we aim to find an optimal tree structure for a given discrete metric space so that the tree-Wasserstein distance approximates the optimal transport distance in the original space. One of our key ideas is to cast the problem in ultrametric spaces. This helps us optimize over the space of ultrametric trees -- a mixed-discrete and continuous optimization problem -- via projected gradient decent over the space of ultrametric matrices. During optimization, we project the parameters to the ultrametric space via a hierarchical minimum spanning tree algorithm, equivalent to the closest projection to ultrametrics under the supremum norm. Experimental results on real datasets show that our approach outperforms previous approaches (e.g. Flowtree, Quadtree) in approximating optimal transport distances. Finally, experiments on synthetic data generated on ground truth trees show that our algorithm can accurately uncover the underlying trees.


title: Complexity and Ramsey Largeness of Sets of Oracles Separating Complexity Classes

abstract: We prove two sets of results concerning computational complexity classes. The first concerns a variation of the random oracle hypothesis posed by Bennett and Gill after they showed that relative to a randomly chosen oracle, P not equal NP with probability 1. This hypothesis was quickly disproven in several ways, most famously in 1992 with the result that IP equals PSPACE, in spite of the classes being shown unequal with probability 1. Here we propose a variation of what it means to be ``large'' using the Ellentuck topology. In this new context, we demonstrate that the set of oracles separating NP and co-NP is not small, and obtain similar results for the separation of PSPACE from PH along with the separation of NP from BQP. We demonstrate that this version of the hypothesis turns it into a sufficient condition for unrelativized relationships, at least in the three cases considered here. Second, we example the descriptive complexity of the classes of oracles providing the separations for these various classes, and determine their exact placement in the Borel hierarchy.


title: Monochromatic products and sums in the rationals

abstract: We show that for every coloring of the rationals into finitely many colors, one of the colors contains a set of the form $\{x,y,xy,x+y\}$ for some nonzero $x$ and $y$.


title: Rainbow Connection for Complete Multipartite Graphs

abstract: A path in an edge-colored graph is said to be rainbow if no color repeats on it. An edge-colored graph is said to be rainbow $k$-connected if every pair of vertices is connected by $k$ internally disjoint rainbow paths. The rainbow $k$-connection number $\mathrm{rc}_k(G)$ is the minimum number of colors $\ell$ such that there exists a coloring with $\ell$ colors that makes $G$ rainbow $k$-connected. Let $f(k,t)$ be the minimum integer such that every $t$-partite graph with part sizes at least $f(k,t)$ has $\mathrm{rc}_k(G) \le 4$ if $t=2$ and $\mathrm{rc}_k(G) \le 3$ if $t \ge 3$. Answering a question of Fujita, Liu and Magnant, we show that \[ f(k,t) = \left\lceil \frac{2k}{t-1} \right\rceil \] for all $k\geq 2$, $t\geq 2$. We also give some conditions for which $\mathrm{rc}_k(G) \le 3$ if $t=2$ and $\mathrm{rc}_k(G) \le 2$ if $t \ge 3$.


title: The moduli space of holomorphic chains of rank one over a compact Riemann surface

abstract: A holomorphic chain on a compact Riemann surface is a tuple of vector bundles together with homomorphisms between them. We show that the moduli space of holomorphic chains of rank one is identified with a fiber product of projective space bundles. We compute the Euler characteristic of the moduli space. The stability of chains involves real vector parameters. We also show that the variation of parameters corresponds to the characters of Gm.


title: DL-Corrector-Remapper: A grid-free bias-correction deep learning methodology for data-driven high-resolution global weather forecasting

abstract: Data-driven models, such as FourCastNet (FCN), have shown exemplary performance in high-resolution global weather forecasting. This performance, however, is based on supervision on mesh-gridded weather data without the utilization of raw climate observational data, the gold standard ground truth. In this work we develop a methodology to correct, remap, and fine-tune gridded uniform forecasts of FCN so it can be directly compared against observational ground truth, which is sparse and non-uniform in space and time. This is akin to bias correction and post-processing of numerical weather prediction (NWP), a routine operation at meteorological and weather forecasting centers across the globe. The Adaptive Fourier Neural Operator (AFNO) architecture is used as the backbone to learn continuous representations of the atmosphere. The spatially and temporally non-uniform output is evaluated by the non-uniform discrete inverse Fourier transform (NUIDFT) given the output query locations. We call this network the Deep-Learning-Corrector-Remapper (DLCR). The improvement in DLCR's performance against the gold standard ground truth over the baseline's performance shows its potential to correct, remap, and fine-tune the mesh-gridded forecasts under the supervision of observations.


title: Bayesian inference is facilitated by modular neural networks with different time scales

abstract: Various animals, including humans, have been suggested to perform Bayesian inferences to handle noisy, time-varying external information. In performing Bayesian inference, the prior distribution must be shaped by sampling noisy external inputs. However, the mechanism by which neural activities represent such distributions has not yet been elucidated. In this study, we demonstrated that the neural networks with modular structures including fast and slow modules effectively represented the prior distribution in performing accurate Bayesian inferences. Using a recurrent neural network consisting of a main module connected with input and output layers and a sub-module connected only with the main module and having slower neural activity, we demonstrated that the modular network with distinct time scales performed more accurate Bayesian inference compared with the neural networks with uniform time scales. Prior information was represented selectively by the slow sub-module, which could integrate observed signals over an appropriate period and represent input means and variances. Accordingly, the network could effectively predict the time-varying inputs. Furthermore, by training the time scales of neurons starting from networks with uniform time scales and without modular structure, the above slow-fast modular network structure spontaneously emerged as a result of learning wherein prior information was selectively represented in the slower sub-module. These results explain how the prior distribution for Bayesian inference is represented in the brain, provide insight into the relevance of modular structure with time scale hierarchy to information processing, and elucidate the significance of brain areas with slower time scales.


title: Accessing gluon polarization with high-$P_T$ hadrons in SIDIS

abstract: A recent global QCD analysis of jet production and other polarized scattering data has found the presence of negative solutions for the gluon helicity distribution in the proton, $\Delta g$, along with the traditional $\Delta g > 0$ solutions. We consider polarized semi-inclusive deep-inelastic scattering for hadrons produced with large transverse momentum as a means of constraining the dependence of $\Delta g$ on the parton momentum fraction, $x$. Focusing on the double longitudinal spin asymmetry, we identify the kinematics relevant for future experiments at Jefferson Lab and the Electron-Ion Collider which are particularly sensitive to the polarized gluon channel and could discriminate between the different $\Delta g$ behaviors.


title: Feature selection intelligent algorithm with mutual information and steepest ascent strategy

abstract: Remote sensing is a higher technology to produce knowledge for data mining applications. In principle hyperspectral images (HSIs) is a remote sensing tool that provides precise classification of regions. The HSI contains more than a hundred of images of the ground truth (GT) map. Some images are carrying relevant information, but others describe redundant information, or they are affected by atmospheric noise. The aim is to reduce dimensionality of HSI. Many studies use mutual information (MI) or normalised forms of MI to select appropriate bands. In this paper we design an algorithm based also on MI, and we combine MI with steepest ascent algorithm, to improve a symmetric uncertainty coefficient-based strategy to select relevant bands for classification of HSI. This algorithm is a feature selection tool and a wrapper strategy. We perform our study on HSI AVIRIS 92AV3C. This is an artificial intelligent system to control redundancy; we had to clear the difference of the result's algorithm and the human decision, and this can be viewed as case study which human decision is perhaps different to an intelligent algorithm. Index Terms - Hyperspectral images, Classification, Fea-ture selection, Mutual Information, Redundancy, Steepest Ascent. Artificial Intelligence


title: An Adaptive Strain Estimation Algorithm Using Short Term Cross Correlation Kernels and 1.5D Lateral Search

abstract: Adaptive stretching, where the post compression signal is iteratively stretched to maximize the correlation between the pre and post compression rf echo frames, has demonstrated superior performance compared to gradient based methods. At higher levels of applied strain however, adaptive stretching suffers from decorrelation noise and the image quality deteriorates significantly. Reducing the size of correlation windows have previously showed to enhance the performance in a speckle tracking algorithm but a correlation filter was required to prevent peak hopping errors. In this paper, we present a novel strain estimation algorithm which utilizes an array of overlapping short term cross correlation kernels which are about one-fourth the size of a typical large kernel, to implement an adaptive stretching algorithm. Our method does not require any supplementary correlation filter to prevent false peak errors. Additionally, a lateral search is incorporated using 1.5D algorithm to account for the mechanically induced lateral shift. To validate the efficacy of our proposed method we analyzed the results using simulation and in-vivo data of breast tumors. Our proposed method demonstrated a superior performance compared to classical adaptive stretching algorithm in both qualitative and quantitative assessment. Strain SNRe, CNRe and image resolution are found to improve significantly. Lesion's shape and boundary are more clearly depicted. The results of improvement are clearly evident at higher levels of applied strain.


title: VRContour: Bringing Contour Delineations of Medical Structures Into Virtual Reality

abstract: Contouring is an indispensable step in Radiotherapy (RT) treatment planning. However, today's contouring software is constrained to only work with a 2D display, which is less intuitive and requires high task loads. Virtual Reality (VR) has shown great potential in various specialties of healthcare and health sciences education due to the unique advantages of intuitive and natural interactions in immersive spaces. VR-based radiation oncology integration has also been advocated as a target healthcare application, allowing providers to directly interact with 3D medical structures. We present VRContour and investigate how to effectively bring contouring for radiation oncology into VR. Through an autobiographical iterative design, we defined three design spaces focused on contouring in VR with the support of a tracked tablet and VR stylus, and investigating dimensionality for information consumption and input (either 2D or 2D + 3D). Through a within-subject study (n = 8), we found that visualizations of 3D medical structures significantly increase precision, and reduce mental load, frustration, as well as overall contouring effort. Participants also agreed with the benefits of using such metaphors for learning purposes.


title: Blow up analysis for Keller-Segel system

abstract: In this paper we develop a blow up theory for the parabolic-elliptic Keller-Segel system, which can be viewed as a parabolic counterpart to the Liouville equation. This theory is applied to the study of first time singularities, ancient solutions and entire solutions, leading to a description of the blow up limit in the first problem, and the large scale structure in the other two problems.


title: BEANS: The Benchmark of Animal Sounds

abstract: The use of machine learning (ML) based techniques has become increasingly popular in the field of bioacoustics over the last years. Fundamental requirements for the successful application of ML based techniques are curated, agreed upon, high-quality datasets and benchmark tasks to be learned on a given dataset. However, the field of bioacoustics so far lacks such public benchmarks which cover multiple tasks and species to measure the performance of ML techniques in a controlled and standardized way and that allows for benchmarking newly proposed techniques to existing ones. Here, we propose BEANS (the BEnchmark of ANimal Sounds), a collection of bioacoustics tasks and public datasets, specifically designed to measure the performance of machine learning algorithms in the field of bioacoustics. The benchmark proposed here consists of two common tasks in bioacoustics: classification and detection. It includes 12 datasets covering various species, including birds, land and marine mammals, anurans, and insects. In addition to the datasets, we also present the performance of a set of standard ML methods as the baseline for task performance. The benchmark and baseline code is made publicly available at \url{https://github.com/earthspecies/beans} in the hope of establishing a new standard dataset for ML-based bioacoustic research.


title: Continual Vision-based Reinforcement Learning with Group Symmetries

abstract: Continual reinforcement learning aims to sequentially learn a variety of tasks, retaining the ability to perform previously encountered tasks while simultaneously developing new policies for novel tasks. However, current continual RL approaches overlook the fact that certain tasks are identical under basic group operations like rotations or translations, especially with visual inputs. They may unnecessarily learn and maintain a new policy for each similar task, leading to poor sample efficiency and weak generalization capability. To address this, we introduce a unique Continual Vision-based Reinforcement Learning method that recognizes Group Symmetries, called COVERS, cultivating a policy for each group of equivalent tasks rather than individual tasks. COVERS employs a proximal policy optimization-based RL algorithm with an equivariant feature extractor and a novel task grouping mechanism that relies on the extracted invariant features. We evaluate COVERS on sequences of table-top manipulation tasks that incorporate image observations and robot proprioceptive information in both simulations and on real robot platforms. Our results show that COVERS accurately assigns tasks to their respective groups and significantly outperforms existing methods in terms of generalization capability.


title: What do Large Language Models Learn beyond Language?

abstract: Large language models (LMs) have rapidly become a mainstay in Natural Language Processing. These models are known to acquire rich linguistic knowledge from training on large amounts of text. In this paper, we investigate if pre-training on text also confers these models with helpful `inductive biases' for non-linguistic reasoning. On a set of 19 diverse non-linguistic tasks involving quantitative computations, recognizing regular expressions and reasoning over strings. We find that pretrained models significantly outperform comparable non-pretrained neural models. This remains true also in experiments with training non-pretrained models with fewer parameters to account for model regularization effects. We further explore the effect of text domain on LMs by pretraining models from text from different domains and provenances. Our experiments surprisingly reveal that the positive effects of pre-training persist even when pretraining on multi-lingual text or computer code, and even for text generated from synthetic languages. Our findings suggest a hitherto unexplored deep connection between pre-training and inductive learning abilities of language models.


title: Characteristics of distributions of sets and their $(R)$- and $(N)$-denseness

abstract: Let $0\leq q\leq1$ and $\mathbb{N}$ denotes the set of all positive integers. In this paper we will deal with it too the family $\mathcal{U}(x^q)$ of all regularly distributed set $X \subset \mathbb{N}$ whose ratio block sequence is asymptotically distributed with distribution function $g(x) = x^q;\ x \in(0,1]$, and we will show that the regular distributed set, regular sequences, regular variation at infinity are equivalent notations. In this paper also we discuss the relation ship between notations as (N)-denseness, directions sets, generalized ratio sets, dispersion of sequence and exponent of convergence.


title: Cayley graphs of R. Thompson's group F: new estimates for the density

abstract: We improve some known estimates for the density of the Cayley graph of Thompson's group F in standard generators.


title: The impact of spin-kick alignment on the inferred velocity distribution of isolated pulsars

abstract: The speeds of young isolated pulsars are generally inferred from their observed 2-d velocities on the plane of the sky under the assumption that the unobserved radial velocity is not special, i.e., that the measured 2-d velocity is an isotropic projection of the full 3-d velocity. However, if pulsar spins are preferentially aligned with kicks, then the observer's viewing angle relative to the pulsar velocity vector is in fact special because the direction of the spin impacts the detectability of the pulsar. This means that the measured 2-d velocity of observable pulsars is not an isotropic projection, which affects inference on 3-d velocities. We estimate this effect and conclude that it could lead to a ~15% systematic over-estimate of neutron star natal kicks if young pulsars have high obliquity angles and narrow beams, but the exact correction factor depends on the distribution of beam-spin and spin-kick misalignment angles and beam widths.


title: On the number of genealogical ancestors tracing to the source groups of an admixed population

abstract: In genetically admixed populations, admixed individuals possess ancestry from multiple source groups. Studies of human genetic admixture frequently estimate ancestry components corresponding to fractions of individual genomes that trace to specific ancestral populations. However, the same numerical ancestry fraction can represent a wide array of admixture scenarios. Using a mechanistic model of admixture, we characterize admixture genealogically: how many distinct ancestors from the source populations does the admixture represent? We consider African Americans, for whom continent-level estimates produce a 75-85% value for African ancestry on average and 15-25% for European ancestry. Genetic studies together with key features of African-American demographic history suggest ranges for model parameters. Using the model, we infer that if genealogical lineages of a random African American born during 1960-1965 are traced back until they reach members of source populations, the expected number of genealogical lines terminating with African individuals is 314, and the expected number terminating in Europeans is 51. Across discrete generations, the peak number of African genealogical ancestors occurs for birth cohorts from the early 1700s. The probability exceeds 50% that at least one European ancestor was born more recently than 1835. Our genealogical perspective can contribute to further understanding the admixture processes that underlie admixed populations. For African Americans, the results provide insight both on how many of the ancestors of a typical African American might have been forcibly displaced in the Transatlantic Slave Trade and on how many separate European admixture events might exist in a typical African-American genealogy.


title: BIM can help decarbonize the construction sector: life cycle evidence from Pavement Management Systems

abstract: Transforming the construction sector is key to reaching net-zero, and many stakeholders expect its decarbonization through digitalization. But no quantified evidence has been brought to date. We propose the first environmental quantification of the impact of Building Information Modeling (BIM) in the construction sector. Specifically, the direct and indirect greenhouse gas (GHG) emissions generated by a monofunctional BIM to plan road maintenance, a Pavement Management System (PMS), are evaluated using field data from France. The related carbon footprints are calculated following a life cycle approach, using different sources of data, including ecoinvent v3.6, and the IPCC 2013 GWP 100a characterization factors. Three design-build-maintain pavement alternatives are compared: scenario 1 relates to a massive design and surface maintenance, scenario 2 to a progressive design and pre-planned structural maintenance, and scenario 3 to a progressive design and tailored structural maintenance supported by the PMS. First, results show negligible direct emissions due to the PMS existence: 0.02% of the life cycle emissions of scenario 3. Second, complementary sensitivity analyses show that using a PMS is climate-positive over the life cycle when pavement subgrade bearing capacity improves over time, and climate-neutral otherwise. The GHG emissions savings using BIM can reach up to 30% of the life cycle emissions compared to other scenarios, and 65% when restraining the scope to maintenance and rehabilitation and excluding original pavement construction. Third, the neutral effect of BIM in case of a deterioration of the bearing capacity of the subgrade may be explained by design practices and safety margins, that could be enhanced using BIM. Fourth, the decarbonization potential of a multifunctional BIM is discussed, and research perspectives are presented.


title: PENTATRON: PErsonalized coNText-Aware Transformer for Retrieval-based cOnversational uNderstanding

abstract: Conversational understanding is an integral part of modern intelligent devices. In a large fraction of the global traffic from customers using smart digital assistants, frictions in dialogues may be attributed to incorrect understanding of the entities in a customer's query due to factors including ambiguous mentions, mispronunciation, background noise and faulty on-device signal processing. Such errors are compounded by two common deficiencies from intelligent devices namely, (1) the device not being tailored to individual customers, and (2) the device responses being unaware of the context in the conversation session. Viewing this problem via the lens of retrieval-based search engines, we build and evaluate a scalable entity correction system, PENTATRON. The system leverages a parametric transformer-based language model to learn patterns from in-session customer-device interactions coupled with a non-parametric personalized entity index to compute the correct query, which aids downstream components in reasoning about the best response. In addition to establishing baselines and demonstrating the value of personalized and context-aware systems, we use multitasking to learn the domain of the correct entity. We also investigate the utility of language model prompts. Through extensive experiments, we show a significant upward movement of the key metric (Exact Match) by up to 500.97% (relative to the baseline).


title: Learning a Grammar Inducer from Massive Uncurated Instructional Videos

abstract: Video-aided grammar induction aims to leverage video information for finding more accurate syntactic grammars for accompanying text. While previous work focuses on building systems for inducing grammars on text that are well-aligned with video content, we investigate the scenario, in which text and video are only in loose correspondence. Such data can be found in abundance online, and the weak correspondence is similar to the indeterminacy problem studied in language acquisition. Furthermore, we build a new model that can better learn video-span correlation without manually designed features adopted by previous work. Experiments show that our model trained only on large-scale YouTube data with no text-video alignment reports strong and robust performances across three unseen datasets, despite domain shift and noisy label issues. Furthermore our model yields higher F1 scores than the previous state-of-the-art systems trained on in-domain data.


title: Tools for Extracting Spatio-Temporal Patterns in Meteorological Image Sequences: From Feature Engineering to Attention-Based Neural Networks

abstract: Atmospheric processes involve both space and time. This is why human analysis of atmospheric imagery can often extract more information from animated loops of image sequences than from individual images. Automating such an analysis requires the ability to identify spatio-temporal patterns in image sequences which is a very challenging task, because of the endless possibilities of patterns in both space and time. In this paper we review different concepts and techniques that are useful to extract spatio-temporal context specifically for meteorological applications. In this survey we first motivate the need for these approaches in meteorology using two applications, solar forecasting and detecting convection from satellite imagery. Then we provide an overview of many different concepts and techniques that are helpful for the interpretation of meteorological image sequences, such as (1) feature engineering methods to strengthen the desired signal in the input, using meteorological knowledge, classic image processing, harmonic analysis and topological data analysis (2) explain how different convolution filters (2D/3D/LSTM-convolution) can be utilized strategically in convolutional neural network architectures to find patterns in both space and time (3) discuss the powerful new concept of 'attention' in neural networks and the powerful abilities it brings to the interpretation of image sequences (4) briefly survey strategies from unsupervised, self-supervised and transfer learning to reduce the need for large labeled datasets. We hope that presenting an overview of these tools - many of which are underutilized - will help accelerate progress in this area.


title: Proportionate Recursive Maximum Correntropy Criterion Adaptive Filtering Algorithms and their Performance Analysis

abstract: The maximum correntropy criterion (MCC) has been employed to design outlier-robust adaptive filtering algorithms, among which the recursive MCC (RMCC) algorithm is a typical one. Motivated by the success of our recently proposed proportionate recursive least squares (PRLS) algorithm for sparse system identification, we propose to introduce the proportionate updating (PU) mechanism into the RMCC, leading to two sparsity-aware RMCC algorithms: the proportionate recursive MCC (PRMCC) algorithm and the combinational PRMCC (CPRMCC) algorithm. The CPRMCC is implemented as an adaptive convex combination of two PRMCC filters. For PRMCC, its stability condition and mean-square performance were analyzed. Based on the analysis, optimal parameter selection in nonstationary environments was obtained. Performance study of CPRMCC was also provided and showed that the CPRMCC performs at least as well as the better component PRMCC filter in steady state. Numerical simulations of sparse system identification corroborate the advantage of proposed algorithms as well as the validity of theoretical analysis.


title: Bounded-Regret MPC via Perturbation Analysis: Prediction Error, Constraints, and Nonlinearity

abstract: We study Model Predictive Control (MPC) and propose a general analysis pipeline to bound its dynamic regret. The pipeline first requires deriving a perturbation bound for a finite-time optimal control problem. Then, the perturbation bound is used to bound the per-step error of MPC, which leads to a bound on the dynamic regret. Thus, our pipeline reduces the study of MPC to the well-studied problem of perturbation analysis, enabling the derivation of regret bounds of MPC under a variety of settings. To demonstrate the power of our pipeline, we use it to generalize existing regret bounds on MPC in linear time-varying (LTV) systems to incorporate prediction errors on costs, dynamics, and disturbances. Further, our pipeline leads to regret bounds on MPC in systems with nonlinear dynamics and constraints.


title: A criterion and a Cram\'er-Wold device for quasi-infinite divisibility for discrete multivariate probability laws

abstract: Multivariate discrete probability laws are considered. We show that such laws are quasi-infinitely divisible if and only if their characteristic functions are separated from zero. We generalize the existing results for the univariate discrete laws and for the multivariate laws on $\mathbb{Z}^d$. The Cram\'er-Wold devices for infinite and quasi-infinite divisibility were proved.


title: A Benchmark Study of Contrastive Learning for Arabic Social Meaning

abstract: Contrastive learning (CL) brought significant progress to various NLP tasks. Despite this progress, CL has not been applied to Arabic NLP to date. Nor is it clear how much benefits it could bring to particular classes of tasks such as those involved in Arabic social meaning (e.g., sentiment analysis, dialect identification, hate speech detection). In this work, we present a comprehensive benchmark study of state-of-the-art supervised CL methods on a wide array of Arabic social meaning tasks. Through extensive empirical analyses, we show that CL methods outperform vanilla finetuning on most tasks we consider. We also show that CL can be data efficient and quantify this efficiency. Overall, our work allows us to demonstrate the promise of CL methods, including in low-resource settings.


title: Diffusion Motion: Generate Text-Guided 3D Human Motion by Diffusion Model

abstract: We propose a simple and novel method for generating 3D human motion from complex natural language sentences, which describe different velocity, direction and composition of all kinds of actions. Different from existing methods that use classical generative architecture, we apply the Denoising Diffusion Probabilistic Model to this task, synthesizing diverse motion results under the guidance of texts. The diffusion model converts white noise into structured 3D motion by a Markov process with a series of denoising steps and is efficiently trained by optimizing a variational lower bound. To achieve the goal of text-conditioned image synthesis, we use the classifier-free guidance strategy to fuse text embedding into the model during training. Our experiments demonstrate that our model achieves competitive results on HumanML3D test set quantitatively and can generate more visually natural and diverse examples. We also show with experiments that our model is capable of zero-shot generation of motions for unseen text guidance.


title: Learning Vector-Quantized Item Representation for Transferable Sequential Recommenders

abstract: Recently, the generality of natural language text has been leveraged to develop transferable recommender systems. The basic idea is to employ pre-trained language models~(PLM) to encode item text into item representations. Despite the promising transferability, the binding between item text and item representations might be too tight, leading to potential problems such as over-emphasizing the effect of text features and exaggerating the negative impact of domain gap. To address this issue, this paper proposes VQ-Rec, a novel approach to learning Vector-Quantized item representations for transferable sequential Recommenders. The main novelty of our approach lies in the new item representation scheme: it first maps item text into a vector of discrete indices (called item code), and then employs these indices to lookup the code embedding table for deriving item representations. Such a scheme can be denoted as "text $\Longrightarrow$ code $\Longrightarrow$ representation". Based on this representation scheme, we further propose an enhanced contrastive pre-training approach, using semi-synthetic and mixed-domain code representations as hard negatives. Furthermore, we design a new cross-domain fine-tuning method based on a differentiable permutation-based network. Extensive experiments conducted on six public benchmarks demonstrate the effectiveness of the proposed approach, in both cross-domain and cross-platform settings. Code and pre-trained model are available at: https://github.com/RUCAIBox/VQ-Rec.


title: Attitude Control of Highly Maneuverable Aircraft Using an Improved Q-learning

abstract: Attitude control of a novel regional truss-braced wing aircraft with low stability characteristics is addressed in this paper using Reinforcement Learning (RL). In recent years, RL has been increasingly employed in challenging applications, particularly, autonomous flight control. However, a significant predicament confronting discrete RL algorithms is the dimension limitation of the state-action table and difficulties in defining the elements of the RL environment. To address these issues, in this paper, a detailed mathematical model of the mentioned aircraft is first developed to shape an RL environment. Subsequently, Q-learning, the most prevalent discrete RL algorithm will be implemented in both the Markov Decision Process (MDP), and Partially Observable Markov Decision Process (POMDP) frameworks to control the longitudinal mode of the air vehicle. In order to eliminate residual fluctuations that are a consequence of discrete action selection, and simultaneously track variable pitch angles, a Fuzzy Action Assignment (FAA) method is proposed to generate continuous control commands using the trained Q-table. Accordingly, it will be proved that by defining an accurate reward function, along with observing all crucial states, the performance of the introduced control system surpasses a well-tuned PID controller.


title: Bayesian Detection and Tracking of Odontocetes in 3-D from Their Echolocation Clicks

abstract: Localizing and tracking of marine mammals can reveal key insights into behaviors underwater that otherwise would remain unexplored. A promising nonintrusive approach to obtaining location information of marine mammals is based on recordings of bio-acoustic signals by volumetric hydrophone arrays. Time-difference-of-arrival (TDOA) measurements of echolocation clicks emitted by odontocetes can be extracted and used for detection, localization, and tracking in 3-D. We propose a data processing chain that automatically detects and tracks multiple odontocetes in 3-D from their echolocation clicks. First, TDOA measurements are extracted with a generalized cross-correlation that whitens received acoustic signals based on instrument noise statistics. Subsequently, odontocetes are tracked in the TDOA domain using a graph-based multi-target tracking (MTT) method to reject false TDOA measurements and close gaps of missed detections. The resulting TDOA estimates are then used by another graph-based MTT stage that estimates odontocete tracks in 3-D. The tracking capability of the proposed data processing chain is demonstrated on real acoustic data provided by two volumetric hydrophone arrays that recorded echolocation clicks from Cuvier's beaked whales (Ziphius cavirostris). Simulation results show that the presented 3-D MTT method can outperform an existing approach that relies on hand annotation.


title: The background information about perturbative quantum gravity

abstract: The purpose of this Chapter is to give a general introduction and status review on the perturbative approach to quantum gravity (QG). This text is a modified version of the corresponding chapters of Part II of the recent textbook on quantum field theory (QFT) and QG, co-authored with I.L. Buchbinder and published in Oxford University Press. We discuss the choice of the starting action in the QG models, degrees of freedom and propagator of metric perturbations, power counting and renormalizability of these models, the problems related to higher derivative theories and ghosts, such as quantum unitarity and the stability of classical solutions in general relativity; and the perspective to overcome these problems. The gauge fixing and parametrization dependencies are discussed in detail using the corresponding general QFT theorems developed in gauge theories. On top of that, we present a basic example of deriving the one-loop divergences and discuss an important example of the renormalization group in QG. The gauge invariant renormalizability of QG is considered in another Chapter of the Handbook, written together with P.M. Lavrov.


title: Online Adaptive Policy Selection in Time-Varying Systems: No-Regret via Contractive Perturbations

abstract: We study online adaptive policy selection in systems with time-varying costs and dynamics. We develop the Gradient-based Adaptive Policy Selection (GAPS) algorithm together with a general analytical framework for online policy selection via online optimization. Under our proposed notion of contractive policy classes, we show that GAPS approximates the behavior of an ideal online gradient descent algorithm on the policy parameters while requiring less information and computation. When convexity holds, our algorithm is the first to achieve optimal policy regret. When convexity does not hold, we provide the first local regret bound for online policy selection. Our numerical experiments show that GAPS can adapt to changing environments more quickly than existing benchmarks.


title: A Comprehensive Comparison of Neural Networks as Cognitive Models of Inflection

abstract: Neural networks have long been at the center of a debate around the cognitive mechanism by which humans process inflectional morphology. This debate has gravitated into NLP by way of the question: Are neural networks a feasible account for human behavior in morphological inflection? We address that question by measuring the correlation between human judgments and neural network probabilities for unknown word inflections. We test a larger range of architectures than previously studied on two important tasks for the cognitive processing debate: English past tense, and German number inflection. We find evidence that the Transformer may be a better account of human behavior than LSTMs on these datasets, and that LSTM features known to increase inflection accuracy do not always result in more human-like behavior.


title: Some inequalities on weighted Sobolev spaces, distance weights and the Assouad dimension

abstract: We study certain inequalities and a related result on weighted Sobolev spaces on bounded John domains in $\mathbb{R}^n$. Namely, we prove the existence of a right inverse for the divergence operator, along with the corresponding a priori estimate, the improved and the fractional Poincar\'e inequalities, the Korn inequality and the local Fefferman-Stein inequality. All these results are obtained on weighted Sobolev spaces, where the weight is a power of the distance to the boundary. In all cases the exponent of the weight $d(\cdot,\partial\Omega)^{\beta p}$ is only required to satisfy the restriction: $\beta p>-(n-\dim_A(\partial\Omega))$, where $p$ is the exponent of the Sobolev space and $\dim_A(\partial\Omega)$ is the Assouad dimension of the boundary of the domain. According to our best knowledge, this condition is less restrictive than the ones in the literature.


title: Bergman-Einstein metrics on two-dimensional Stein spaces

abstract: We show that the Bergman metric of the ball quotients $\mathbb{B}^2/\Gamma$, where $\Gamma$ is a finite and fixed point free group, is K\"ahler-Einstein if and only if $\Gamma$ is trivial. As a consequence, we characterize the unit ball $\mathbb{B}^2$, among 2 dimensional Stein spaces with isolated normal singularities, proving an algebraic version of Cheng's conjecture for 2 dimensional Stein spaces.


title: Trustworthy Human Computation: A Survey

abstract: Human computation is an approach to solving problems that prove difficult using AI only, and involves the cooperation of many humans. Because human computation requires close engagement with both "human populations as users" and "human populations as driving forces," establishing mutual trust between AI and humans is an important issue to further the development of human computation. This survey lays the groundwork for the realization of trustworthy human computation. First, the trustworthiness of human computation as computing systems, that is, trust offered by humans to AI, is examined using the RAS (Reliability, Availability, and Serviceability) analogy, which define measures of trustworthiness in conventional computer systems. Next, the social trustworthiness provided by human computation systems to users or participants is discussed from the perspective of AI ethics, including fairness, privacy, and transparency. Then, we consider human--AI collaboration based on two-way trust, in which humans and AI build mutual trust and accomplish difficult tasks through reciprocal collaboration. Finally, future challenges and research directions for realizing trustworthy human computation are discussed.


title: A Grammatical Calculus for Peaks and Runs of Permutations

abstract: We develop a nonstandard approach to exploring polynomials associated with peaks and runs of permutations. With the aid of a context-free grammar, or a set of substitution rules, one can perform a symbolic calculus, and the computation often becomes rather simple. From a grammar it follows at once a system of ordinary differential equations for the generating functions. Utilizing a certain constant property, it is even possible to deduce a single equation for each generating function. To bring the grammar to a combinatorial setting, we find a labeling scheme for up-down runs of a permutation, which can be regarded as a refined property, or the differentiability in a certain sense, in contrast to the usual counting argument for the recurrence relation. The labeling scheme also exhibits how the substitution rules arise in the construction of the combinatorial structures. Consequently, polynomials on peaks and runs can be dealt with in two ways, combinatorially or grammatically. The grammar also serves as a guideline to build a bijection between permutations and increasing trees that maps the number of up-down runs to the number of nonroot vertices of even degree. This correspondence can be adapted to left peaks and exterior peaks, and the key step of the construction is called the reflection principle.


title: Transformer-Based Conditioned Variational Autoencoder for Dialogue Generation

abstract: In human dialogue, a single query may elicit numerous appropriate responses. The Transformer-based dialogue model produces frequently occurring sentences in the corpus since it is a one-to-one mapping function. CVAE is a technique for reducing generic replies. In this paper, we create a new dialogue model (CVAE-T) based on the Transformer with CVAE structure. We use a pre-trained MLM model to rewrite some key n-grams in responses to obtain a series of negative examples, and introduce a regularization term during training to explicitly guide the latent variable in learning the semantic differences between each pair of positive and negative examples. Experiments suggest that the method we design is capable of producing more informative replies.


title: Design and Performance Analysis of a Chemically-Etched Flexible NFC Tag Antenna

abstract: Near Field Communication (NFC) is a perfect example of ubiquitous computing that is secured, short-ranged, low-powered contactless communication. High demand is predicted for NFC, especially with wearables, and the variety of applications may require that this technology be fabricated onto different materials. In this research, we first designed flexible NFC antennas based on mathematical models. A simulation of the NFC coil inductance was performed and verified using the predictive models. Later, two flexible NFC antennas, including 160x80 mm2 (rectangular) and 80x80 mm2 (square) were fabricated through a chemical etching process and verified at 13.56 MHz frequency. Two experiments 1) Read range detection and 2) User experience study on 22 participants validate longer read range and shorter connection time of our fabricated flexible NFC tags.


title: R$^2$F: A General Retrieval, Reading and Fusion Framework for Document-level Natural Language Inference

abstract: Document-level natural language inference (DOCNLI) is a new challenging task in natural language processing, aiming at judging the entailment relationship between a pair of hypothesis and premise documents. Current datasets and baselines largely follow sentence-level settings, but fail to address the issues raised by longer documents. In this paper, we establish a general solution, named Retrieval, Reading and Fusion (R2F) framework, and a new setting, by analyzing the main challenges of DOCNLI: interpretability, long-range dependency, and cross-sentence inference. The basic idea of the framework is to simplify document-level task into a set of sentence-level tasks, and improve both performance and interpretability with the power of evidence. For each hypothesis sentence, the framework retrieves evidence sentences from the premise, and reads to estimate its credibility. Then the sentence-level results are fused to judge the relationship between the documents. For the setting, we contribute complementary evidence and entailment label annotation on hypothesis sentences, for interpretability study. Our experimental results show that R2F framework can obtain state-of-the-art performance and is robust for diverse evidence retrieval methods. Moreover, it can give more interpretable prediction results. Our model and code are released at https://github.com/phoenixsecularbird/R2F.


title: ProGen: Progressive Zero-shot Dataset Generation via In-context Feedback

abstract: Recently, dataset-generation-based zero-shot learning has shown promising results by training a task-specific model with a dataset synthesized from large pre-trained language models (PLMs). The final task-specific model often achieves compatible or even better performance than PLMs under the zero-shot setting, with orders of magnitude fewer parameters. However, synthetic datasets have their drawbacks. They have long been suffering from low-quality issues (e.g., low informativeness and redundancy). This explains why the massive synthetic data does not lead to better performance -- a scenario we would expect in the human-labeled data. To improve the quality of dataset synthesis, we propose a progressive zero-shot dataset generation framework, ProGen, which leverages the feedback from the task-specific model to guide the generation of new training data via in-context examples. Extensive experiments on five text classification datasets demonstrate the effectiveness of the proposed approach. We also show ProGen achieves on-par or superior performance with only 1\% synthetic dataset size compared to baseline methods without in-context feedback.


title: Salience Allocation as Guidance for Abstractive Summarization

abstract: Abstractive summarization models typically learn to capture the salient information from scratch implicitly. Recent literature adds extractive summaries as guidance for abstractive summarization models to provide hints of salient content and achieves better performance. However, extractive summaries as guidance could be over strict, leading to information loss or noisy signals. Furthermore, it cannot easily adapt to documents with various abstractiveness. As the number and allocation of salience content pieces vary, it is hard to find a fixed threshold deciding which content should be included in the guidance. In this paper, we propose a novel summarization approach with a flexible and reliable salience guidance, namely SEASON (SaliencE Allocation as Guidance for Abstractive SummarizatiON). SEASON utilizes the allocation of salience expectation to guide abstractive summarization and adapts well to articles in different abstractiveness. Automatic and human evaluations on two benchmark datasets show that the proposed method is effective and reliable. Empirical results on more than one million news articles demonstrate a natural fifteen-fifty salience split for news article sentences, providing a useful insight for composing news articles.


title: Deep Multi-Branch CNN Architecture for Early Alzheimer's Detection from Brain MRIs

abstract: Alzheimer's disease (AD) is a neuro-degenerative disease that can cause dementia and result severe reduction in brain function inhibiting simple tasks especially if no preventative care is taken. Over 1 in 9 Americans suffer from AD induced dementia and unpaid care for people with AD related dementia is valued at $271.6 billion. Hence, various approaches have been developed for early AD diagnosis to prevent its further progression. In this paper, we first review other approaches that could be used for early detection of AD. We then give an overview of our dataset that was from the Alzheimer's Disease Neuroimaging Initiative (ADNI) and propose a deep Convolutional Neural Network (CNN) architecture consisting of 7,866,819 parameters. This model has three different convolutional branches with each having a different length. Each branch is comprised of different kernel sizes. This model can predict whether a patient is non-demented, mild-demented, or moderately demented with a 99.05% three class accuracy.


title: Multiple Stellar Populations of Globular Clusters From Homogeneous Ca-CN-CH-NH Photometry. VII. Metal-Poor Populations in 47 Tucanae (NGC 104)

abstract: We present new large field-of-view ($\sim$1\deg$\times$1\deg) Ca-CN photometry of the prototypical metal-rich globular cluster 47 Tucanae (NGC 104). Our results are the following. (1) The populational number ratios of the red giant branch (RGB) and red horizontal branch (RHB) are in excellent agreement: n(CN-w):n(CN-s) = 30:70 ($\pm$1--2), where the CN-w and CN-s stand for the CN-weak and CN-strong populations, respectively. Both the CN-s RGB and RHB populations are more centrally concentrated than those of CN-w populations are. (2) Our photometric metallicities of individual RGB stars in each population can be well described by bimodal distributions with two metallicity peaks, [Fe/H] $\sim$ $-$0.72 and $-$0.92 dex, where the metal-poor components occupy $\sim$ 13% of the total RGB stars. The metal-poor populations are more significantly centrally concentrated than the metal-rich populations, showing a similar result that we found in M3. (3) The RGB bump $V$ magnitudes of individual populations indicate that there is no difference in the helium abundance between the two metal-poor populations, while the helium enhancement of $\Delta Y$ $\sim$ 0.02--0.03 is required between the the two metal-rich populations. (4) The RHB morphology of 47 Tuc appears to support our idea of the bimodal metallicity distribution of the cluster. We suggest that 47 Tuc could be another example of merger remnants of two globular clusters, similar to M3 and M22.


title: Accumulated Trivial Attention Matters in Vision Transformers on Small Datasets

abstract: Vision Transformers has demonstrated competitive performance on computer vision tasks benefiting from their ability to capture long-range dependencies with multi-head self-attention modules and multi-layer perceptron. However, calculating global attention brings another disadvantage compared with convolutional neural networks, i.e. requiring much more data and computations to converge, which makes it difficult to generalize well on small datasets, which is common in practical applications. Previous works are either focusing on transferring knowledge from large datasets or adjusting the structure for small datasets. After carefully examining the self-attention modules, we discover that the number of trivial attention weights is far greater than the important ones and the accumulated trivial weights are dominating the attention in Vision Transformers due to their large quantity, which is not handled by the attention itself. This will cover useful non-trivial attention and harm the performance when trivial attention includes more noise, e.g. in shallow layers for some backbones. To solve this issue, we proposed to divide attention weights into trivial and non-trivial ones by thresholds, then Suppressing Accumulated Trivial Attention (SATA) weights by proposed Trivial WeIghts Suppression Transformation (TWIST) to reduce attention noise. Extensive experiments on CIFAR-100 and Tiny-ImageNet datasets show that our suppressing method boosts the accuracy of Vision Transformers by up to 2.3%. Code is available at https://github.com/xiangyu8/SATA.


title: Adaptive Data Fusion for Multi-task Non-smooth Optimization

abstract: We study the problem of multi-task non-smooth optimization that arises ubiquitously in statistical learning, decision-making and risk management. We develop a data fusion approach that adaptively leverages commonalities among a large number of objectives to improve sample efficiency while tackling their unknown heterogeneities. We provide sharp statistical guarantees for our approach. Numerical experiments on both synthetic and real data demonstrate significant advantages of our approach over benchmarks.


title: Guided contrastive self-supervised pre-training for automatic speech recognition

abstract: Contrastive Predictive Coding (CPC) is a representation learning method that maximizes the mutual information between intermediate latent representations and the output of a given model. It can be used to effectively initialize the encoder of an Automatic Speech Recognition (ASR) model. We present a novel modification of CPC called Guided Contrastive Predictive Coding (GCPC). Our proposed method maximizes the mutual information between representations from a prior-knowledge model and the output of the model being pre-trained, allowing prior knowledge injection during pre-training. We validate our method on 3 ASR tasks: German, French and English. Our method outperforms CPC pre-training on all three datasets, reducing the Word Error Rate (WER) by 4.44%, 6.55% and 15.43% relative on the German, French and English (Librispeech) tasks respectively, compared to training from scratch, while CPC pre-training only brings 2.96%, 1.01% and 14.39% relative WER reduction respectively.


title: Classifying globular clusters and applying them to estimate the mass of the Milky Way

abstract: We combine the kinematics of 159 globular clusters (GCs) provided by the Gaia Early Data Release 3 (EDR3) with other observational data to classify the GCs, and to estimate the mass of the Milky Way (MW). We use the age-metallicity relation, integrals of motion, action space and the GC orbits to identify the GCs as either formed in-situ (Bulge and Disk) or ex situ (via accretion). We find that $45.3\%$ have formed in situ, $38.4\%$ may be related to known merger events: Gaia-Sausage-Enceladus, the Sagittarius dwarf galaxy, the Helmi streams, the Sequoia galaxy, and the Kraken galaxy. We also further identify three new sub-structures associated with the Gaia-Sausage-Enceladus. The remaining $16.3\%$ of GCs are unrelated to the known mergers and thought to be from small accretion events. We select 46 GCs which have radii $8.0<r<37.3$ kpc and obtain the anisotropy parameter $\beta=0.315_{-0.049}^{+0.055}$, which is lower than the recent result using the sample of GCs in Gaia Data Release 2, but still in agreement with it by considering the error bar. By using the same sample, we obtain the MW mass inside the outermost GC as $M(<37.3 kpc)=0.423_{-0.02}^{+0.02}\times10^{12}M_{\odot}$, and the corresponding $M_{200}=1.11_{-0.18}^{+0.25}\times10^{12}M_{\odot}$. The estimated mass is consistent with the results in many recent studies. We also find that the estimated $\beta$ and mass depend on the selected sample of GCs. However, it is difficult to determine whether a GC fully traces the potential of the MW.


title: Electron charge qubits with 0.1 millisecond coherence time

abstract: Electron charge qubits are compelling candidates for solid-state quantum computing because of their inherent simplicity in qubit design, fabrication, control, and readout. However, all existing electron charge qubits, built upon conventional semiconductors and superconductors, suffer from severe charge noise that limits the coherence time to the order of 1 microsecond. Here, we report our experimental realization of ultralong-coherence electron charge qubits, based upon isolated single electrons trapped on an ultraclean solid neon surface in vacuum. Quantum information is encoded in the motional states of an electron that is strongly coupled with microwave photons in an on-chip superconducting resonator. The measured relaxation time $T_1$ and coherence time $T_2$ are both on the order of 0.1 milliseconds. The single-shot readout fidelity without using a quantum-limited amplifier is 98.1%. The average single-qubit gate fidelity using Clifford-based randomized benchmarking is 99.97%. Simultaneous strong coupling of two qubits with the same resonator is demonstrated, as a first step toward two-qubit entangling gates for universal quantum computing. These results manifest that the electron-on-solid-neon (eNe) charge qubits outperform all existing charge qubits to date and rival state-of-the-art superconducting transmon qubits, offering an appealing platform for quantum computing.

categories: quant-ph cond-mat.mes-hall cond-mat.mtrl-sci cond-mat.quant-gas cond-mat.supr-con


title: Open-domain Question Answering via Chain of Reasoning over Heterogeneous Knowledge

abstract: We propose a novel open-domain question answering (ODQA) framework for answering single/multi-hop questions across heterogeneous knowledge sources. The key novelty of our method is the introduction of the intermediary modules into the current retriever-reader pipeline. Unlike previous methods that solely rely on the retriever for gathering all evidence in isolation, our intermediary performs a chain of reasoning over the retrieved set. Specifically, our method links the retrieved evidence with its related global context into graphs and organizes them into a candidate list of evidence chains. Built upon pretrained language models, our system achieves competitive performance on two ODQA datasets, OTT-QA and NQ, against tables and passages from Wikipedia. In particular, our model substantially outperforms the previous state-of-the-art on OTT-QA with an exact match score of 47.3 (45 % relative gain).


title: P$^3$LM: Probabilistically Permuted Prophet Language Modeling for Generative Pre-Training

abstract: Conventional autoregressive left-to-right (L2R) sequence generation faces two issues during decoding: limited to unidirectional target sequence modeling, and constrained on strong local dependencies. To address the aforementioned problem, we propose P$^3$LM, a probabilistically permuted prophet language model, which strengthens the modeling of bidirectional information and long token dependencies for sequence generation. Specifically, P$^3$LM learns to generate tokens in permuted order upon an order-aware transformer decoder, as well as to generate the corresponding future $N$ tokens with a multi-stream attention mechanism. Extensive experiments are conducted on the GLGE benchmark, which includes four datasets for summarization, two for question generation, one for conversational question answering, and one for dialog response generation, where P$^3$LM achieves state-of-the-art results compared with strong publicly available generative pre-training methods.


title: Uniform shear flow via the Boltzmann equation with hard potentials

abstract: The motion of rarefied gases for uniform shear flow at the kinetic level is governed by the spatially homogeneous Boltzmann equation with a deformation force. In the paper we study the corresponding Cauchy problem with initial data of finite mass and energy for the collision kernel in case of hard potentials $0<\gamma\leq 1$ under the cutoff assumption. We prove the global existence and large time behavior of solutions provided that the force strength $\alpha>0$ is small enough. In particular, when the initial perturbation is of order $\alpha^m$ for $m>2$, we make a rigorous justification of the uniform-in-time asymptotic expansion of solutions up to order $\alpha^2$ under a homoenergetic self-similar scaling that can capture the increase of temperature $\theta(t)\sim (1+\gamma \varrho_0\alpha^2 t)^{2/\gamma}$ when time tends to infinity, where $\varrho_0>0$ is a strictly positive constant depending only on the deformation force and the linearized collision operator. Specifically, we establish $$ \theta^{3/2}(t)F(t,\theta^{1/2}(t)v)= \mu+\alpha \sqrt{\mu} G_1(t,v)+\alpha^2 \sqrt{\mu}G_2(t,v)+O(1)\alpha^m(1+\gamma \varrho_0\alpha^2 t)^{-2} $$ as $t\to\infty$, where $\mu$ is a global Maxwellian and $G_1,G_2$ are microscopic bounded functions that can be explicitly determined and decay in time as $G_1\sim (1+\gamma \varrho_0\alpha^2 t)^{-1}$ and $G_2\sim (1+\gamma \varrho_0\alpha^2 t)^{-2}$.


title: Two-dimensional natural hyperbolic materials: From polaritons modulation to applications

abstract: Natural hyperbolic materials (HMs) in two dimensions (2D) have an extraordinarily high anisotropy and a hyperbolic dispersion relation. Some of them can even sustain hyperbolic polaritons with great directional propagation and light compression to deeply sub-wavelength scales due to their inherent anisotropy. Herein, the anisotropic optical features of 2D natural HMs are reviewed. Four hyperbolic polaritons (i.e., phonon polaritons, plasmon polaritons, exciton-polaritons, and shear polaritons) as well as their generation mechanism are discussed in detail. The natural merits of 2D HMs hold promise for practical quantum photonic applications such as valley quantum interference, mid-infrared polarizer, spontaneous emission enhancement, near-field thermal radiation, and a new generation of optoelectronic components, among others. These analyses' conclusion outlines existing issues and potential interesting directions for 2D natural HMs. These findings could spur more interest in anisotropic 2D atomic crystals in the future, as well as the quick generation of natural HMs for new applications.


title: Detection of Risk Predictors of COVID-19 Mortality with Classifier Machine Learning Models Operated with Routine Laboratory Biomarkers

abstract: Early evaluation of patients who require special care and who have high death-expectancy in COVID-19, and the effective determination of relevant biomarkers on large sample-groups are important to reduce mortality. This study aimed to reveal the routine blood-value predictors of COVID-19 mortality and to determine the lethal-risk levels of these predictors during the disease process. The dataset of the study consists of 38 routine blood-values of 2597 patients who died (n = 233) and those who recovered (n = 2364) from COVID-19 in August-December, 2021. In this study, the histogram-based gradient-boosting (HGB) model was the most successful machine-learning classifier in detecting living and deceased COVID-19 patients (with squared F1 metrics F1^2 = 1). The most efficient binary combinations with procalcitonin were obtained with D-dimer, ESR, D-Bil and ferritin. The HGB model operated with these feature pairs correctly detected almost all of the patients who survived and those who died (precision > 0.98, recall > 0.98, F1^2 > 0.98). Furthermore, in the HGB model operated with a single feature, the most efficient features were procalcitonin (F1^2 = 0.96) and ferritin (F1^2 = 0.91). In addition, according to the two-threshold approach, ferritin values between 376.2 mkg/L and 396.0 mkg/L (F1^2 = 0.91) and pro-calcitonin values between 0.2 mkg/L and 5.2 mkg/L (F1^2 = 0.95) were found to be fatal risk levels for COVID-19. Considering all the results, we suggest that many features combined with these features, especially procalcitonin and ferritin, operated with the HGB model, can be used to achieve very successful results in the classification of those who live, and those who die from COVID-19. Moreover, we strongly recommend that clinicians consider the critical levels we have found for procalcitonin and ferritin properties, to reduce the lethality of the COVID-19 disease.


title: Stochastic Qubit Resource Allocation for Quantum Cloud Computing

abstract: Quantum cloud computing is a promising paradigm for efficiently provisioning quantum resources (i.e., qubits) to users. In quantum cloud computing, quantum cloud providers provision quantum resources in reservation and on-demand plans for users. Literally, the cost of quantum resources in the reservation plan is expected to be cheaper than the cost of quantum resources in the on-demand plan. However, quantum resources in the reservation plan have to be reserved in advance without information about the requirement of quantum circuits beforehand, and consequently, the resources are insufficient, i.e., under-reservation. Hence, quantum resources in the on-demand plan can be used to compensate for the unsatisfied quantum resources required. To end this, we propose a quantum resource allocation for the quantum cloud computing system in which quantum resources and the minimum waiting time of quantum circuits are jointly optimized. Particularly, the objective is to minimize the total costs of quantum circuits under uncertainties regarding qubit requirement and minimum waiting time of quantum circuits. In experiments, practical circuits of quantum Fourier transform are applied to evaluate the proposed qubit resource allocation. The results illustrate that the proposed qubit resource allocation can achieve the optimal total costs.


title: Systematic KMTNet Planetary Anomaly Search, Paper VII: Complete Sample of $q < 10^{-4}$ Planets from the First Four-Year Survey

abstract: We present the analysis of seven microlensing planetary events with planet/host mass ratios $q < 10^{-4}$: KMT-2017-BLG-1194, KMT-2017-BLG-0428, KMT-2019-BLG-1806, KMT-2017-BLG-1003, KMT-2019-BLG-1367, OGLE-2017-BLG-1806, and KMT-2016-BLG-1105. They were identified by applying the Korea Microlensing Telescope Network (KMTNet) AnomalyFinder algorithm to 2016--2019 KMTNet events. A Bayesian analysis indicates that all the lens systems consist of a cold super-Earth orbiting an M or K dwarf. Together with 17 previously published and three that will be published elsewhere, AnomalyFinder has found a total of 27 planets that have solutions with $q < 10^{-4}$ from 2016--2019 KMTNet events, which lays the foundation for the first statistical analysis of the planetary mass-ratio function based on KMTNet data. By reviewing the 27 planets, we find that the missing planetary caustics problem in the KMTNet planetary sample has been solved by AnomalyFinder. We also find a desert of high-magnification planetary signals ($A \gtrsim 65$), and a follow-up project for KMTNet high-magnification events could detect at least two more $q < 10^{-4}$ planets per year and form an independent statistical sample.


title: Neural Sound Field Decomposition with Super-resolution of Sound Direction

abstract: Sound field decomposition predicts waveforms in arbitrary directions using signals from a limited number of microphones as inputs. Sound field decomposition is fundamental to downstream tasks, including source localization, source separation, and spatial audio reproduction. Conventional sound field decomposition methods such as Ambisonics have limited spatial decomposition resolution. This paper proposes a learning-based Neural Sound field Decomposition (NeSD) framework to allow sound field decomposition with fine spatial direction resolution, using recordings from microphone capsules of a few microphones at arbitrary positions. The inputs of a NeSD system include microphone signals, microphone positions, and queried directions. The outputs of a NeSD include the waveform and the presence probability of a queried position. We model the NeSD systems respectively with different neural networks, including fully connected, time delay, and recurrent neural networks. We show that the NeSD systems outperform conventional Ambisonics and DOANet methods in sound field decomposition and source localization on speech, music, and sound events datasets. Demos are available at https://www.youtube.com/watch?v=0GIr6doj3BQ.


title: AI-based Arabic Language and Speech Tutor

abstract: In the past decade, we have observed a growing interest in using technologies such as artificial intelligence (AI), machine learning, and chatbots to provide assistance to language learners, especially in second language learning. By using AI and natural language processing (NLP) and chatbots, we can create an intelligent self-learning environment that goes beyond multiple-choice questions and/or fill in the blank exercises. In addition, NLP allows for learning to be adaptive in that it offers more than an indication that an error has occurred. It also provides a description of the error, uses linguistic analysis to isolate the source of the error, and then suggests additional drills to achieve optimal individualized learning outcomes. In this paper, we present our approach for developing an Artificial Intelligence-based Arabic Language and Speech Tutor (AI-ALST) for teaching the Moroccan Arabic dialect. The AI-ALST system is an intelligent tutor that provides analysis and assessment of students learning the Moroccan dialect at University of Arizona (UA). The AI-ALST provides a self-learned environment to practice each lesson for pronunciation training. In this paper, we present our initial experimental evaluation of the AI-ALST that is based on MFCC (Mel frequency cepstrum coefficient) feature extraction, bidirectional LSTM (Long Short-Term Memory), attention mechanism, and a cost-based strategy for dealing with class-imbalance learning. We evaluated our tutor on the word pronunciation of lesson 1 of the Moroccan Arabic dialect class. The experimental results show that the AI-ALST can effectively and successfully detect pronunciation errors and evaluate its performance by using F_1-score, accuracy, precision, and recall.


title: Quantifying Complexity: An Object-Relations Approach to Complex Systems

abstract: The best way to model, understand, and quantify the information contained in complex systems is an open question in physics, mathematics, and computer science. The uncertain relationship between entropy and complexity further complicates this question. With ideas drawn from the object-relations theory of psychology, this paper develops an object-relations model of complex systems which generalizes to systems of all types, including mathematical operations, machines, biological organisms, and social structures. The resulting Complex Information Entropy (CIE) equation is a robust method to quantify complexity across various contexts. The paper also describes algorithms to iteratively update and improve approximate solutions to the CIE equation, to recursively infer the composition of complex systems, and to discover the connections among objects across different lengthscales and timescales. Applications are discussed in the fields of engineering design, atomic and molecular physics, chemistry, materials science, neuroscience, psychology, sociology, ecology, economics, and medicine.


title: A Task-aware Dual Similarity Network for Fine-grained Few-shot Learning

abstract: The goal of fine-grained few-shot learning is to recognize sub-categories under the same super-category by learning few labeled samples. Most of the recent approaches adopt a single similarity measure, that is, global or local measure alone. However, for fine-grained images with high intra-class variance and low inter-class variance, exploring global invariant features and discriminative local details is quite essential. In this paper, we propose a Task-aware Dual Similarity Network(TDSNet), which applies global features and local patches to achieve better performance. Specifically, a local feature enhancement module is adopted to activate the features with strong discriminability. Besides, task-aware attention exploits the important patches among the entire task. Finally, both the class prototypes obtained by global features and discriminative local patches are employed for prediction. Extensive experiments on three fine-grained datasets demonstrate that the proposed TDSNet achieves competitive performance by comparing with other state-of-the-art algorithms.