title: Exploring Image Augmentations for Siamese Representation Learning with Chest X-Rays

abstract: Image augmentations are quintessential for effective visual representation learning across self-supervised learning techniques. While augmentation strategies for natural imaging have been studied extensively, medical images are vastly different from their natural counterparts. Thus, it is unknown whether common augmentation strategies employed in Siamese representation learning generalize to medical images and to what extent. To address this challenge, in this study, we systematically assess the effect of various augmentations on the quality and robustness of the learned representations. We train and evaluate Siamese Networks for abnormality detection on chest X-Rays across three large datasets (MIMIC-CXR, CheXpert and VinDR-CXR). We investigate the efficacy of the learned representations through experiments involving linear probing, fine-tuning, zero-shot transfer, and data efficiency. Finally, we identify a set of augmentations that yield robust representations that generalize well to both out-of-distribution data and diseases, while outperforming supervised baselines using just zero-shot transfer and linear probes by up to 20%. Our code is available at https://github.com/StanfordMIMI/siaug.


title: Lateralized Learning for Multi-Class Visual Classification Tasks

abstract: The majority of computer vision algorithms fail to find higher-order (abstract) patterns in an image so are not robust against adversarial attacks, unlike human lateralized vision. Deep learning considers each input pixel in a homogeneous manner such that different parts of a ``locality-sensitive hashing table'' are often not connected, meaning higher-order patterns are not discovered. Hence these systems are not robust against noisy, irrelevant, and redundant data, resulting in the wrong prediction being made with high confidence. Conversely, vertebrate brains afford heterogeneous knowledge representation through lateralization, enabling modular learning at different levels of abstraction. This work aims to verify the effectiveness, scalability, and robustness of a lateralized approach to real-world problems that contain noisy, irrelevant, and redundant data. The experimental results of multi-class (200 classes) image classification show that the novel system effectively learns knowledge representation at multiple levels of abstraction making it more robust than other state-of-the-art techniques. Crucially, the novel lateralized system outperformed all the state-of-the-art deep learning-based systems for the classification of normal and adversarial images by 19.05% - 41.02% and 1.36% - 49.22%, respectively. Findings demonstrate the value of heterogeneous and lateralized learning for computer vision applications.


title: Graph rules for recurrent neural network dynamics: extended version

abstract: This is an extended version of our survey article, "Graph rules for recurrent neural network dynamics," to appear in the April 2023 edition of the Notices of the AMS. It includes additional results, derivations, figures, references, and a set of open questions.


title: Machine learning enables robust prediction of thermal boundary conductance of 2D substrate interfaces

abstract: Two-dimensional van der Waals (vdW) materials exhibit a broad palette of unique and superlative properties, including high electrical and thermal conductivities, paired with the ability to exfoliate or grow and transfer single layers onto a variety of substrates thanks to the relatively weak vdW interlayer bonding. However, the same vdW bonds also lead to relatively low thermal boundary conductance (TBC) between the 2D layer and its 3D substrate, which is the main pathway for heat removal and thermal management in devices, leading to a potential thermal bottleneck and dissipation-driven performance degradation. Here we use first-principles phonon dispersion with our 2D-3D Boltzmann phonon transport model to compute the TBC of 156 unique 2D/3D interface pairs, many of which are not available in the literature. We then employ machine learning (ML) to develop streamlined predictive models, of which Neural Network and Gaussian process display the highest predictive accuracy (RMSE $<$ 5 MWm$^{-2}$K$^{-1}$ and $R^2>$0.99) on the complete descriptor set. Then we perform sensitivity analysis to identify the most impactful descriptors, consisting of the vdW spring coupling constant, 2D thermal conductivity, ZA phonon bandwidth, the ZA phonon resonance gap, and the frequency of the first van Hove singularity or Boson peak. On that reduced set, we find that a decision-tree algorithm can make accurate predictions (RMSE $<$ 20 MWm$^{-2}$K$^{-1}$ and $R^2>$0.9) on materials it has not been trained on by performing a transferability analysis. Our model allows optimal selection of 2D-substrate pairings to maximize heat transfer and will improve thermal management in future 2D nanoelectronics.


title: Reweighted Interacting Langevin Diffusions: an Accelerated Sampling Methodfor Optimization

abstract: We proposed a new technique to accelerate sampling methods for solving difficult optimization problems. Our method investigates the intrinsic connection between posterior distribution sampling and optimization with Langevin dynamics, and then we propose an interacting particle scheme that approximates a Reweighted Interacting Langevin Diffusion system (RILD). The underlying system is designed by adding a multiplicative source term into the classical Langevin operator, leading to a higher convergence rate and a more concentrated invariant measure. We analyze the convergence rate of our algorithm and the improvement compared to existing results in the asymptotic situation. We also design various tests to verify our theoretical results, showing the advantages of accelerating convergence and breaking through barriers of suspicious local minimums, especially in high-dimensional non-convex settings. Our algorithms and analysis shed some light on combining gradient and genetic algorithms using Partial Differential Equations (PDEs) with provable guarantees.


title: The light-by-light contribution to the muon anomalous magnetic moment from the axial-vector mesons exchanges within the nonlocal quark model

abstract: The contribution of axial-vector mesons to the muon's anomalous magnetic moment through a light-by-light process is considered within a nonlocal quark model. The model is based on a four-quark interaction with scalar--pseudoscalar and vector--axial-vector sectors. While the transverse component of the axial-vector corresponds to a spin-1 particle, the unphysical longitudinal component is mixed with a pseudoscalar meson. The model parameters are re-fitted to the pion properties in the presence of pi-a_1 mixing. The obtained estimation for the light-by-light contribution of a_1+f_1 mesons is (3.6+-1.8)*10^{-11}.


title: Exploring the Constructicon: Linguistic Analysis of a Computational CxG

abstract: Recent work has formulated the task for computational construction grammar as producing a constructicon given a corpus of usage. Previous work has evaluated these unsupervised grammars using both internal metrics (for example, Minimum Description Length) and external metrics (for example, performance on a dialectology task). This paper instead takes a linguistic approach to evaluation, first learning a constructicon and then analyzing its contents from a linguistic perspective. This analysis shows that a learned constructicon can be divided into nine major types of constructions, of which Verbal and Nominal are the most common. The paper also shows that both the token and type frequency of constructions can be used to model variation across registers and dialects.


title: Adversarial Style Augmentation for Domain Generalization

abstract: It is well-known that the performance of well-trained deep neural networks may degrade significantly when they are applied to data with even slightly shifted distributions. Recent studies have shown that introducing certain perturbation on feature statistics (\eg, mean and standard deviation) during training can enhance the cross-domain generalization ability. Existing methods typically conduct such perturbation by utilizing the feature statistics within a mini-batch, limiting their representation capability. Inspired by the domain generalization objective, we introduce a novel Adversarial Style Augmentation (ASA) method, which explores broader style spaces by generating more effective statistics perturbation via adversarial training. Specifically, we first search for the most sensitive direction and intensity for statistics perturbation by maximizing the task loss. By updating the model against the adversarial statistics perturbation during training, we allow the model to explore the worst-case domain and hence improve its generalization performance. To facilitate the application of ASA, we design a simple yet effective module, namely AdvStyle, which instantiates the ASA method in a plug-and-play manner. We justify the efficacy of AdvStyle on tasks of cross-domain classification and instance retrieval. It achieves higher mean accuracy and lower performance fluctuation. Especially, our method significantly outperforms its competitors on the PACS dataset under the single source generalization setting, \eg, boosting the classification accuracy from 61.2\% to 67.1\% with a ResNet50 backbone. Our code will be available at \url{https://github.com/YBZh/AdvStyle}.


title: Tagging before Alignment: Integrating Multi-Modal Tags for Video-Text Retrieval

abstract: Vision-language alignment learning for video-text retrieval arouses a lot of attention in recent years. Most of the existing methods either transfer the knowledge of image-text pretraining model to video-text retrieval task without fully exploring the multi-modal information of videos, or simply fuse multi-modal features in a brute force manner without explicit guidance. In this paper, we integrate multi-modal information in an explicit manner by tagging, and use the tags as the anchors for better video-text alignment. Various pretrained experts are utilized for extracting the information of multiple modalities, including object, person, motion, audio, etc. To take full advantage of these information, we propose the TABLE (TAgging Before aLignmEnt) network, which consists of a visual encoder, a tag encoder, a text encoder, and a tag-guiding cross-modal encoder for jointly encoding multi-frame visual features and multi-modal tags information. Furthermore, to strengthen the interaction between video and text, we build a joint cross-modal encoder with the triplet input of [vision, tag, text] and perform two additional supervised tasks, Video Text Matching (VTM) and Masked Language Modeling (MLM). Extensive experimental results demonstrate that the TABLE model is capable of achieving State-Of-The-Art (SOTA) performance on various video-text retrieval benchmarks, including MSR-VTT, MSVD, LSMDC and DiDeMo.


title: Magnetic field imaging by hBN quantum sensor nanoarray

abstract: Placing a sensor close to the target at the nano-level is a central challenge in quantum sensing. We demonstrate high-spatial-resolution magnetic field imaging with a boron vacancy (V$_\text{B}^-$) defects array in hexagonal boron nitride with a few 10 nm thickness. V$_\text{B}^-$ sensor spots with a size of (100 nm)$^2$ are arranged periodically with nanoscale precision using a helium ion microscope and attached tightly to a gold wire. The sensor array allows us to visualize the magnetic field induced by the current in the wire with a spatial resolution beyond the diffraction limit. Each sensor exhibits a practical sensitivity of $73.6~\mu\text{T/Hz}^{0.5}$, suitable for quantum materials research. Our technique of arranging V$_\text{B}^-$ quantum sensors periodically and tightly on measurement targets will maximize their potential.


title: MAKE: Vision-Language Pre-training based Product Retrieval in Taobao Search

abstract: Taobao Search consists of two phases: the retrieval phase and the ranking phase. Given a user query, the retrieval phase returns a subset of candidate products for the following ranking phase. Recently, the paradigm of pre-training and fine-tuning has shown its potential in incorporating visual clues into retrieval tasks. In this paper, we focus on solving the problem of text-to-multimodal retrieval in Taobao Search. We consider that users' attention on titles or images varies on products. Hence, we propose a novel Modal Adaptation module for cross-modal fusion, which helps assigns appropriate weights on texts and images across products. Furthermore, in e-commerce search, user queries tend to be brief and thus lead to significant semantic imbalance between user queries and product titles. Therefore, we design a separate text encoder and a Keyword Enhancement mechanism to enrich the query representations and improve text-to-multimodal matching. To this end, we present a novel vision-language (V+L) pre-training methods to exploit the multimodal information of (user query, product title, product image). Extensive experiments demonstrate that our retrieval-specific pre-training model (referred to as MAKE) outperforms existing V+L pre-training methods on the text-to-multimodal retrieval task. MAKE has been deployed online and brings major improvements on the retrieval system of Taobao Search.


title: Robust propagation-based phase retrieval for CT in proximity to highly attenuating objects

abstract: X-ray imaging is a fast, precise and non-invasive method of imaging which, combined with computed tomography, provides detailed 3D rendering of samples. Incorporating propagation-based phase contrast can vastly improve data quality for weakly attenuating samples via material-specific phase retrieval filters, allowing radiation exposure to be reduced. However, applying phase retrieval to multi-material phantoms complicates analysis by requiring a choice of which material boundary to tune the phase retrieval. Filtering for the boundary with strongest phase contrast increases noise suppression, but with the detriment of over-blurring other interfaces, potentially obscuring small or neighbouring features and removing quantitative sample information. Additionally, regions bounded by more than one material type inherently cannot be conventionally filtered to reconstruct the whole boundary. As remedy, we present a computationally-efficient, non-iterative nor AI-mediated method for applying strong phase retrieval, whilst preserving sharp boundaries for all materials within the sample. This technique was tested on phase contrast images of a rabbit kitten brain encased by the surrounding dense skull. Using 24 keV synchrotron radiation with a 5 m propagation distance, our technique provided a 6.9-fold improvement in the signal-to-noise ratio (SNR) of brain tissue compared to the standard phase retrieval procedure, without over-smoothing the images. Simultaneous quantification of edge resolution and SNR gain was performed with an aluminium-water phantom imaged using a microfocus X-ray tube at mean energy 19.58 keV and 0.576 m effective propagation distance. Our method provided a 4.2-fold SNR boost whilst preserving the boundary resolution at 54 $\pm$ 1 $\mu$m, compared to 108 $\pm$ 2 $\mu$m in conventional phase retrieval.


title: Large-scale motions and growth rate from forward-modelling Tully-Fisher peculiar velocities

abstract: Peculiar velocities are an important probe of the mass distribution in the Universe and the growth rate of structure, directly measuring the effects of gravity on the largest scales and providing a test for theories of gravity. Comparing peculiar velocities predicted from the density field mapped by a galaxy redshift survey with peculiar velocities measured using a distance estimator such as the Tully-Fisher relation yields the growth factor for large-scale structure. We present a method for forward-modelling a sample of galaxy magnitudes and velocity widths that simultaneously determines the parameters of the Tully-Fisher relation and the peculiar velocity field. We apply this to the Cosmicflows-4 (CF4) Tully-Fisher dataset, using the peculiar velocities predicted from the 2M++ redshift survey. After validating the method on mock surveys, we measure the product of the growth rate and mass fluctuation amplitude to be $f\!\sigma_8$ = 0.35$\pm$0.03 at an effective redshift of $z$ = 0.017. This is consistent at 3$\sigma$ with the Planck CMB prediction, even though the uncertainty does not fully account for all sources of sample variance. We find the residual bulk flow from gravitational influences outside the 2M++ survey volume to be $|V|$ = 227$\pm$11 km/s, $(l,b)$ = (303$^\circ$,$-$1$^\circ$) in Galactic polar coordinates and the CMB frame. Using simulations, we show that applying our methodology to the large new sample of Tully-Fisher peculiar velocities expected from the WALLABY HI survey of the southern sky can improve the constraints on the growth rate by a factor of 2-3.


title: Convergence of uncertainty estimates in Ensemble and Bayesian sparse model discovery

abstract: Sparse model identification enables nonlinear dynamical system discovery from data. However, the control of false discoveries for sparse model identification is challenging, especially in the low-data and high-noise limit. In this paper, we perform a theoretical study on ensemble sparse model discovery, which shows empirical success in terms of accuracy and robustness to noise. In particular, we analyse the bootstrapping-based sequential thresholding least-squares estimator. We show that this bootstrapping-based ensembling technique can perform a provably correct variable selection procedure with an exponential convergence rate of the error rate. In addition, we show that the ensemble sparse model discovery method can perform computationally efficient uncertainty estimation, compared to expensive Bayesian uncertainty quantification methods via MCMC. We demonstrate the convergence properties and connection to uncertainty quantification in various numerical studies on synthetic sparse linear regression and sparse model discovery. The experiments on sparse linear regression support that the bootstrapping-based sequential thresholding least-squares method has better performance for sparse variable selection compared to LASSO, thresholding least-squares, and bootstrapping-based LASSO. In the sparse model discovery experiment, we show that the bootstrapping-based sequential thresholding least-squares method can provide valid uncertainty quantification, converging to a delta measure centered around the true value with increased sample sizes. Finally, we highlight the improved robustness to hyperparameter selection under shifting noise and sparsity levels of the bootstrapping-based sequential thresholding least-squares method compared to other sparse regression methods.


title: A q-analogue of symmetric multiple zeta value

abstract: We construct a q-analogue of truncated version of symmetric multiple zeta values which satisfies the double shuffle relation. Using it, we define a q-analogue of symmetric multiple zeta values and see that it satisfies many of the same relations as symmetric multiple zeta values, which are the inverse relation and a part of the double shuffle relation and the Ohno-type relation.


title: Complex Critical Points of Deep Linear Neural Networks

abstract: We extend the work of Mehta, Chen, Tang, and Hauenstein on computing the complex critical points of the loss function of deep linear neutral networks when the activation function is the identity function. For networks with a single hidden layer trained on a single data point we give an improved bound on the number of complex critical points of the loss function. We show that for any number of hidden layers complex critical points with zero coordinates arise in certain patterns which we completely classify for networks with one hidden layer. We report our results of computational experiments with varying network architectures defining small deep linear networks using HomotopyContinuation.jl.


title: REPLUG: Retrieval-Augmented Black-Box Language Models

abstract: We introduce REPLUG, a retrieval-augmented language modeling framework that treats the language model (LM) as a black box and augments it with a tuneable retrieval model. Unlike prior retrieval-augmented LMs that train language models with special cross attention mechanisms to encode the retrieved text, REPLUG simply prepends retrieved documents to the input for the frozen black-box LM. This simple design can be easily applied to any existing retrieval and language models. Furthermore, we show that the LM can be used to supervise the retrieval model, which can then find documents that help the LM make better predictions. Our experiments demonstrate that REPLUG with the tuned retriever significantly improves the performance of GPT-3 (175B) on language modeling by 6.3%, as well as the performance of Codex on five-shot MMLU by 5.1%.


title: Average Envy-freeness for Indivisible Items

abstract: In fair division applications, agents may have unequal entitlements reflecting their different contributions. Moreover, the contributions of agents may depend on the allocation itself. Previous fairness notions designed for agents with equal or pre-determined entitlement fail to characterize fairness in these collaborative allocation scenarios. We propose a novel fairness notion of average envy-freeness (AEF), where the envy of agents is defined on the average value of items in the bundles. Average envy-freeness provides a reasonable comparison between agents based on the items they receive and reflects their entitlements. We study the complexity of finding AEF and its relaxation, average envy-freeness up to one item (AEF-1). While deciding if an AEF allocation exists is NP-complete, an AEF-1 allocation is guaranteed to exist and can be computed in polynomial time. We also study allocation with quotas, i.e. restrictions on the sizes of bundles. We prove that finding AEF-1 allocation satisfying a quota is NP-hard. Nevertheless, in the instances with a fixed number of agents, we propose polynomial-time algorithms to find AEF-1 allocation with a quota for binary valuation and approximated AEF-1 allocation with a quota for general valuation.


title: Transverse spin angular momentum of space-time surface plasmon polariton wave packet

abstract: In addition to longitudinal spin angular momentum (SAM) along the axis of propagation of light, spatially structured electromagnetic fields such as evanescent waves and focused beams have recently been found to possess transverse SAM in the direction perpendicular to the axis of propagation. In particular, the SAM of SPPs with spatial structure has been extensively studied in the last decade after it became clear that evanescent fields with spatially structured energy flow generate threedimensional spin texture. Here we present numerical calculations of the space-time surface plasmon polariton (ST-SPP) wave packet, a plasmonic bullet that propagates at an arbitrary group velocity while maintaining its spatial distribution. ST-SPP wave packets with complex spatial structure and energy flow density distribution determined by the group velocity are found to propagate with accompanying three-dimensional spin texture and finite topological charge density. Furthermore, the spatial distribution of the spin texture and topological charge density determined by the spatial structure of the SPP is controllable, and the deformation associated with propagation is negligible. ST-SPP wave packets, which can stably transport customizable three-dimensional spin textures and topological charge densities, can be excellent subjects of observation in studies of spinphotonics and optical topological materials.


title: Endomorphisms of a certain ring of rational functions

abstract: We define a ring whose elements are rational functions, whose addition is polynomial multiplication, and whose multiplication is a convolution operation. It is then show that this ring's endomorphisms exhibit a strong classification. Namely, they will all fall in a well structured family, or they will degenerate. This degeneration is classified strongly in terms of roots of unity.


title: NPSA: Nonparametric Simulated Annealing for Global Optimization

abstract: In this paper we describe NPSA, the first parallel nonparametric global maximum likelihood optimization algorithm using simulated annealing (SA). Unlike the nonparametric adaptive grid search method NPAG, which is not guaranteed to find a global optimum solution, and may suffer from the curse of dimensionality, NPSA is a global optimizer and it is free from these grid related issues. We illustrate NPSA by a number of examples including a pharmacokinetics (PK) model for Voriconazole and show that NPSA may be taken as an upgrade to the current grid search based nonparametric methods.


title: Three-Dimensional Low-Density Fermions in Planckian Limit: Entropy and Dynamics

abstract: In this Letter, we explore dynamics in a three-dimensional strongly interacting liquid. In quantum liquids discussed below, thermodynamic properties such as pressure and thermal energies are fully characterized by $s(T)$, the entropy density of the liquid (that is also directly proportional to the hydrodynamic viscosity). We obtain a universal fermion spectral function $A(\omega, {\bf k})$ that is distinctly specified by $\hbar / T$, a Planckian time scale. These phenomena can emerge in strongly interacting many-body states with a finite fermion density $\rho$ at temperatures $T^*$ where the chemical potential of fermions $\mu(\rho, T=T^*)$ approaches zero and can be thought as many-body simulations of certain aspects of Planckian dynamics.


title: Over-8-dB squeezed light generation by a broadband waveguide optical parametric amplifier toward fault-tolerant ultra-fast quantum computers

abstract: We achieved continuous-wave 8.3-dB squeezed light generation using a terahertz-order-broadband waveguide optical parametric amplifier (OPA) by improving a measurement setup from our previous work [T. Kashiwazaki, et al., Appl. Phys. Lett. 119, 251104 (2021)], where a low-loss periodically poled lithium niobate (PPLN) waveguide had shown 6.3-dB squeezing at a 6-THz frequency. First, to improve efficiency of the squeezed light detection, we reduced effective optical loss to about 12% by removing extra optics and changing the detection method into a low-loss balanced homodyne measurement. Second, to minimize phase-locking fluctuation, we constructed a frequency-optimized phase-locking system by comprehending its frequency responses. Lastly, we found optimal experimental parameters of a measurement frequency and a pump power from their dependences for the squeezing levels. The measurement frequency was decided as 11 MHz to maximize a clearance between shot and circuit noises. Furthermore, pump power was optimized as 660 mW to get higher squeezing level while suppressing anti-squeezed-noise contamination due to an imperfection of phase locking. To our knowledge, this is the first achievement of over-8-dB squeezing by waveguide OPAs without any loss-correction and circuit-noise correction. Moreover, it is shown that the squeezing level soon after our PPLN waveguide is estimated at over 10 dB, which is thought to be mainly restricted by the waveguide loss. This broadband highly-squeezed light opens the possibility to realize fault-tolerant ultra-fast optical quantum computers.


title: GPU Accelerated Newton for Taylor Series Solutions of Polynomial Homotopies in Multiple Double Precision

abstract: A polynomial homotopy is a family of polynomial systems, typically in one parameter $t$. Our problem is to compute power series expansions of the coordinates of the solutions in the parameter $t$, accurately, using multiple double arithmetic. One application of this problem is the location of the nearest singular solution in a polynomial homotopy, via the theorem of Fabry. Power series serve as input to construct Pad\'{e} approximations. Exploiting the massive parallelism of Graphics Processing Units capable of performing several trillions floating-point operations per second, the objective is to compensate for the cost overhead caused by arithmetic with power series in multiple double precision. The application of Newton's method for this problem requires the evaluation and differentiation of polynomials, followed by solving a blocked lower triangular linear system. Experimental results are obtained on NVIDIA GPUs, in particular the RTX 2080, RTX 4080, P100, V100, and A100. Code generated by the CAMPARY software is used to obtain results in double double, quad double, and octo double precision. The programs in this study are self contained, available in a public github repository under the GPL-v3.0 License.


title: Zero-shot Clarifying Question Generation for Conversational Search

abstract: A long-standing challenge for search and conversational assistants is query intention detection in ambiguous queries. Asking clarifying questions in conversational search has been widely studied and considered an effective solution to resolve query ambiguity. Existing work have explored various approaches for clarifying question ranking and generation. However, due to the lack of real conversational search data, they have to use artificial datasets for training, which limits their generalizability to real-world search scenarios. As a result, the industry has shown reluctance to implement them in reality, further suspending the availability of real conversational search interaction data. The above dilemma can be formulated as a cold start problem of clarifying question generation and conversational search in general. Furthermore, even if we do have large-scale conversational logs, it is not realistic to gather training data that can comprehensively cover all possible queries and topics in open-domain search scenarios. The risk of fitting bias when training a clarifying question retrieval/generation model on incomprehensive dataset is thus another important challenge. In this work, we innovatively explore generating clarifying questions in a zero-shot setting to overcome the cold start problem and we propose a constrained clarifying question generation system which uses both question templates and query facets to guide the effective and precise question generation. The experiment results show that our method outperforms existing state-of-the-art zero-shot baselines by a large margin. Human annotations to our model outputs also indicate our method generates 25.2\% more natural questions, 18.1\% more useful questions, 6.1\% less unnatural and 4\% less useless questions.


title: Make-An-Audio: Text-To-Audio Generation with Prompt-Enhanced Diffusion Models

abstract: Large-scale multimodal generative modeling has created milestones in text-to-image and text-to-video generation. Its application to audio still lags behind for two main reasons: the lack of large-scale datasets with high-quality text-audio pairs, and the complexity of modeling long continuous audio data. In this work, we propose Make-An-Audio with a prompt-enhanced diffusion model that addresses these gaps by 1) introducing pseudo prompt enhancement with a distill-then-reprogram approach, it alleviates data scarcity with orders of magnitude concept compositions by using language-free audios; 2) leveraging spectrogram autoencoder to predict the self-supervised audio representation instead of waveforms. Together with robust contrastive language-audio pretraining (CLAP) representations, Make-An-Audio achieves state-of-the-art results in both objective and subjective benchmark evaluation. Moreover, we present its controllability and generalization for X-to-Audio with "No Modality Left Behind", for the first time unlocking the ability to generate high-definition, high-fidelity audios given a user-defined modality input. Audio samples are available at https://Text-to-Audio.github.io


title: SingSong: Generating musical accompaniments from singing

abstract: We present SingSong, a system that generates instrumental music to accompany input vocals, potentially offering musicians and non-musicians alike an intuitive new way to create music featuring their own voice. To accomplish this, we build on recent developments in musical source separation and audio generation. Specifically, we apply a state-of-the-art source separation algorithm to a large corpus of music audio to produce aligned pairs of vocals and instrumental sources. Then, we adapt AudioLM (Borsos et al., 2022) -- a state-of-the-art approach for unconditional audio generation -- to be suitable for conditional "audio-to-audio" generation tasks, and train it on the source-separated (vocal, instrumental) pairs. In a pairwise comparison with the same vocal inputs, listeners expressed a significant preference for instrumentals generated by SingSong compared to those from a strong retrieval baseline. Sound examples at https://g.co/magenta/singsong


title: Citation Analysis of Computer Systems Papers

abstract: Citation analysis is used extensively in the bibliometrics literature to assess the impact of individual works, researchers, institutions, and even entire fields of study. In this paper, we analyze citations in one large and influential field within computer science, namely computer systems. Using citation data from a cross-sectional sample of 2,088 papers in 50 systems conferences from 2017, we examine four research questions: overall distribution of systems citations; their evolution over time; the differences between databases (Google Scholar and Scopus) for systems papers, and; the characteristics of self-citations in the field. We find that only 1.5% of papers remain uncited after five years, while 12.8% accrued at least 100 citations, both statistics comparing favorably to many other scientific fields. The most cited subfields and conference areas within systems were security, databases, and computer architecture. Most papers achieved their first citation within a year from publication, and the median citation count continued to grow at an almost linear rate over five years, with only a few papers peaking before that. We also find that early citations could be linked to papers with a freely available preprint, or may be primarily composed of self-citations. The ratio of self-citations to total citations starts relatively high for most papers but appears to stabilize by 12--18 months, at which point highly cited papers revert to predominately external citations. Past self-citation count (taken from each paper's reference list) appears to bear little if any relationship with the future self-citation count of each paper. The choice of citation database also makes little difference in relative citation comparisons, despite marked differences in absolute counts.


title: Solving High-Dimensional PDEs with Latent Spectral Models

abstract: Deep models have achieved impressive progress in solving partial differential equations (PDEs). A burgeoning paradigm is learning neural operators to approximate the input-output mappings of PDEs. While previous deep models have explored the multiscale architectures and various operator designs, they are limited to learning the operators as a whole in the coordinate space. In real physical science problems, PDEs are complex coupled equations with numerical solvers relying on discretization into high-dimensional coordinate space, which cannot be precisely approximated by a single operator nor efficiently learned due to the curse of dimensionality. We present Latent Spectral Models (LSM) toward an efficient and precise solver for high-dimensional PDEs. Going beyond the coordinate space, LSM enables an attention-based hierarchical projection network to reduce the high-dimensional data into a compact latent space in linear time. Inspired by classical spectral methods in numerical analysis, we design a neural spectral block to solve PDEs in the latent space that approximates complex input-output mappings via learning multiple basis operators, enjoying nice theoretical guarantees for convergence and approximation. Experimentally, LSM achieves consistent state-of-the-art and yields a relative gain of 11.5% averaged on seven benchmarks covering both solid and fluid physics. Code is available at https://github.com/thuml/Latent-Spectral-Models.


title: Dimensionless Groups by Entropic Similarity

abstract: We propose an additional category of dimensionless groups based on the principle of {\it entropic similarity}, defined by ratios of (i) entropy production terms; (ii) entropy flow rates or fluxes; or (iii) information flow rates or fluxes. Since all processes involving work against friction, dissipation, diffusion, dispersion, mixing, separation, chemical reaction, gain of information or other irreversible changes are driven by (or must overcome) the second law of thermodynamics, it is appropriate to analyse these processes directly in terms of competing entropy-producing and transporting phenomena and the dominant entropic regime, rather than indirectly in terms of forces. In this study, we derive entropic groups for a wide variety of phenomena relevant to fluid mechanics, classified into diffusion and chemical reaction processes, dispersion mechanisms and wave phenomena. It is shown that many dimensionless groups traditionally derived by kinematic or dynamic similarity (including the Reynolds number) can also be recovered by entropic similarity -- albeit with a different entropic interpretation -- while a large number of new dimensionless groups are also identified. The analyses significantly expand the scope of dimensional analysis and similarity arguments for the resolution of new and existing problems in science and engineering.


title: A Four-Parameter Black-Hole Solution in the Bumblebee Gravity Model

abstract: The bumblebee gravity model includes a class of vector-tensor theories of gravitation where the vector field couples to the Ricci tensor quadratically. We obtain an analytical spherical black-hole solution in this model. The solution has four parameters, expanding the two-parameter solution family known in the literature. Special choices of the parameters are pointed out and discussed.


title: NeSyFOLD: Neurosymbolic Framework for Interpretable Image Classification

abstract: Deep learning models such as CNNs have surpassed human performance in computer vision tasks such as image classification. However, despite their sophistication, these models lack interpretability which can lead to biased outcomes reflecting existing prejudices in the data. We aim to make predictions made by a CNN interpretable. Hence, we present a novel framework called NeSyFOLD to create a neurosymbolic (NeSy) model for image classification tasks. The model is a CNN with all layers following the last convolutional layer replaced by a stratified answer set program (ASP). A rule-based machine learning algorithm called FOLD-SE-M is used to derive the stratified answer set program from binarized filter activations of the last convolutional layer. The answer set program can be viewed as a rule-set, wherein the truth value of each predicate depends on the activation of the corresponding kernel in the CNN. The rule-set serves as a global explanation for the model and is interpretable. A justification for the predictions made by the NeSy model can be obtained using an ASP interpreter. We also use our NeSyFOLD framework with a CNN that is trained using a sparse kernel learning technique called Elite BackProp (EBP). This leads to a significant reduction in rule-set size without compromising accuracy or fidelity thus improving scalability of the NeSy model and interpretability of its rule-set. Evaluation is done on datasets with varied complexity and sizes. To make the rule-set more intuitive to understand, we propose a novel algorithm for labelling each kernel's corresponding predicate in the rule-set with the semantic concept(s) it learns. We evaluate the performance of our "semantic labelling algorithm" to quantify the efficacy of the semantic labelling for both the NeSy model and the NeSy-EBP model.


title: Finite image size effects on the characterization of magnetic domain patterns via magnetic force microscopy

abstract: Optimizing magnetic thin films for nanotechnologies often requires imaging nanoscale magnetic domain patterns via magnetic microscopy. The finite size of the image may however significantly affect the characterization of the observed magnetic states. We evaluated finite image size effects on the characterization of a variety of stripe and bubble domain patterns exhibited by ferromagnetic Co/Pt multilayers with perpendicular magnetic anisotropy, where the domain size (stripe width and bubble diameter) is around 100 nm. If the image size is too small, below ~ 5 microns, it may cause a significant underestimation of average domain size and overestimation of domain density by up to a factor 5 when reducing the image size from about 20 microns to about a 1 microns. Using a criterion based on how the excess density evolves with image size, we found that to obtain reliable statistical estimates of domain density and average domain size, the image needs to be large enough, and include at least about 100 stripes or about 2500 bubbles.


title: An induction principle for the Bombieri-Vinogradov theorem over $\mathbb{F}_q[t]$ and a variant of the Titchmarsh divisor problem

abstract: Let $\mathbb{F}_q[t]$ be the polynomial ring over the finite field $\mathbb{F}_{q}$. For arithmetic functions $\psi_{1}, \psi_{2}: \mathbb{F}_{q}[t]\rightarrow\mathbb{C}$, we establish that if a Bombieri-Vinogradov type equidistribution result holds for $\psi_{1}$ and $\psi_{2}$, then it also holds for their Dirichlet convolution $\psi_{1} \ast \psi_{2}$. As an application of this, we resolve a version of the Titchmarsh divisor problem in $\mathbb{F}_{q}[t]$. More precisely, we obtain an asymptotic for the average behaviour of the divisor function over shifted products of two primes in $\mathbb{F}_q[t]$.


title: A deep-learning search for technosignatures of 820 nearby stars

abstract: The goal of the Search for Extraterrestrial Intelligence (SETI) is to quantify the prevalence of technological life beyond Earth via their "technosignatures". One theorized technosignature is narrowband Doppler drifting radio signals. The principal challenge in conducting SETI in the radio domain is developing a generalized technique to reject human radio frequency interference (RFI). Here, we present the most comprehensive deep-learning based technosignature search to date, returning 8 promising ETI signals of interest for re-observation as part of the Breakthrough Listen initiative. The search comprises 820 unique targets observed with the Robert C. Byrd Green Bank Telescope, totaling over 480, hr of on-sky data. We implement a novel beta-Convolutional Variational Autoencoder to identify technosignature candidates in a semi-unsupervised manner while keeping the false positive rate manageably low. This new approach presents itself as a leading solution in accelerating SETI and other transient research into the age of data-driven astronomy.


title: Optimal Decision Trees For Interpretable Clustering with Constraints (Extended Version)

abstract: Constrained clustering is a semi-supervised task that employs a limited amount of labelled data, formulated as constraints, to incorporate domain-specific knowledge and to significantly improve clustering accuracy. Previous work has considered exact optimization formulations that can guarantee optimal clustering while satisfying all constraints, however these approaches lack interpretability. Recently, decision-trees have been used to produce inherently interpretable clustering solutions, however existing approaches do not support clustering constraints and do not provide strong theoretical guarantees on solution quality. In this work, we present a novel SAT-based framework for interpretable clustering that supports clustering constraints and that also provides strong theoretical guarantees on solution quality. We also present new insight into the trade-off between interpretability and satisfaction of such user-provided constraints. Our framework is the first approach for interpretable and constrained clustering. Experiments with a range of real-world and synthetic datasets demonstrate that our approach can produce high-quality and interpretable constrained clustering solutions.


title: Analysis of anisotropic subgrid-scale stress for coarse large-eddy simulation

abstract: This study discusses the necessity of anisotropic subgrid-scale (SGS) stress in large-eddy simulations (LESs) of turbulent shear flows using a coarse grid resolution. We decompose the SGS stress into two parts to observe the role of SGS stress in turbulent shear flows in addition to the energy transfer between grid-scale (GS or resolved scale) and SGS. One is the isotropic eddy-viscosity term, which contributes to energy transfer, and the other is the residual anisotropic term, which is separated from the energy transfer. We investigate the budget equation for GS Reynolds stress in turbulent channel flows accompanied by the SGS stress decomposition. In addition, we examine the medium and coarse filter length cases; the conventional eddy-viscosity models can fairly predict the mean velocity profile for the medium filter case and fails for the coarse filter case. The budget for GS turbulent kinetic energy shows that the anisotropic SGS stress has a negligible contribution to energy transfer. In contrast, the anisotropic stress has a large and non-dissipative contribution to the streamwise and spanwise components of GS Reynolds stress when the filter size is large. Even for the medium-size filter case, the anisotropic stress contributes positively to the budget for the spanwise GS Reynolds stress. Spectral analysis of the budget reveals that the positive contribution is prominent at a scale consistent with the spacing of streaks in the near-wall region. Therefore, we infer that anisotropic stress contributes to the generation mechanism of coherent structures. Predicting the positive contribution of the anisotropic stress to the budget is key to further improving SGS models.


title: Constraining the Surface Curvature of an Anisotropic Neutron Star

abstract: The anisotropy of pressure arises due to the various complex phenomena that happen inside the neutron star (NS). In this study, we calculate the degree of anisotropy inside the NS using the scalar pressure anisotropy model. Macroscopic properties such as mass, radius, compactness, redshift, tidal deformability, the moment of inertia, and surface curvature (SC) are computed for the anisotropic NS with the equation of states spanning from relativistic to nonrelativistic cases. The variation of SC as the functions of the above-mentioned quantities are computed by changing the degree of anisotropy. Pressure anisotropy has significant effects on the magnitude of SC. The universal relations between the canonical SC$-\Lambda$ and SC$-\bar{I}$ are studied. From the GW170817 tidal deformability data constraints on SC are found to be SC$_{1.4}(10^{14}) = 3.44_{-1.0}^{+0.4}, 2.85_{-1.20}^{+0.62}, \ {\rm and} \ 2.52_{-1.02}^{+0.61}$ for $\lambda_{\rm BL} = 0.0, 1.0$, and $2.0$ respectively.


title: A Simulation Study of the Performance of Statistical Models for Count Outcomes with Excessive Zeros

abstract: Background: Outcome measures that are count variables with excessive zeros are common in health behaviors research. There is a lack of empirical data about the relative performance of prevailing statistical models when outcomes are zero-inflated, particularly compared with recently developed approaches. Methods: The current simulation study examined five commonly used analytical approaches for count outcomes, including two linear models (with outcomes on raw and log-transformed scales, respectively) and three count distribution-based models (i.e., Poisson, negative binomial, and zero-inflated Poisson (ZIP) models). We also considered the marginalized zero-inflated Poisson (MZIP) model, a novel alternative that estimates the effects on overall mean while adjusting for zero-inflation. Extensive simulations were conducted to evaluate their the statistical power and Type I error rate across various data conditions. Results: Under zero-inflation, the Poisson model failed to control the Type I error rate, resulting in higher than expected false positive results. When the intervention effects on the zero (vs. non-zero) and count parts were in the same direction, the MZIP model had the highest statistical power, followed by the linear model with outcomes on raw scale, negative binomial model, and ZIP model. The performance of a linear model with a log-transformed outcome variable was unsatisfactory. When only one of the effects on the zero (vs. non-zero) part and the count part existed, the ZIP model had the highest statistical power. Conclusions: The MZIP model demonstrated better statistical properties in detecting true intervention effects and controlling false positive results for zero-inflated count outcomes. This MZIP model may serve as an appealing analytical approach to evaluating overall intervention effects in studies with count outcomes marked by excessive zeros.


title: Monotone Splitting SQP Algorithms for Two-block Nonconvex Optimization Problems with General Linear Constraints and Applications

abstract: In this work, based on the ideas of alternating direction method with multipliers (ADMM) and sequential quadratic programming (SQP), as well as Armijo line search technology, monotone splitting SQP algorithms for two-block nonconvex optimization problems with linear equality, inequality and box constraints are discussed. Firstly, the discussed problem is transformed into an optimization problem with only linear equality and box constraints by introducing slack variables. Secondly, we use the idea of ADMM to decompose the quadratic programming (QP) subproblem. Especially, the QP subproblem corresponding to the introducing slack variable is simple, and it has an explicit optimal solution without increasing computational cost. Thirdly, the search direction is generated by the optimal solutions of the subproblems, and the new iteration point is yielded by Armijo line search with augmented Lagrange function. And the global convergence of the algorithm is analyzed under weaker assumptions. In addition, box constraints are extended to general nonempty closed convex sets, moreover, the global convergence of the corresponding algorithm is also proved. Finally, some preliminary numerical experiments and applications in the mid-to-large-scale economic dispatch problems for power systems are reported, and these show that our proposed algorithm is promising.


title: Floquet States

abstract: Quantum systems driven by a time-periodic field are a platform of condensed matter physics where effective (quasi)stationary states, termed "Floquet states", can emerge with external-field-dressed quasiparticles during driving. They appear, for example, as a prethermal intermediate state in isolated driven quantum systems or as a nonequilibrium steady state in driven open quantum systems coupled to environment. Floquet states may have various intriguing physical properties, some of which can be drastically different from those of the original undriven systems in equilibrium. In this article, we review fundamental aspects of Floquet states, and discuss recent topics and applications of Floquet states in condensed matter physics.


title: Distributed Stochastic Optimization under a General Variance Condition

abstract: Distributed stochastic optimization has drawn great attention recently due to its effectiveness in solving large-scale machine learning problems. Though numerous algorithms have been proposed and successfully applied to general practical problems, their theoretical guarantees mainly rely on certain boundedness conditions on the stochastic gradients, varying from uniform boundedness to the relaxed growth condition. In addition, how to characterize the data heterogeneity among the agents and its impacts on the algorithmic performance remains challenging. In light of such motivations, we revisit the classical Federated Averaging (FedAvg) algorithm (McMahan et al., 2017) as well as the more recent SCAFFOLD method (Karimireddy et al., 2020) for solving the distributed stochastic optimization problem and establish the convergence results under only a mild variance condition on the stochastic gradients for smooth nonconvex objective functions. Almost sure convergence to a stationary point is also established under the condition. Moreover, we discuss a more informative measurement for data heterogeneity as well as its implications.


title: The Meta Distribution of SINR in UAV-Assisted Cellular Networks

abstract: Mounting compact and lightweight base stations on unmanned aerial vehicles (UAVs) is a cost-effective and flexible solution to provide seamless coverage on the existing terrestrial networks. While the coverage probability in UAV-assisted cellular networks has been widely investigated, it provides only the first-order statistic of signal-to-interference-plus-noise ratio (SINR). In this paper, to analyze high-order statistics of SINR and characterize the disparity among individual links, we provide a meta distribution (MD)-based analytical framework for UAV-assisted cellular networks, in which the probabilistic line-of-sight channel and realistic antenna pattern are taken into account for air-to-ground transmissions. To accurately characterize the interference from UAVs, we relax the widely applied uniform off-boresight angle (OBA) assumption and derive the exact distribution of OBA. Using stochastic geometry, for both steerable and vertical antenna scenarios, we obtain mathematical expressions for the moments of condition success probability, the SINR MD, and the mean local delay. Moreover, we study the asymptotic behavior of the moments as network density approaches infinity. Numerical results validate the tightness of the theoretical results and show that the uniform OBA assumption underestimates the network performance, especially in the regime of moderate altitude of UAV. We also show that when UAVs are equipped with steerable antennas, the network coverage and user fairness can be optimized simultaneously by carefully adjusting the UAV parameters.


title: Global Three-Dimensional Radiation Magnetohydrodynamic Simulations of Accretion onto a Stellar Mass Black Hole at Sub- and Near-critical Accretion Rates

abstract: We present global 3D radiation magnetohydrodynamical simulations of accretion onto a 6.62 solar mass black hole with quasi-steady state accretion rates reaching 0.016 to 0.9 times the critical accretion rate, which is defined as the accretion rate to power the Eddington luminosity assuming a 10% radiative efficiency, in different runs. The simulations show no sign of thermal instability over hundreds of thermal timescales at 10 $r_{\rm g}$. The energy dissipation happens close to the mid-plane in the near-critical runs and near the disk surface in the low accretion rate run. The total radiative luminosity inside $\sim$20 $r_{\rm g}$ is about 1% to 30% the Eddington limit, with a radiative efficiency of about 6% and 3%, respectively, in the sub- and near-critical accretion regimes. In both cases, self-consistent turbulence generated by the magnetorotational instability (MRI) leads to angular momentum transfer, and the disk is supported by magnetic pressure. Outflows from the central low-density funnel with a terminal velocity of $\sim$0.1$c$ are seen only in the near-critical runs. We conclude that these magnetic pressure dominated disks are thermally stable and thicker than the $\alpha$ disk, and the effective temperature profiles are much flatter than that in the $\alpha$ disks. The magnetic pressure of these disks are comparable within an order of magnitude with the previous analytical magnetic pressure dominated disk model.


title: Feature-Space Bayesian Adversarial Learning Improved Malware Detector Robustness

abstract: We present a new algorithm to train a robust malware detector. Modern malware detectors rely on machine learning algorithms. Now, the adversarial objective is to devise alterations to the malware code to decrease the chance of being detected whilst preserving the functionality and realism of the malware. Adversarial learning is effective in improving robustness but generating functional and realistic adversarial malware samples is non-trivial. Because: i) in contrast to tasks capable of using gradient-based feedback, adversarial learning in a domain without a differentiable mapping function from the problem space (malware code inputs) to the feature space is hard; and ii) it is difficult to ensure the adversarial malware is realistic and functional. This presents a challenge for developing scalable adversarial machine learning algorithms for large datasets at a production or commercial scale to realize robust malware detectors. We propose an alternative; perform adversarial learning in the feature space in contrast to the problem space. We prove the projection of perturbed, yet valid malware, in the problem space into feature space will always be a subset of adversarials generated in the feature space. Hence, by generating a robust network against feature-space adversarial examples, we inherently achieve robustness against problem-space adversarial examples. We formulate a Bayesian adversarial learning objective that captures the distribution of models for improved robustness. We prove that our learning method bounds the difference between the adversarial risk and empirical risk explaining the improved robustness. We show that adversarially trained BNNs achieve state-of-the-art robustness. Notably, adversarially trained BNNs are robust against stronger attacks with larger attack budgets by a margin of up to 15% on a recent production-scale malware dataset of more than 20 million samples.


title: Retracts of Laurent polynomial rings

abstract: Let $R$ be an integral domain and $B=R[x_1,\ldots,x_n]$ be the polynomial ring. In this paper, we consider retracts of $B[1/M]$ for a monomial $M$. We show that (1) if $M=\prod_{i=1}^nx_i$, then every retract is a Laurent polynomial ring over $R$, (2) if $R$ is a perfect field and $n=3$, then every retract is isomorphic to $R[y_1^{\pm1},\ldots,y_s^{\pm1},z_1,\ldots,z_t]$ for some $s,t\geq 0$.


title: Image Contrast Enhancement using Fuzzy Technique with Parameter Determination using Metaheuristics

abstract: In this work, we have presented a way to increase the contrast of an image. Our target is to find a transformation that will be image specific. We have used a fuzzy system as our transformation function. To tune the system according to an image, we have used Genetic Algorithm and Hill Climbing in multiple ways to evolve the fuzzy system and conducted several experiments. Different variants of the method are tested on several images and two variants that are superior to others in terms of fitness are selected. We have also conducted a survey to assess the visual improvement of the enhancements made by the two variants. The survey indicates that one of the methods can enhance the contrast of the images visually.


title: Computing the Haar state on ${\mathbb{O}(SL_q(3))}$

abstract: This paper shows that to compute the Haar state on $\mathbb{O}(SL_q(n))$, it suffices to compute the Haar states of a special type of monomials which we define as standard monomials. Then, we provide an algorithm to explicitly compute the Haar states of standard monomials on $\mathbb{O}(SL_q(3))$ with reasonable computational cost. The numerical results on $\mathbb{O}(SL_q(3))$ will be used in the future study of the $q$-deformed Weingarten function.


title: Attack Impact Evaluation for Stochastic Control Systems through Alarm Flag State Augmentation

abstract: This note addresses the problem of evaluating the impact of an attack on discrete-time nonlinear stochastic control systems. The problem is formulated as an optimal control problem with a joint chance constraint that forces the adversary to avoid detection throughout a given time period. Due to the joint constraint, the optimal control policy depends not only on the current state, but also on the entire history, leading to an explosion of the search space and making the problem generally intractable. However, we discover that the current state and whether an alarm has been triggered, or not, is sufficient for specifying the optimal decision at each time step. This information, which we refer to as the alarm flag, can be added to the state space to create an equivalent optimal control problem that can be solved with existing numerical approaches using a Markov policy. Additionally, we note that the formulation results in a policy that does not avoid detection once an alarm has been triggered. We extend the formulation to handle multi-alarm avoidance policies for more reasonable attack impact evaluations, and show that the idea of augmenting the state space with an alarm flag is valid in this extended formulation as well.


title: Distributed Matrix Computations with Low-weight Encodings

abstract: Straggler nodes are well-known bottlenecks of distributed matrix computations which induce reductions in computation/communication speeds. A common strategy for mitigating such stragglers is to incorporate Reed-Solomon based MDS (maximum distance separable) codes into the framework; this can achieve resilience against an optimal number of stragglers. However, these codes assign dense linear combinations of submatrices to the worker nodes. When the input matrices are sparse, these approaches increase the number of non-zero entries in the encoded matrices, which in turn adversely affects the worker computation time. In this work, we develop a distributed matrix computation approach where the assigned encoded submatrices are random linear combinations of a small number of submatrices. In addition to being well suited for sparse input matrices, our approach continues have the optimal straggler resilience in a certain range of problem parameters. Moreover, compared to recent sparse matrix computation approaches, the search for a "good" set of random coefficients to promote numerical stability in our method is much more computationally efficient. We show that our approach can efficiently utilize partial computations done by slower worker nodes in a heterogeneous system which can enhance the overall computation speed. Numerical experiments conducted through Amazon Web Services (AWS) demonstrate up to 30% reduction in per worker node computation time and 100x faster encoding compared to the available methods.


title: GibbsDDRM: A Partially Collapsed Gibbs Sampler for Solving Blind Inverse Problems with Denoising Diffusion Restoration

abstract: Pre-trained diffusion models have been successfully used as priors in a variety of linear inverse problems, where the goal is to reconstruct a signal from noisy linear measurements. However, existing approaches require knowledge of the linear operator. In this paper, we propose GibbsDDRM, an extension of Denoising Diffusion Restoration Models (DDRM) to a blind setting in which the linear measurement operator is unknown. GibbsDDRM constructs a joint distribution of the data, measurements, and linear operator by using a pre-trained diffusion model for the data prior, and it solves the problem by posterior sampling with an efficient variant of a Gibbs sampler. The proposed method is problem-agnostic, meaning that a pre-trained diffusion model can be applied to various inverse problems without fine-tuning. In experiments, it achieved high performance on both blind image deblurring and vocal dereverberation tasks, despite the use of simple generic priors for the underlying linear operators.


title: Understanding Visual Arts Experiences of Blind People

abstract: Visual arts play an important role in cultural life and provide access to social heritage and self-enrichment, but most visual arts are inaccessible to blind people. Researchers have explored different ways to enhance blind people's access to visual arts (e.g., audio descriptions, tactile graphics). However, how blind people adopt these methods remains unknown. We conducted semi-structured interviews with 15 blind visual arts patrons to understand how they engage with visual artwork and the factors that influence their adoption of visual arts access methods. We further examined interview insights in a follow-up survey (N=220). We present: 1) current practices and challenges of accessing visual artwork in-person and online (e.g., Zoom tour), 2) motivation and cognition of perceiving visual arts (e.g., imagination), and 3) implications for designing visual arts access methods. Overall, our findings provide a roadmap for technology-based support for blind people's visual arts experiences.


title: Dynamic Storyboard Generation in an Engine-based Virtual Environment for Video Production

abstract: Amateurs working on mini-films and short-form videos usually spend lots of time and effort on the multi-round complicated process of setting and adjusting scenes, plots, and cameras to deliver satisfying video shots. We present Virtual Dynamic Storyboard (VDS) to allow users storyboarding shots in virtual environments, where the filming staff can easily test the settings of shots before the actual filming. VDS runs on a "propose-simulate-discriminate" mode: Given a formatted story script and a camera script as input, it generates several character animation and camera movement proposals following predefined story and cinematic rules to allow an off-the-shelf simulation engine to render videos. To pick up the top-quality dynamic storyboard from the candidates, we equip it with a shot ranking discriminator based on shot quality criteria learned from professional manual-created data. VDS is comprehensively validated via extensive experiments and user studies, demonstrating its efficiency, effectiveness, and great potential in assisting amateur video production.


title: Edge-guided Multi-domain RGB-to-TIR image Translation for Training Vision Tasks with Challenging Labels

abstract: The insufficient number of annotated thermal infrared (TIR) image datasets not only hinders TIR image-based deep learning networks to have comparable performances to that of RGB but it also limits the supervised learning of TIR image-based tasks with challenging labels. As a remedy, we propose a modified multidomain RGB to TIR image translation model focused on edge preservation to employ annotated RGB images with challenging labels. Our proposed method not only preserves key details in the original image but also leverages the optimal TIR style code to portray accurate TIR characteristics in the translated image, when applied on both synthetic and real world RGB images. Using our translation model, we have enabled the supervised learning of deep TIR image-based optical flow estimation and object detection that ameliorated in deep TIR optical flow estimation by reduction in end point error by 56.5\% on average and the best object detection mAP of 23.9\% respectively. Our code and supplementary materials are available at https://github.com/rpmsnu/sRGB-TIR.


title: High-Density behavior of symmetry energy and speed of sound in the dense matter within an effective chiral model

abstract: With an effective chiral model, we investigate how the mesonic cross couplings $\sigma-\rho$ and $\omega-\rho$ affect the density content of the symmetry energy and its higher-order slope parameters. Earlier mentioned cross-couplings are crucial to controlling the density content of symmetry energy. For this purpose, we did a case study for different values of the symmetry energy $J_1$, defined at density 0.1 fm$^{-3}$ in the range (23.4 - 25.2) for a fixed value of the slope of the symmetry energy $L_0 = 60$ MeV at saturation density and investigate its effect on the higher-order coefficients and their influence on the underlying equation of state. We found that the model with $J_1= 24.6$ MeV is more favorable with the pure neutron matter (PNM) constraints obtained from $\chi$EFT calculations. In addition, we show that all of our models predict a monotonically increasing speed of sound up to four times the saturation density. The speed of sound decreases/saturates above that point and approaches the conformal limit approximately $\sqrt{1/3}~c$ at the center of the maximum mass star.


title: A new dynamical mechanism of incomplete fusion in heavy-ion collision

abstract: The incomplete fusion has been proved as the formation and emission of the $\alpha$ particle by the increase in the rotational energy of the very mass-asymmetric dinuclear system. The results of the dinuclear system model have confirmed that the incomplete fusion in heavy-ion collisions occurs at a large orbital angular momentum ($L > 30 \hbar$) due to the strong increase of the intrinsic fusion barrier.


title: Sinc-collocation methods with consistent collocation points for Fredholm integral equations of the second kind

abstract: Sinc-collocation methods are known to be efficient for Fredholm integral equations of the second kind, even if functions in the equations have endpoint singularity. However, existing methods have the disadvantage of inconsistent collocation points. This inconsistency complicates the implementation of such methods, particularly for large-scale problems. To overcome this drawback, this study proposes another Sinc-collocation methods with consistent collocation points. The results of a theoretical error analysis show that the proposed methods have the same convergence property as existing methods. Numerical experiments suggest the superiority of the proposed methods in terms of implementation and computational cost.


title: The local converse theorem for quasi-split $O_{2n}$ and $SO_{2n}$

abstract: Let $F$ be a non-archimedean local field of characteristic not equal to 2. In this paper, we prove the local converse theorem for quasi-split $\O_{2n}(F)$ and $\SO_{2n}(F)$, via the description of the local theta correspondence between $\O_{2n}(F)$ and $\Sp_{2n}(F)$. More precisely, as a main step, we explicitly describe the precise behavior of the $\gamma$-factors under the correspondence. Furthermore, we apply our results to prove the weak rigidity theorems for irreducible generic cuspidal automorphic representations of $\O_{2n}(\A)$ and $\SO_{2n}(\mathbb{A})$, respectively, where $\A$ is a ring of adele of a global number field $L$.


title: Photonic corner skin modes

abstract: Useful in the enhancement of light-matter interaction, localization of light is at the heart of photonics studies. Different approaches have been proposed to localize light, including those based on dynamical localization, topological trivial or nontrivial defects in the band gap of photonic crystals, and bound states in the continuum. Recent studies on non-Hermitian skin effect have provided us new means to localize waves. In this work, we propose a new method towards localized light, called photonic corner skin modes arising from second-order non-Hermitian skin effect and gain-loss symmetry on a lattice. Specifically, we propose to make use of small pseudo-inversion symmetric gain/loss, which does not close the band gap, to realize a photonic Chern insulator with chiral edge states. The chiral edge states then accumulate at certain corners of the system. Intriguing phenomena such as corner skin modes arising from an underlying bipolar second-order non-Hermitian skin effect and multiple-corner skin modes are predicted in continuous systems.


title: Neural-FEBI: Accurate Function Identification in Ethereum Virtual Machine Bytecode

abstract: Millions of smart contracts have been deployed onto the Ethereum platform, posing potential attack subjects. Therefore, analyzing contract binaries is vital since their sources are unavailable, involving identification comprising function entry identification and detecting its boundaries. Such boundaries are critical to many smart contract applications, e.g. reverse engineering and profiling. Unfortunately, it is challenging to identify functions from these stripped contract binaries due to the lack of internal function call statements and the compiler-inducing instruction reshuffling. Recently, several existing works excessively relied on a set of handcrafted heuristic rules which impose several faults. To address this issue, we propose a novel neural network-based framework for EVM bytecode Function Entries and Boundaries Identification (neural-FEBI) that does not rely on a fixed set of handcrafted rules. Instead, it used a two-level bi-Long Short-Term Memory network and a Conditional Random Field network to locate the function entries. The suggested framework also devises a control flow traversal algorithm to determine the code segments reachable from the function entry as its boundary. Several experiments on 38,996 publicly available smart contracts collected as binary demonstrate that neural-FEBI confirms the lowest and highest F1-scores for the function entries identification task across different datasets of 88.3 to 99.7, respectively. Its performance on the function boundary identification task is also increased from 79.4% to 97.1% compared with state-of-the-art. We further demonstrate that the identified function information can be used to construct more accurate intra-procedural CFGs and call graphs. The experimental results confirm that the proposed framework significantly outperforms state-of-the-art, often based on handcrafted heuristic rules.


title: Contrasting dynamics of seed banks and standing vegetation of annuals and perennials along a rainfall gradient

abstract: The soil seed bank is a major component of plant communities. However, long-term analyses of the dynamics of the seed bank and the ensuing vegetation are rare. Here, we studied the dynamics in plant communities with high dominance of annuals in Mediterranean, semiarid, and arid ecosystems for nine consecutive years. For annuals, we hypothesized that the density of the seed bank would be more stable than the density of the standing herbaceous vegetation. Moreover, we predicted that differences in temporal variability between the seed bank and the vegetation would increase with aridity, where year-to-year rainfall variability is higher. We found that the temporal variability at the population level (assessed as the standard deviation of the loge-transformed density) of the nine dominant annuals in each site did not differ between the seed bank and the ensuing vegetation in any of the sites. For the total density of annuals, patterns depended on aridity. In the Mediterranean site, the temporal variability was similar in the seed bank and the vegetation (0.40 vs. 0.40). Still, in the semiarid and arid sites, variability in the seed bank was lower than in the vegetation (0.49 vs. 1.01 and 0.63 vs. 1.38, respectively). This difference between the population-level patterns and the total density of annuals can be related to the lower population synchrony in their seed bank. In contrast, for the herbaceous perennials (all species combined), the seed bank variability was higher than in the vegetation. Overall, our results highlight the role of the seed bank in buffering the annual vegetation density with increasing climatic uncertainty typical in aridity gradients. This role is crucial under the increasing uncertainty imposed by climatic change in the region.


title: Likely detection of gamma-ray pulsations of PSR~J1717+4308A in NGC~6341 and implication of the gamma-ray millisecond pulsars in globular clusters

abstract: We report our analysis results for the globular cluster (GC) NGC~6341 (M92), as a millisecond pulsar (MSP) J1717$+$4308A has recently been reported found in this GC. The data used are from the Large Area Telescope onboard the {\it Fermi Gamma-ray Space Telescope (Fermi)}. We detect $\gamma$-ray pulsations of the MSP at a $4.4\sigma$ confidence level (the corresponding weighted H-test value is $\sim$28.4). This MSP, the fourth $\gamma$-ray pulsar found in a GC, does not have significant off-pulse emission and has $\gamma$-ray luminosity and efficiency $1.3\times10^{34}$\,erg\,s$^{-1}$ and 1.7\% respectively. In order to have a clear view on the properties of the known GC $\gamma$-ray MSPs, we re-analyze the \fermi\ LAT data for the other three ones. These four MSPs share the properties of either having high $\dot{E}$ ($\sim 10^{36}$\,erg\,s$^{-1}$) or being in the GCs that contain only limited numbers of known MSPs. In addition, we find that PSRs~J1823$-$3021A and B1821$-$24, in NGC~6624 and NGC~6626 respectively, have detectable off-pulse $\gamma$-ray emission and PSR J1835$-$3259B in NGC~6652 does not. Using the obtained off-pulse spectra or spectral upper limits, we constrain the numbers of other MSPs in the four GCs. The results are consistent with the numbers of the radio pulsars reported in them. While at least in NGC~6624 and NGC~6626, the contribution of other MSPs to their observed $\gamma$-ray emission can not be ignored, our study indicates that the presence of a bright MSP could be the dominant factor for whether a GC is detectable at $\gamma$-rays or not.


title: Robust Meta Learning for Image based tasks

abstract: A machine learning model that generalizes well should obtain low errors on unseen test examples. Thus, if we learn an optimal model in training data, it could have better generalization performance in testing tasks. However, learning such a model is not possible in standard machine learning frameworks as the distribution of the test data is unknown. To tackle this challenge, we propose a novel robust meta-learning method, which is more robust to the image-based testing tasks which is unknown and has distribution shifts with training tasks. Our robust meta-learning method can provide robust optimal models even when data from each distribution are scarce. In experiments, we demonstrate that our algorithm not only has better generalization performance but also robust to different unknown testing tasks.


title: KG-BERTScore: Incorporating Knowledge Graph into BERTScore for Reference-Free Machine Translation Evaluation

abstract: BERTScore is an effective and robust automatic metric for referencebased machine translation evaluation. In this paper, we incorporate multilingual knowledge graph into BERTScore and propose a metric named KG-BERTScore, which linearly combines the results of BERTScore and bilingual named entity matching for reference-free machine translation evaluation. From the experimental results on WMT19 QE as a metric without references shared tasks, our metric KG-BERTScore gets higher overall correlation with human judgements than the current state-of-the-art metrics for reference-free machine translation evaluation.1 Moreover, the pre-trained multilingual model used by KG-BERTScore and the parameter for linear combination are also studied in this paper.


title: CSDR-BERT: a pre-trained scientific dataset match model for Chinese Scientific Dataset Retrieval

abstract: As the number of open and shared scientific datasets on the Internet increases under the open science movement, efficiently retrieving these datasets is a crucial task in information retrieval (IR) research. In recent years, the development of large models, particularly the pre-training and fine-tuning paradigm, which involves pre-training on large models and fine-tuning on downstream tasks, has provided new solutions for IR match tasks. In this study, we use the original BERT token in the embedding layer, improve the Sentence-BERT model structure in the model layer by introducing the SimCSE and K-Nearest Neighbors method, and use the cosent loss function in the optimization phase to optimize the target output. Our experimental results show that our model outperforms other competing models on both public and self-built datasets through comparative experiments and ablation implementations. This study explores and validates the feasibility and efficiency of pre-training techniques for semantic retrieval of Chinese scientific datasets.


title: High-pressure order-disorder transition in Mg$_2$SiO$_4$: Implications for super-Earth mineralogy

abstract: (Mg, Fe)SiO$_3$ post-perovskite is the highest pressure silicate mineral phase in the Earth's interior. The extreme pressure and temperature conditions inside large extrasolar planets will likely lead to phase transitions beyond pPv. In this work we have explored the high-pressure phase relations in Mg$_2$SiO$_4$ using computations based on density functional theory. We find that a partially disordered I-42d type structure would be stable in the interiors of these super-Earth planets. The discovery of a structure where two very dissimilar cations, Mg$^{2+}$ and Si$^{4+}$ occupy the same crystallographic site opens up a domain of interesting crystal chemistry and provides a foundation for other silicates and oxides with mixed occupancy. We have explored the mechanism of the phase transition from the ordered ground state and the effect of the disordering on electronic properties of the silicate phase.


title: Multiple Weighted Estimates for Multilinear Commutators of Multilinear Singular Integrals with Generalized Kernels

abstract: In this paper, the weighted Lp boundedness of multilinear commutators and iterated commutators of multilinear singular integral operators with generalized kernels is established, where the weight is multiple weight. Our results are generalizations of the corresponding results for multilinear singular integral operators with standard kernels and Dini kernels.


title: Simultaneous magnetic and electric Purcell enhancement in a hybrid metal-dielectric nanostructure

abstract: Hybrid metal-dielectric structures, which combine the advantages of both metal and dielectric materials, support high-confined but low-loss magnetic and electric resonances under deliberate arrangements. However, their potential for enhancing magnetic emission has not been explored. Here, we study the simultaneous magnetic and electric Purcell enhancement supported by a hybrid structure consisting of a dielectric nanoring and a silver nanorod Such a structure enables low Ohmic loss and highly-confined field under the mode hybridization of magnetic resonances on nanoring and electric resonances on nanorod in the optical communication band. So, the 60-fold magnetic Purcell enhancement and 45-fold electric Purcell enhancement can be achieved simultaneously with $>95\%$ of the radiation transmitted to far field. The position of emitter has a several-ten-nanometer tolerance for sufficiently large Purcell enhancement, which brings convenience to experimental fabrications. Moreover, an array formed by this hybrid nanostructure can further enhance the magnetic Purcell factors. The findings provide a possibility to selectively excite the magnetic and electric emission in integrated photon circuits. It may also facilitate brighter magnetic emission sources and light-emitting metasurfaces in a simpler arrangement.


title: Algebraic Inverse Fast Multipole Method: A fast direct solver that is better than HODLR based fast direct solver

abstract: This article presents a fast direct solver, termed Algebraic Inverse Fast Multipole Method (from now on abbreviated as AIFMM), for linear systems arising out of $N$-body problems. AIFMM relies on the following three main ideas: (i) Certain sub-blocks in the matrix corresponding to $N$-body problems can be efficiently represented as low-rank matrices; (ii) The low-rank sub-blocks in the above matrix are leveraged to construct an extended sparse linear system; (iii) While solving the extended sparse linear system, certain fill-ins that arise in the elimination phase are represented as low-rank matrices and are "redirected" though other variables maintaining zero fill-in sparsity. The main highlights of this article are the following: (i) Our method is completely algebraic (as opposed to the existing Inverse Fast Multipole Method~\cite{ arXiv:1407.1572,doi:10.1137/15M1034477,TAKAHASHI2017406}, from now on abbreviated as IFMM). We rely on our new Nested Cross Approximation~\cite{arXiv:2203.14832} (from now on abbreviated as NNCA) to represent the matrix arising out of $N$-body problems. (ii) A significant contribution is that the algorithm presented in this article is more efficient than the existing IFMMs. In the existing IFMMs, the fill-ins are compressed and redirected as and when they are created. Whereas in this article, we update the fill-ins first without affecting the computational complexity. We then compress and redirect them only once. (iii) Another noteworthy contribution of this article is that we provide a comparison of AIFMM with Hierarchical Off-Diagonal Low-Rank (from now on abbreviated as HODLR) based fast direct solver and NNCA powered GMRES based fast iterative solver. (iv) Additionally, AIFMM is also demonstrated as a preconditioner.


title: Measuring Lorentz Violation in Weak Gravity Fields

abstract: Many new linearized coefficients for Lorentz violation are discovered in our recent work on the construction of a generic Lorentz-violating effective field theory in curved spacetime. The new coefficients can be constrained by experiments in weak gravity fields. In this work, we compare experiments in different gravitational potentials and study three types of gravity-related experiments: free-fall, gravitational interferometer, and gravitational bound-state experiments. First constraints on the new coefficients for Lorentz violation are extracted from those experiments.


title: Typing of data transfer processes in the information system within the framework of threat modeling

abstract: Work is aimed at automating the process of obtaining a list of security threats aimed at the information system in the work processes of data transfer are considered, definitions for each process are presented. The typification of processes and the formalization of the list of basic data transfer processes are considered. Based on the presented typical data transmission processes, schemes of these processes have been developed that describe transmission channels and information carriers.


title: Ensemble-learning error mitigation for variational quantum shallow-circuit classifiers

abstract: Classification is one of the main applications of supervised learning. Recent advancement in developing quantum computers has opened a new possibility for machine learning on such machines. Due to the noisy performance of near-term quantum computers, error mitigation techniques are essential for extracting meaningful data from noisy raw experimental measurements. Here, we propose two ensemble-learning error mitigation methods, namely bootstrap aggregating and adaptive boosting, which can significantly enhance the performance of variational quantum classifiers for both classical and quantum datasets. The idea is to combine several weak classifiers, each implemented on a shallow noisy quantum circuit, to make a strong one with high accuracy. While both of our protocols substantially outperform error-mitigated primitive classifiers, the adaptive boosting shows better performance than the bootstrap aggregating. The protocols have been exemplified for classical handwriting digits as well as quantum phase discrimination of a symmetry-protected topological Hamiltonian, in which we observe a significant improvement in accuracy. Our ensemble-learning methods provide a systematic way of utilising shallow circuits to solve complex classification problems.


title: A thorough investigation of the prospects of eLISA in addressing the Hubble tension: Fisher Forecast, MCMC and Machine Learning

abstract: We carry out an in-depth analysis of the capability of the upcoming space-based gravitational wave mission eLISA in addressing the Hubble tension, with a primary focus on observations at intermediate redshifts ($3<z<8$). We consider six different parametrizations representing different classes of cosmological models, which we constrain using the latest datasets of cosmic microwave background (CMB), baryon acoustic oscillations (BAO), and type Ia supernovae (SNIa) observations, in order to find out the up-to-date tensions with direct measurement data. Subsequently, these constraints are used as fiducials to construct mock catalogs for eLISA. We then employ Fisher analysis to forecast the future performance of each model in the context of eLISA. We further implement traditional Markov Chain Monte Carlo (MCMC) to estimate the parameters from the simulated catalogs. Finally, we utilize Gaussian Processes (GP), a machine learning algorithm, for reconstructing the Hubble parameter directly from simulated data. Based on our analysis, we present a thorough comparison of the three methods as forecasting tools. Our Fisher analysis confirms that eLISA would constrain the Hubble constant ($H_0$) at the sub-percent level. MCMC/GP results predict reduced tensions for models/fiducials which are currently harder to reconcile with direct measurements of $H_0$, whereas no significant change occurs for models/fiducials at lesser tensions with the latter. This feature warrants further investigation in this direction.


title: Solvent quality and solvent polarity in polypeptides

abstract: Using molecular dynamics and thermodynamic integration, we report on the solvation process in water and in cyclohexane of seven polypeptides (GLY, ALA, ILE, ASN, LYS, ARG, GLU). The polypeptides are selected to cover the full hydrophobic scale while varying their chain length from tri- to undeca-homopeptides provide indications on possible non-additivity effects as well as the role of the peptide backbone in the overall stability of the polypeptides. The use of different solvents and different polypeptides allows us to investigate the relation between solvent quality -- the capacity of a given solvent to fold a given biopolymer often described on a scale ranging from "good" to "poor", and solvent polarity -- related to the specific interactions of any solvent with respect to a reference solvent. Undeca-glycine is found to be the only polypeptides to have a proper stable collapse in water (polar solvent), with the other hydrophobic polypetides displaying in water repeated folding and unfolding events and with polar polypeptides presenting a even more complex behavior. By contrast, all polypeptides but none are found to keep an extended conformation in cyclohexane, irrespective of their polarity. All considered polypeptides are also found to have a favorable solvation free energy independently of the solvent polarity and their intrinsic hydrophobicity, clearly highlighting the prominent stabilizing role of the peptide backbone, with the solvation process largely enthalpically dominated in polar polypeptides and partially entropically driven for hydrophobic polypeptides. Our study thus reveals the complexity of the solvation process of polypeptides defying the common view " like dissolves like", with the solute polarity playing the most prominent role. The absence of a mirror symmetry upon the inversion of polarities of both the solvent and the polypeptides is confirmed.


title: Machine Learning with High-Cardinality Categorical Features in Actuarial Applications

abstract: High-cardinality categorical features are pervasive in actuarial data (e.g. occupation in commercial property insurance). Standard categorical encoding methods like one-hot encoding are inadequate in these settings. In this work, we present a novel _Generalised Linear Mixed Model Neural Network_ ("GLMMNet") approach to the modelling of high-cardinality categorical features. The GLMMNet integrates a generalised linear mixed model in a deep learning framework, offering the predictive power of neural networks and the transparency of random effects estimates, the latter of which cannot be obtained from the entity embedding models. Further, its flexibility to deal with any distribution in the exponential dispersion (ED) family makes it widely applicable to many actuarial contexts and beyond. We illustrate and compare the GLMMNet against existing approaches in a range of simulation experiments as well as in a real-life insurance case study. Notably, we find that the GLMMNet often outperforms or at least performs comparably with an entity embedded neural network, while providing the additional benefit of transparency, which is particularly valuable in practical applications. Importantly, while our model was motivated by actuarial applications, it can have wider applicability. The GLMMNet would suit any applications that involve high-cardinality categorical variables and where the response cannot be sufficiently modelled by a Gaussian distribution.


title: UzbekTagger: The rule-based POS tagger for Uzbek language

abstract: This research paper presents a part-of-speech (POS) annotated dataset and tagger tool for the low-resource Uzbek language. The dataset includes 12 tags, which were used to develop a rule-based POS-tagger tool. The corpus text used in the annotation process was made sure to be balanced over 20 different fields in order to ensure its representativeness. Uzbek being an agglutinative language so the most of the words in an Uzbek sentence are formed by adding suffixes. This nature of it makes the POS-tagging task difficult to find the stems of words and the right part-of-speech they belong to. The methodology proposed in this research is the stemming of the words with an affix/suffix stripping approach including database of the stem forms of the words in the Uzbek language. The tagger tool was tested on the annotated dataset and showed high accuracy in identifying and tagging parts of speech in Uzbek text. This newly presented dataset and tagger tool can be used for a variety of natural language processing tasks such as language modeling, machine translation, and text-to-speech synthesis. The presented dataset is the first of its kind to be made publicly available for Uzbek, and the POS-tagger tool created can also be used as a pivot to use as a base for other closely-related Turkic languages.


title: Impact of solvent on state-to-state population transport in multistate systems using coherences

abstract: Understanding the pathways taken by a quantum particle during a transport process is an enormous challenge. There are broadly two different aspects of the problem that affect the route taken. First is obviously the couplings between the various sites, which translates into the intrinsic "strength" of a state-to-state channel. Apart from the inter-state couplings, the solvents affecting the energies of the state, and their relative coupling strengths and time-scales form the second factor. This impact of dissipative media is significantly more difficult to analyze. Building on recently derived relations between coherences and population derivatives, we present an analysis of the transport that allows us to account for both the effects in a rigorous manner. We demonstrate the richness hidden behind the transport even for a relatively simple system, a 4-site coarse-grained model of the Fenna-Matthews-Olson complex. The effect of the local dissipative media is highly non-trivial. We show that while the impact on the total site population may be small, there are dramatic changes to the pathway taken by the transport process. The ability to untangle the dynamics at a greater granularity opens up possibilities in terms of design of novel systems with an eye towards quantum control.


title: Delayed Stochastic Algorithms for Distributed Weakly Convex Optimization

abstract: This paper studies delayed stochastic algorithms for weakly convex optimization in a distributed network with workers connected to a master node. Recently, Xu et al. 2022 showed that an inertial stochastic subgradient method converges at a rate of $\mathcal{O}(\tau_{\text{max}}/\sqrt{K})$ which depends on the maximum information delay $\tau_{\text{max}}$. In this work, we show that the delayed stochastic subgradient method ($\texttt{DSGD}$) obtains a tighter convergence rate which depends on the expected delay $\bar{\tau}$. Furthermore, for an important class of composition weakly convex problems, we develop a new delayed stochastic prox-linear ($\texttt{DSPL}$) method in which the delays only affect the high-order term in the complexity rate and hence, are negligible after a certain number of $\texttt{DSPL}$ iterations. In addition, we demonstrate the robustness of our proposed algorithms against arbitrary delays. By incorporating a simple safeguarding step in both methods, we achieve convergence rates that depend solely on the number of workers, eliminating the effect of the delay. Our numerical experiments further confirm the empirical superiority of our proposed methods.


title: Importance Weighted Actor-Critic for Optimal Conservative Offline Reinforcement Learning

abstract: We propose A-Crab (Actor-Critic Regularized by Average Bellman error), a new practical algorithm for offline reinforcement learning (RL) in complex environments with insufficient data coverage. Our algorithm combines the marginalized importance sampling framework with the actor-critic paradigm, where the critic returns evaluations of the actor (policy) that are pessimistic relative to the offline data and have a small average (importance-weighted) Bellman error. Compared to existing methods, our algorithm simultaneously offers a number of advantages: (1) It achieves the optimal statistical rate of $1/\sqrt{N}$ -- where $N$ is the size of offline dataset -- in converging to the best policy covered in the offline dataset, even when combined with general function approximators. (2) It relies on a weaker average notion of policy coverage (compared to the $\ell_\infty$ single-policy concentrability) that exploits the structure of policy visitations. (3) It outperforms the data-collection behavior policy over a wide range of specific hyperparameters. We provide both theoretical analysis and experimental results to validate the effectiveness of our proposed algorithm.