title: Optimal Online Learning using Potential Functions

abstract: We study a family of potential functions for online learning. We show that if the potential function has strictly positive derivatives of order 1-4 then the min-max optimal strategy for the adversary is Brownian motion. Using that fact we analyze different potential functions and show that the Normal-Hedge potential provides the tightest upper bounds on the cumulative regret of the top {\epsilon}-percentile.


title: Underwater Image Restoration via Contrastive Learning and a Real-world Dataset

abstract: Underwater image restoration is of significant importance in unveiling the underwater world. Numerous techniques and algorithms have been developed in the past decades. However, due to fundamental difficulties associated with imaging/sensing, lighting, and refractive geometric distortions, in capturing clear underwater images, no comprehensive evaluations have been conducted of underwater image restoration. To address this gap, we have constructed a large-scale real underwater image dataset, dubbed `HICRD' (Heron Island Coral Reef Dataset), for the purpose of benchmarking existing methods and supporting the development of new deep-learning based methods. We employ accurate water parameter (diffuse attenuation coefficient) in generating reference images. There are 2000 reference restored images and 6003 original underwater images in the unpaired training set. Further, we present a novel method for underwater image restoration based on unsupervised image-to-image translation framework. Our proposed method leveraged contrastive learning and generative adversarial networks to maximize the mutual information between raw and restored images. Extensive experiments with comparisons to recent approaches further demonstrate the superiority of our proposed method. Our code and dataset are publicly available at GitHub.


title: Challenges in Translation of Emotions in Multilingual User-Generated Content: Twitter as a Case Study

abstract: Although emotions are universal concepts, transferring the different shades of emotion from one language to another may not always be straightforward for human translators, let alone for machine translation systems. Moreover, the cognitive states are established by verbal explanations of experience which is shaped by both the verbal and cultural contexts. There are a number of verbal contexts where expression of emotions constitutes the pivotal component of the message. This is particularly true for User-Generated Content (UGC) which can be in the form of a review of a product or a service, a tweet, or a social media post. Recently, it has become common practice for multilingual websites such as Twitter to provide an automatic translation of UGC to reach out to their linguistically diverse users. In such scenarios, the process of translating the user's emotion is entirely automatic with no human intervention, neither for post-editing nor for accuracy checking. In this research, we assess whether automatic translation tools can be a successful real-life utility in transferring emotion in user-generated multilingual data such as tweets. We show that there are linguistic phenomena specific of Twitter data that pose a challenge in translation of emotions in different languages. We summarise these challenges in a list of linguistic features and show how frequent these features are in different language pairs. We also assess the capacity of commonly used methods for evaluating the performance of an MT system with respect to the preservation of emotion in the source text.


title: Constrained randomization and statistical inference for multi-arm parallel cluster randomized controlled trials

abstract: A practical limitation of cluster randomized controlled trials (cRCTs) is that the number of available clusters may be small, resulting in an increased risk of baseline imbalance under simple randomization. Constrained randomization overcomes this issue by restricting the allocation to a subset of randomization schemes where sufficient overall covariate balance across comparison arms is achieved. However, for multi-arm cRCTs, several design and analysis issues pertaining to constrained randomization have not been fully investigated. Motivated by an ongoing multi-arm cRCT, we elaborate the method of constrained randomization and provide a comprehensive evaluation of the statistical properties of model-based and randomization-based tests under both simple and constrained randomization designs in multi-arm cRCTs, with varying combinations of design and analysis-based covariate adjustment strategies. In particular, as randomization-based tests have not been extensively studied in multi-arm cRCTs, we additionally develop most-powerful randomization tests under the linear mixed model framework for our comparisons. Our results indicate that under constrained randomization, both model-based and randomization-based analyses could gain power while preserving nominal type I error rate, given proper analysis-based adjustment for the baseline covariates. Randomization-based analyses, however, are more robust against violations of distributional assumptions. The choice of balance metrics and candidate set sizes and their implications on the testing of the pairwise and global hypotheses are also discussed. Finally, we caution against the design and analysis of multi-arm cRCTs with an extremely small number of clusters, due to insufficient degrees of freedom and the tendency to obtain an overly restricted randomization space.


title: Uncertainty and Value of Information in Risk Prediction Modeling

abstract: Background: Due to the finite size of the development sample, predicted probabilities from a risk prediction model are inevitably uncertain. We apply Value of Information methodology to evaluate the decision-theoretic implications of prediction uncertainty. Methods: Adopting a Bayesian perspective, we extend the definition of the Expected Value of Perfect Information (EVPI) from decision analysis to net benefit calculations in risk prediction. In the context of model development, EVPI is the expected gain in net benefit by using the correct predictions as opposed to predictions from a proposed model. We suggest bootstrap methods for sampling from the posterior distribution of predictions for EVPI calculation using Monte Carlo simulations. In a case study, we used subsets of data of various sizes from a clinical trial for predicting mortality after myocardial infarction to show how EVPI changes with sample size. Results: With a sample size of 1,000 and at the pre-specified threshold of 2% on predicted risks, the gain in net benefit by using the proposed and the correct models were 0.0006 and 0.0011, respectively, resulting in an EVPI of 0.0005 and a relative EVPI of 87%. EVPI was zero only at unrealistically high thresholds (>85%). As expected, EVPI declined with larger samples. We summarize an algorithm for incorporating EVPI calculations into the commonly used bootstrap method for optimism correction. Conclusion: Value of Information methods can be applied to explore decision-theoretic consequences of uncertainty in risk prediction and can complement inferential methods when developing risk prediction models. R code for implementing this method is provided.


title: Ricci solitons and certain related metrics on 3-dimensional trans-Sasakian manifold

abstract: In this paper we study certain types of metrics such as Ricci soliton, $*$-conformal Ricci soliton in 3-dimensional trans-Sasakian manifold. First we have shown that a 3-dimensional trans-Sasakian manifold of type $(\alpha,\beta)$ admits a Ricci soliton where the covariant derivative of potential vector field in the direction of unit vector field $\xi$ is orthogonal to $\xi$. It is also shown that if the structure functions satisfy $\alpha^2=\beta^2$ then the covariant derivative of the potential vector field in the direction of $\xi$ is a constant multiple of $\xi$. Further, we have evolved the nature of scalar curvature when the manifold satisfies $*$-conformal Ricci soliton of type $(\alpha,\beta)$, provided $\alpha \neq 0$. Finally, we present an example to verify our findings.


title: Semiparametric inference for partially linear regressions with Box-Cox transformation

abstract: In this paper, a semiparametric partially linear model in the spirit of Robinson (1988) with Box- Cox transformed dependent variable is studied. Transformation regression models are widely used in applied econometrics to avoid misspecification. In addition, a partially linear semiparametric model is an intermediate strategy that tries to balance advantages and disadvantages of a fully parametric model and nonparametric models. A combination of transformation and partially linear semiparametric model is, thus, a natural strategy. The model parameters are estimated by a semiparametric extension of the so called smooth minimum distance (SmoothMD) approach proposed by Lavergne and Patilea (2013). SmoothMD is suitable for models defined by conditional moment conditions and allows the variance of the error terms to depend on the covariates. In addition, here we allow for infinite-dimension nuisance parameters. The asymptotic behavior of the new SmoothMD estimator is studied under general conditions and new inference methods are proposed. A simulation experiment illustrates the performance of the methods for finite samples.


title: GIARPS High-resolution Observations of T Tauri stars (GHOsT). III. A pilot study of stellar and accretion properties

abstract: The mass-accretion rate, Macc, is a crucial parameter for the study of the evolution of accretion disks around young low-mass stellar objects (YSOs) and for planet formation studies. The Taurus star forming region (SFR) is rich in pre-main sequence (PMS) stars, most of them of the T Tauri class. A variety of methodologies have been used in the past to measure mass accretion in samples of YSOs in Taurus, but despite being a general benchmark for star formation studies, a comprehensive and systematic analysis of the Taurus T Tauri population, where the stellar and accretion properties are derived homogeneously and simultaneously, is still missing. As part of the GIARPS High-resolution Observations of T Tauri stars (GHOsT) project, here we present a pilot study of the stellar and accretion properties of seven YSOs in Taurus using the spectrograph GIARPS at the Telescopio Nazionale Galileo (TNG). Contemporaneous low-resolution spectroscopic and photometric ancillary observations allow us to perform an accurate flux calibration of the high-resolution spectra. The simultaneity of the high-resolution, wide-band spectroscopic observations, from the optical to the near-infrared (NIR), the veiling measurements in such wide spectral range, and many well-calibrated emission line diagnostics allows us to derive the stellar and accretion properties of the seven YSOs in a homogeneous and self-consistent way. The procedures and methodologies presented here will be adopted in future works for the analysis of the complete GHOsT data set. We discuss the accretion properties of the seven YSOs in comparison with the 90\% complete sample of YSOs in the Lupus SFR and investigate possibilities for the origin of the continuum excess emission in the NIR. }


title: Analytical and numerical study of the hidden boundary of practical stability: complex versus real Lorenz systems

abstract: This work presents the continuation of the recent article "The Lorenz system: hidden boundary of practical stability and the Lyapunov dimension", published in the Nonlinear Dynamics journal. In this work, in comparison with the results for classical real-valued Lorenz system (henceforward -- Lorenz system), the problem of analytical and numerical identification of the boundary of global stability for the complex-valued Lorenz system (henceforward -- complex Lorenz system) is studied. As in the case of the Lorenz system, to estimate the inner boundary of global stability the possibility of using the mathematical apparatus of Lyapunov functions (namely, the Barbashin-Krasovskii and LaSalle theorems) is demonstrated. For additional analysis of homoclinic bifurcations in complex Lorenz system a special analytical approach by Vladimirov is utilized. To outline the outer boundary of global stability and identify the so-called hidden boundary of global stability, possible birth of hidden attractors and transient chaotic sets is analyzed.


title: A class of smooth, possibly data-adaptive nonparametric copula estimators containing the empirical beta copula

abstract: A broad class of smooth, possibly data-adaptive nonparametric copula estimators that contains empirical Bernstein copulas introduced by Sancetta and Satchell (and thus the empirical beta copula proposed by Segers, Sibuya and Tsukahara) is studied. Within this class, a subclass of estimators that depend on a scalar parameter determining the amount of marginal smoothing and a functional parameter controlling the shape of the smoothing region is specifically considered. Empirical investigations of the influence of these parameters suggest to focus on two particular data-adaptive smooth copula estimators that were found to be uniformly better than the empirical beta copula in all of the considered Monte Carlo experiments. Finally, with future applications to change-point detection in mind, conditions under which related sequential empirical copula processes converge weakly are provided.


title: Parametric generation of spin waves in nano-scaled magnonic conduits

abstract: The research feld of magnonics proposes a low-energy wave-logic computation technology based on spin waves to complement the established CMOS technology and provide a basis for emerging unconventional computation architectures. However, magnetic damping is a limiting factor for all-magnonic logic circuits and multi-device networks, ultimately rendering mechanisms to effciently manipulate and amplify spin waves a necessity. In this regard, parallel pumping is a versatile tool since it allows to selectively generate and amplify spin waves. While extensively studied in microscopic systems, nano-scaled systems are lacking investigation to assess the feasibility and potential future use of parallel pumping in magnonics. Here, we investigate a longitudinally magnetized 100 nm-wide magnonic nano-conduit using space and time-resolved micro-focused Brillouin-light-scattering spectroscopy. Employing parallel pumping to generate spin waves, we observe that the non-resonant excitation of dipolar spin waves is favored over the resonant excitation of short wavelength exchange spin waves. In addition, we utilize this technique to access the effective spin-wave relaxation time of an individual nano-conduit, observing a large relaxation time up to (115.0 +- 7.6) ns. Despite the significant decrease of the pumping effciency in the investigated nano-conduit, a reasonably small threshold is found rendering parallel pumping feasible on the nano-scale.


title: A simple, combinatorial proof of Gowers Dichotomy for Banach Spaces

abstract: In this paper we present a simple proof of Gowers Dichotomy which states that every infinite dimensional Banach Space has a subspace which either contains an unconditional basic sequence or is hereditarily indecomposable. Our approach is purely combinatorial and mainly based on work of Ellentuck, Galvin and Prikry in infinite Ramsey theory.


title: Derived Langlands VIII: Local GLn

abstract: In this, the eighth article in my Derived Langlands series, I describe the construction of a 2-variable L-function for two representations of general linear groups of a $p$-adic local field. Due to extenuating health circumstances, many of the proofs and ideas herein are suggestive rather than the finished definitive versions.


title: Knaster and friends III: Subadditive colorings

abstract: We continue our study of strongly unbounded colorings, this time focusing on subadditive maps. In Part I of this series, we showed that, for many pairs of infinite cardinals $\theta<\kappa$, the existence of a strongly unbounded coloring $c:[\kappa]^2 \rightarrow\theta$ is a theorem of ZFC. Adding the requirement of subadditivity to a strongly unbounded coloring is a significant strengthening, though, and here we see that in many cases the existence of a subadditive strongly unbounded coloring is independent of ZFC. We connect the existence of subadditive strongly unbounded colorings with a number of other infinitary combinatorial principles, including the narrow system property, the existence of $\kappa$-Aronszajn trees with ascent paths, and square principles. In particular, we show that the existence of a closed, subadditive, strongly unbounded coloring is equivalent to a certain weak indexed square principle. We conclude the paper with an application to the failure of the infinite productivity of $\kappa$-stationarily layered posets, answering a question of Cox.


title: Neighborhood Contrastive Learning for Novel Class Discovery

abstract: In this paper, we address Novel Class Discovery (NCD), the task of unveiling new classes in a set of unlabeled samples given a labeled dataset with known classes. We exploit the peculiarities of NCD to build a new framework, named Neighborhood Contrastive Learning (NCL), to learn discriminative representations that are important to clustering performance. Our contribution is twofold. First, we find that a feature extractor trained on the labeled set generates representations in which a generic query sample and its neighbors are likely to share the same class. We exploit this observation to retrieve and aggregate pseudo-positive pairs with contrastive learning, thus encouraging the model to learn more discriminative representations. Second, we notice that most of the instances are easily discriminated by the network, contributing less to the contrastive loss. To overcome this issue, we propose to generate hard negatives by mixing labeled and unlabeled samples in the feature space. We experimentally demonstrate that these two ingredients significantly contribute to clustering performance and lead our model to outperform state-of-the-art methods by a large margin (e.g., clustering accuracy +13% on CIFAR-100 and +8% on ImageNet).


title: Aspects of strong electron-phonon coupling in superconductivity of compressed metal hydrides MH6 with Im-3m structure

abstract: Recently YH6, compound from a group of theoretically predicted stable compressed MH6 hydrides (M/ Ca, Mg, Y, Sc) with bcc Im-3m crystal structure, was successfully experimentally realized. Superconductivity of pressurized YH6 was confirmed experimentally, Tc / 224 K at 166 GPa, but with critical temperature considerably lower than value predicted by Migdal-Eliashberg (ME) theory. Here we present theoretical reinvestigation of superconductivity in MH6 hydrides. Our results confirm that YH6 and ScH6 with Im-3m structure at corresponding GPa pressures are superconductors but with an antiadiabatic character of superconducting ground state and a multiple gap structure in one-particle spectrum. Transition into superconducting state is driven by strong electron-phonon coupling with phonon modes of H atom vibrations. Based on antiadiabatic theory, calculated critical temperature in YH6 is 231 K which is by 7 K higher than experimental value. For ScH6 calculated critical temperature is 196 K, which is in this case higher by 27 K than former theoretical prediction -169 K.Important results of applied antiadiabatic theory concerns CaH6 and MgH6 in Im-3m structure at corresponding GPa pressures. Theory indicates that these hydrides are not superconductors. It is in sharp contradiction to former predictions based on ME theory which for these hydrides calculated not only Tc well above 200 K, but for MgH6 critical temperature was predicted substantially higher than 300 K. Unfortunately, high pressure synthesis of CaH6, MgH6 nor ScH6, in Im-3m structure has not been realized until present.


title: Mobile Sensing for Multipurpose Applications in Transportation

abstract: Routine and consistent data collection is required to address contemporary transportation issues.The cost of data collection increases significantly when sophisticated machines are used to collect data. Due to this constraint, State Departments of Transportation struggles to collect consistent data for analyzing and resolving transportation problems in a timely manner. Recent advancements in the sensors integrated into smartphones have resulted in a more affordable method of data collection.The primary objective of this study is to develop and implement a smartphone application for data collection.The currently designed app consists of three major modules: a frontend graphical user interface (GUI), a sensor module, and a backend module. While the frontend user interface enables interaction with the app, the sensor modules collect relevant data such as video and accelerometer readings while the app is in use. The backend, on the other hand, is made up of firebase storage, which is used to store the gathered data.In comparison to other developed apps for collecting pavement information, this current app is not overly reliant on the internet enabling the app to be used in areas of restricted internet access.The developed application was evaluated by collecting data on the i70W highway connecting Columbia, Missouri, and Kansas City, Missouri.The data was analyzed for a variety of purposes, including calculating the International Roughness Index (IRI), identifying pavement distresses, and understanding driver's behaviour and environment .The results of the application indicate that the data collected by the app is of high quality.


title: Is Shapley Value fair? Improving Client Selection for Mavericks in Federated Learning

abstract: Shapley Value is commonly adopted to measure and incentivize client participation in federated learning. In this paper, we show -- theoretically and through simulations -- that Shapley Value underestimates the contribution of a common type of client: the Maverick. Mavericks are clients that differ both in data distribution and data quantity and can be the sole owners of certain types of data. Selecting the right clients at the right moment is important for federated learning to reduce convergence times and improve accuracy. We propose FedEMD, an adaptive client selection strategy based on the Wasserstein distance between the local and global data distributions. As FedEMD adapts the selection probability such that Mavericks are preferably selected when the model benefits from improvement on rare classes, it consistently ensures the fast convergence in the presence of different types of Mavericks. Compared to existing strategies, including Shapley Value-based ones, FedEMD improves the convergence of neural network classifiers by at least 26.9% for FedAvg aggregation compared with the state of the art.


title: Bohr type inequality for {C}es\'{a}ro and {B}ernardi integral operator on simply connected domain

abstract: In this article, we study the Bohr type inequality for {C}es\'{a}ro operator and {B}ernardi integral operator acting on the space of analytic functions defined on a simply connected domain containing the unit disk $\mathbb{D}$.


title: Circular orderability of 3-manifold groups

abstract: This paper initiates the study of circular orderability of $3$-manifold groups, motivated by the L-space conjecture. We show that a compact, connected, $\mathbb{P}^2$-irreducible $3$-manifold has a circularly orderable fundamental group if and only if there exists a finite cyclic cover with left-orderable fundamental group, which naturally leads to a "circular orderability version" of the L-space conjecture. We also show that the fundamental groups of almost all graph manifolds are circularly orderable, and contrast the behaviour of circularly orderability and left-orderability with respect to the operations of Dehn surgery and taking cyclic branched covers.


title: Windowing and random weighting based cubature RTS smoothing for target tracking

abstract: This paper presents windowing and random weighting (WRW) based adaptive cubature Rauch Tung Striebel (CRTS) smoother (WRWACRTS). The Unscented KF (WRWUKF) has already existed as an alternative to nonlinear smoothing solutions. In the proposed method, both windowing and random weighted estimation methods are combined together and used to estimate the noise statistics. Subsequently, the weights of each window are adjusting randomly, and update the process and measurement noise covariances matrices at each epoch. The developed WRWACRTS algorithm overcomes the limitation of the conventional CKS. The Lyapunov function-based approach is used to investigate the convergence proof of the WRWACRTS algorithm. A numerical example is shown to demonstrate the performance of the proposed algorithm.


title: Soliton resolution for energy-critical wave maps in the equivariant case

abstract: We consider the equivariant wave maps equation $\mathbb{R}^{1+2} \to \mathbb{S}^2$, in all equivariance classes $k \in \mathbb{N}$. We prove that every finite energy solution resolves, continuously in time, into a superposition of asymptotically decoupling harmonic maps and free radiation.


title: One- and Two-Photon Localization in Quantum Optics

abstract: We consider the lattice analog of a recently proposed continuum model for the propagation of one- and two-photon states in a random medium. We find that there is localization of single photons in an energy band centered at the resonant energy of the atoms. Moreover, there is also localization of photons at arbitrarily large energies. For the case of two photons, there is localization in an energy band centered at twice the resonant frequency.


title: Flash Crash for Cash: Cyber Threats in Decentralized Finance

abstract: Decentralized Finance (DeFi) took shape in 2020. An unprecedented amount of over 14 billion USD moved into DeFi projects offering trading, loans and insurance. But its growth has also drawn the attention of malicious actors. Many projects were exploited as quickly as they launched and millions of USD were lost. While many developers understand integer overflows and reentrancy attacks, security threats to the DeFi ecosystem are more complex and still poorly understood. In this paper we provide the first overview of in-the-wild DeFi security incidents. We observe that many of these exploits are market attacks, weaponizing weakly implemented business logic in one protocol with credit provided by another to inflate appropriations. Rather than misusing individual protocols, attackers increasingly use DeFi's strength of permissionless composability against itself. By providing the first holistic analysis of real-world security incidents within the nascent financial ecosystem DeFi is, we hope to inform threat modeling in decentralized cryptoeconomic initiatives in the years ahead.


title: Spin Dependent Gravitational Tail Memory in $D=4$

abstract: We derive the leading spin-dependent gravitational tail memory, which appears at the second post-Minkowskian (2 PM) order and behaves as $u^{-2}$ for large retarded time $u$. This result follows from classical soft graviton theorem at order $\omega\ln\omega$ as a low-frequency expansion of gravitational waveform with frequency $\omega$. First, we conjecture the result from the classical limit of quantum soft graviton theorem up to sub-subleading order in soft expansion and then we derive it for a classical scattering process without any reference to the soft graviton theorem. The final result of the gravitational waveform in the direct derivation completely agrees with the conjectured result.


title: A new approach to projectivity in the categories of complexes

abstract: Recently, several authors have adopted new alternative approaches in the study of some classical notions of modules. Among them, we find the notion of subprojectivity which was introduced to measure in a way the degree of projectivity of modules. The study of subprojectivity has recently been extended to the context of abelian categories, which has brought to light some interesting new aspects. For instance, in the category of complexes, it gives a new way to measure, among other things, the exactness of complexes. In this paper, we prove that the subprojectivity notion provides a new sight of null-homotopic morphisms in the category of complexes. This will be proven through two main results. Moreover, various results which emphasize the importance of subprojectivity in the category of complexes are also given. Namely, we give some applications by characterizing some classical rings and establish various examples that allow us to reflect the scope and limits of our results.


title: Quantum electrodynamics in anisotropic and tilted Dirac photonic lattices

abstract: One of the most striking predictions of quantum electrodynamics is that vacuum fluctuations of the electromagnetic field can lead to spontaneous emission of atoms as well as photon-mediated interactions among them. Since these processes strongly depend on the nature of the photonic bath, a current burgeoning field is the study of their modification in the presence of photons with non-trivial energy dispersions, e.g., the ones confined in photonic crystals. A remarkable example is the case of isotropic Dirac-photons, which has been recently shown to lead to non-exponential spontaneous emission as well as dissipation-less long-range emitter interactions. In this work, we show how to further tune these processes by considering anisotropic Dirac cone dispersions, which include tilted, semi-Dirac, and the recently discovered type II and III Dirac points. In particular, we show how by changing the anisotropy of the lattice one can change both the spatial shape of the interactions as well as its coherent/incoherent nature. Finally, we discuss a possible implementation where these energy dispersions can be engineered and interfaced with quantum emitters based on subwavelength atomic arrays.


title: On the Cryptographic Hardness of Learning Single Periodic Neurons

abstract: We show a simple reduction which demonstrates the cryptographic hardness of learning a single periodic neuron over isotropic Gaussian distributions in the presence of noise. More precisely, our reduction shows that any polynomial-time algorithm (not necessarily gradient-based) for learning such functions under small noise implies a polynomial-time quantum algorithm for solving worst-case lattice problems, whose hardness form the foundation of lattice-based cryptography. Our core hard family of functions, which are well-approximated by one-layer neural networks, take the general form of a univariate periodic function applied to an affine projection of the data. These functions have appeared in previous seminal works which demonstrate their hardness against gradient-based (Shamir'18), and Statistical Query (SQ) algorithms (Song et al.'17). We show that if (polynomially) small noise is added to the labels, the intractability of learning these functions applies to all polynomial-time algorithms, beyond gradient-based and SQ algorithms, under the aforementioned cryptographic assumptions. Moreover, we demonstrate the necessity of noise in the hardness result by designing a polynomial-time algorithm for learning certain families of such functions under exponentially small adversarial noise. Our proposed algorithm is not a gradient-based or an SQ algorithm, but is rather based on the celebrated Lenstra-Lenstra-Lov\'asz (LLL) lattice basis reduction algorithm. Furthermore, in the absence of noise, this algorithm can be directly applied to solve CLWE detection (Bruna et al.'21) and phase retrieval with an optimal sample complexity of $d+1$ samples. In the former case, this improves upon the quadratic-in-$d$ sample complexity required in (Bruna et al.'21).

categories: cs.LG cs.CC math.PR math.ST stat.ML stat.TH


title: Calliar: An Online Handwritten Dataset for Arabic Calligraphy

abstract: Calligraphy is an essential part of the Arabic heritage and culture. It has been used in the past for the decoration of houses and mosques. Usually, such calligraphy is designed manually by experts with aesthetic insights. In the past few years, there has been a considerable effort to digitize such type of art by either taking a photo of decorated buildings or drawing them using digital devices. The latter is considered an online form where the drawing is tracked by recording the apparatus movement, an electronic pen for instance, on a screen. In the literature, there are many offline datasets collected with a diversity of Arabic styles for calligraphy. However, there is no available online dataset for Arabic calligraphy. In this paper, we illustrate our approach for the collection and annotation of an online dataset for Arabic calligraphy called Calliar that consists of 2,500 sentences. Calliar is annotated for stroke, character, word and sentence level prediction.


title: Random Paraunitary Projections

abstract: Transforms using random matrices have been found to have many applications. We are concerned with the projection of a signal onto Gaussian-distributed random orthogonal bases. We also would like to easily invert the process through transposes in order to facilitate iterative reconstruction. We derive an efficient method to implement random unitary matrices of larger sizes through a set of Givens rotations. Random angles are hierarchically generated on-the-fly and the inverse merely requires traversing the angles in reverse order. Hierarchical randomization of angles also enables reduced storage. Using the random unitary matrices as building blocks we introduce random paraunitary systems (filter banks). We also highlight an efficient implementation of the paraunitary system and of its inverse. We also derive an adaptive under-decimated system, wherein one can control and adapt the amount of projections the signal undergoes, in effect, varying the sampling compression ratio as we go along the signal, without segmenting it. It may locally range from very compressive sampling matrices to (para) unitary random ones. One idea is to adapt to local sparseness characteristics of non-stationary signals.


title: Finite-temperature many-body perturbation theory for electrons: Algebraic recursive definitions, second-quantized derivation, linked-diagram theorem, general-order algorithms, grand canonical and canonical ensembles

abstract: A comprehensive and detailed account is presented for the finite-temperature many-body perturbation theory for electrons that expands in power series all thermodynamic functions on an equal footing. Algebraic recursions in the style of the Rayleigh-Schr\"{o}dinger perturbation theory are derived for the grand potential, chemical potential, internal energy, and entropy in the grand canonical ensemble and for the Helmholtz energy, internal energy, and entropy in the canonical ensemble, leading to their sum-over-states analytical formulas at any arbitrary order. For the grand canonical ensemble, these sum-over-states formulas are systematically transformed to sum-over-orbitals reduced analytical formulas by the quantum-field-theoretical techniques of normal-ordered second quantization and Feynman diagrams extended to finite temperature. It is found that the perturbation corrections to energies entering the recursions have to be treated as a nondiagonal matrix, whose off-diagonal elements are generally nonzero within a subspace spanned by degenerate Slater determinants. They give rise to a unique set of linked diagrams -- renormalization diagrams -- whose resolvent lines are displaced downwards, which are distinct from the well-known anomalous diagrams of which one or more resolvent lines are erased. A linked-diagram theorem is introduced that proves the size-consistency of the finite-temperature many-body perturbation theory at any order. General-order algorithms implementing the recursions establish the convergence of the perturbation series towards the finite-temperature full-configuration-interaction limit unless the series diverges. Normal-ordered Hamiltonian at finite temperature sheds light on the relationship between the finite-temperature Hartree--Fock and first-order many-body perturbation theories.

categories: cond-mat.stat-mech math-ph math.MP physics.chem-ph


title: Spectra of glueballs and oddballs and the equation of state from holographic QCD

abstract: We study the spectra of two-gluon glueballs and three-gluon oddballs and corresponding equation of state in $5$-dimensional deformed holographic QCD models in the graviton-dilaton system, where the metric, the dilaton field and dilaton potential are self-consistently solved from each other through the Einstein field equations and the equation of motion of the dilaton field. We compare the models by inputting the dilaton field, inputting the deformed metric and inputting the dilaton potential, and find that with only 2 parameters, the $5$-dimensional holographic QCD model predictions on glueballs/oddballs spectra in general are in good agreement with lattice results except two oddballs $0^{+-}$ and $2^{+-}$. From the results of glueballs/oddballs spectra at zero temperature and the equation of state at finite temperature, we observe that the model with quadratic dilaton field can simultaneously describe glueballs/oddballs spectra as well as equation of state of pure gluon system. The model with quadratic $A_{E}(z)$ can describe glueballs/oddballs spectra, but its corresponding equation of state behaves more like $N_{f}=2+1$ quark matter. These are consistent with dimension analysis at UV boundary.


title: Electrostatic Force Suspended-Air Multilayer (EPAM) Structure for Highly Transparent Energy Efficient Windows

abstract: The poor thermal insulating building windows, especially single pane windows, are wasting ~7% of the total energy consumed by the U.S. every year. This paper presents an electrostatic force suspended polymer-air multilayer (EPAM) structure as a highly transparent and energy efficient window retrofitting solution for low-income single pane window users. To provide controllable and stable suspension force between large size compliant polymer films without deteriorating their visual transmittance (Vt), corona discharge (CD) was induced to permanently charge polymer films, leading to controllable permanent surface potential difference between two sides of CD charged films. Liquid-solid contact electrification (CE) was combined with CD to realize precise control of the surface potential of each side of polymer films. CD+CE treated films can obtain programmable and stable electrostatic forces to form resilient EPAM structures for cost and energy effective window retrofitting purpose. The resilient EPAM retrofitted windows can provide U-factor lower than 0.5 Btu/hr/ft2/{\deg}F, Vt higher than 70%, haze lower than 1.6% at cost lower than $7.4/ft2, at least 10 times cheaper than double pane windows. The energy saved by EPAM can reach as much as the order of 106 kJ/m2 per year. The CD+CE surface potential programming solution also provides a highly repeatable and controllable way for other electrical potential related technologies.


title: The Chemical Composition of the Solar Surface

abstract: The Sun provides a standard reference against which we compare the chemical abundances found anywhere else in the Universe. Nevertheless, there is not a unique 'solar' composition, since the chemical abundances found in the solar interior, the photosphere, the upper atmosphere, or the solar wind, are not exactly the same. The composition of the solar photosphere, usually preferred as a reference, changes with time due to diffusion, convection, and probably accretion. In addition, we do not know the solar photospheric abundances, inferred from the analysis of the solar spectrum using model atmospheres, with high accuracy, and uncertainties for many elements exceed 25%. This paper gives an overview of the methods and pitfalls of spectroscopic analysis, and discusses the chemistry of the Sun in the context of the solar system.


title: Routing by matching on convex pieces of grid graphs

abstract: The routing number is a graph invariant introduced by Alon, Chung, and Graham in 1994, and it has been studied for trees and other classes of graphs such as hypercubes. It gives the minimum number of routing steps needed to sort a set of distinct tokens, placed one on each vertex, where each routing step swaps a set of disjoint pairs of adjacent tokens. Our main theorem generalizes the known estimate that a rectangular grid graph R with width w(R) and height h(R) has routing number rt(R) in O(w(R)+h(R)). We show that for the subgraph P of the infinite square lattice enclosed by any convex polygon, its routing number rt(P) is in O(w(P)+h(P)).


title: Testing Models of Stellar Structure and Evolution I. Comparison with Detached Eclipsing Binaries

abstract: We present the results of an analysis aimed at testing the accuracy and precision of the PARSEC v1.2S library of stellar evolution models, in a Bayesian framework, to infer stellar parameters. We mainly employ the online DEBCat catalogue by Southworth, a compilation of detached eclipsing binary systems with published measurements of masses and radii to $\sim$ 2 per cent precision. We select a sample of 318 binary components, with masses between 0.10 and 14.5 Msun, at distances between 1.3 pc and ~ 8 kpc for Galactic objects and ~ 44-68 kpc for extragalactic ones. The Bayesian analysis applied takes as input effective temperature, radius, and [Fe/H], and their uncertainties, returning theoretical predictions for other stellar parameters. From the comparison with dynamical masses, we conclude that the inferred masses are precisely derived for stars on the main-sequence and in the core-helium-burning phase, with uncertainties of 4 per cent and 7 per cent, respectively, on average. Masses for subgiants and red giants are predicted within 14 per cent, and those for early asymptotic giant branch stars within 24 per cent. These results are helpful to further improve the models, in particular for advanced evolutionary stages for which our understanding is limited. We obtain distances and ages for the binary systems and compare them, whenever possible, with precise literature estimates, finding excellent agreement. We discuss evolutionary effects and challenges for inferring stellar ages from evolutionary models. We also provide useful polynomial fittings to theoretical zero-age main-sequence relationships.


title: Opportunities and challenges in partitioning the graph measure space of real-world networks

abstract: Based on a large dataset containing thousands of real-world networks ranging from genetic, protein interaction, and metabolic networks to brain, language, ecology, and social networks we search for defining structural measures of the different complex network domains (CND). We calculate 208 measures for all networks and using a comprehensive and scrupulous workflow of statistical and machine learning methods we investigated the limitations and possibilities of identifying the key graph measures of CNDs. Our approach managed to identify well distinguishable groups of network domains and confer their relevant features. These features turn out to be CND specific and not unique even at the level of individual CNDs. The presented methodology may be applied to other similar scenarios involving highly unbalanced and skewed datasets.


title: A SOPHIE RV search for giant planets around young nearby stars (YNS). A combination with the HARPS YNS survey

abstract: The search of close (a<=5 au) giant planet(GP) companions with radial velocity(RV) around young stars and the estimate of their occurrence rates is important to constrain the migration timescales. Furthermore, this search will allow the giant planet occurrence rates to be computed at all separations via the combination with direct imaging techniques. The RV search around young stars is a challenge as they are generally faster rotators than older stars of similar spectral types and they exhibit signatures of spots or pulsation in their RV time series. Specific analyses are necessary to characterize, and possibly correct for, this activity. Our aim is to search for planets around young nearby stars and to estimate the GP occurrence rates for periods up to 1000 days. We used the SOPHIE spectrograph to observe 63 A-M young (<400 Myr) stars. We used our SAFIR software to compute the RVs and other spectroscopic observables. We then combined this survey with the HARPS YNS survey to compute the companion occurrence rates on a total of 120 young A-M stars. We report one new trend compatible with a planetary companion on HD109647. We also report HD105693 and HD112097 as binaries, and we confirm the binarity of HD2454, HD13531, HD17250A, HD28945, HD39587, HD131156, HD 142229, HD186704A, and HD 195943. We constrained for the first time the orbital parameters of HD195943B. We refute the HD13507 single brown dwarf (BD) companion solution and propose a double BD companion solution. Based on our sample of 120 young stars, we obtain a GP occurrence rate of 1_{-0.3}^{+2.2}% for periods lower than 1000 days, and we obtain an upper limit on BD occurrence rateof 0.9_{-0.9}^{+2}% in the same period range. We report a possible lack of close (1<P<1000 days) GPs around young FK stars compared to their older counterparts, with a confidence level of 90%.


title: Online Rank-Revealing Block-Term Tensor Decomposition

abstract: The so-called block-term decomposition (BTD) tensor model, especially in its rank-$(L_r,L_r,1)$ version, has been recently receiving increasing attention due to its enhanced ability of representing systems and signals that are composed of \emph{block} components of rank higher than one, a scenario encountered in numerous and diverse applications. Its uniqueness and approximation have thus been thoroughly studied. The challenging problem of estimating the BTD model structure, namely the number of block terms (rank) and their individual (block) ranks, is of crucial importance in practice and has only recently started to attract significant attention. In data-streaming scenarios and/or big data applications, where the tensor dimension in one of its modes grows in time or can only be processed incrementally, it is essential to be able to perform model selection and computation in a recursive (incremental/online) manner. To date there is only one such work in the literature concerning the (general rank-$(L,M,N)$) BTD model, which proposes an incremental method, however with the BTD rank and block ranks assumed to be a-priori known and time invariant. In this preprint, a novel approach to rank-$(L_r,L_r,1)$ BTD model selection and tracking is proposed, based on the idea of imposing column sparsity jointly on the factors and estimating the ranks as the numbers of factor columns of nonnegligible magnitude. An online method of the alternating iteratively reweighted least squares (IRLS) type is developed and shown to be computationally efficient and fast converging, also allowing the model ranks to change in time. Its time and memory efficiency are evaluated and favorably compared with those of the batch approach. Simulation results are reported that demonstrate the effectiveness of the proposed scheme in both selecting and tracking the correct BTD model.


title: Sums of proper divisors follow the Erd\H{o}s--Kac law

abstract: Let $s(n)=\sum_{d\mid n,~d<n} d$ denote the sum of the proper divisors of $n$. The second-named author proved that $\omega(s(n))$ has normal order $\log\log{n}$, the analogue for $s$-values of a classical result of Hardy and Ramanujan. We establish the corresponding Erd\H{o}s--Kac theorem: $\omega(s(n))$ is asymptotically normally distributed with mean and variance $\log\log{n}$. The same method applies with $s(n)$ replaced by any of several other unconventional arithmetic functions, such as $\beta(n):=\sum_{p\mid n} p$, $n-\phi(n)$, and $n+\tau(n)$ ($\tau$ being the divisor function).


title: First principle investigations of the structural, electronic, and phase stability in 2D layered ZnSb

abstract: Recently, the two dimensional (2D) materials have become a potential candidates for various technological applications in spintronics and optoelectronics. In the present study, the structural, electronic, and phase stability of 2D layered ZnSb compounds of four different phases viz. wurzite(w), tetragonal (t), hexagonal (h), and orthorhombic (o) have been tuned using the first principle calculations based on density functional theory (DFT). We invoked the Perdew-Burke-Ernzerhof (PBE) functional and the projected augmented wave (PAW) method during all the calculations. Based on our numerical results, we predicted the novel tetragonal phase as stable phase of ZnSb next to existing orthorhombic structure. We reported the pressure induced phase transition between orthorhombic to tetragonal phase at 12.48 GPa/atom. The projected density of states indicates the strong p-d hybridization between Sb-5p and Zn-3d states confirming the nature of strong covalent bonding between them. The electronic band structures suggest that t-ZnSb, w-ZnSb, and h-ZnSb are metallic in nature whereas o-ZnSb is semiconducting with narrow band gap of 0.03 eV using PBE. We predicted the possibility of extracting the two dimensional (2D) monolayer sheet in t-ZnSb and o-ZnSb according to the exfoliation energy criterion. In addition, the 2D monolayer (ML) of o-ZnSb has been predicted to be dynamically stable but that of t-ZnSb is not stable as manifested in phonon dispersion bands. Surprisingly, the semiconducting band gap nature of o-ZnSb changes from indirect and narrow to direct and sizable while going from 3D bulk to 2D ML structure. Further, we estimated the value of work functions for the surfaces of t-ZnSb and o-ZnSb as 4.61 eV and 4.04 eV respectively. Such materials can find the niche applications in next generation electronic devices utilizing 2D hetero-structures.


title: Fundamental bounds on the precision of iSCAT, COBRI and dark-field microscopy for 3D localization and mass photometry

abstract: Interferometric imaging is an emerging technique for particle tracking and mass photometry. Mass or position are estimated from weak signals, coherently scattered from nanoparticles or single molecules, and interfered with a co-propagating reference. In this work, we perform a statistical analysis and derive lower bounds on the measurement precision of the parameters of interest from shot-noise limited images. This is done by computing the classical Cram\'er-Rao bound for localization and mass estimation, using a precise vectorial model of interferometric imaging techniques. We then derive fundamental bounds valid for any imaging system, based on the quantum Cram\'er-Rao formalism. This approach enables a rigorous and quantitative comparison of common techniques such as interferometric scattering microscopy (iSCAT), Coherent Brightfield microscopy (COBRI), and dark-field microscopy. In particular, we demonstrate that the light collection geometry in iSCAT greatly increases the axial position sensitivity, and that the Quantum Cram\'er-Rao bound for mass estimation yields a minimum relative estimation error of $\sigma_m/m=1/(2\sqrt{N})$, where $N$ is the number of collected scattered photons.


title: Robust Regression via Model Based Methods

abstract: The mean squared error loss is widely used in many applications, including auto-encoders, multi-target regression, and matrix factorization, to name a few. Despite computational advantages due to its differentiability, it is not robust to outliers. In contrast, l_p norms are known to be robust, but cannot be optimized via, e.g., stochastic gradient descent, as they are non-differentiable. We propose an algorithm inspired by so-called model-based optimization (MBO) [35, 36], which replaces a non-convex objective with a convex model function and alternates between optimizing the model function and updating the solution. We apply this to robust regression, proposing SADM, a stochastic variant of the Online Alternating Direction Method of Multipliers (OADM) [50] to solve the inner optimization in MBO. We show that SADM converges with the rate O(log T/T). Finally, we demonstrate experimentally (a) the robustness of l_p norms to outliers and (b) the efficiency of our proposed model-based algorithms in comparison with gradient methods on autoencoders and multi-target regression.


title: On Stein Variational Neural Network Ensembles

abstract: Ensembles of deep neural networks have achieved great success recently, but they do not offer a proper Bayesian justification. Moreover, while they allow for averaging of predictions over several hypotheses, they do not provide any guarantees for their diversity, leading to redundant solutions in function space. In contrast, particle-based inference methods, such as Stein variational gradient descent (SVGD), offer a Bayesian framework, but rely on the choice of a kernel to measure the similarity between ensemble members. In this work, we study different SVGD methods operating in the weight space, function space, and in a hybrid setting. We compare the SVGD approaches to other ensembling-based methods in terms of their theoretical properties and assess their empirical performance on synthetic and real-world tasks. We find that SVGD using functional and hybrid kernels can overcome the limitations of deep ensembles. It improves on functional diversity and uncertainty estimation and approaches the true Bayesian posterior more closely. Moreover, we show that using stochastic SVGD updates, as opposed to the standard deterministic ones, can further improve the performance.


title: Generalization in the Face of Adaptivity: A Bayesian Perspective

abstract: Repeated use of a data sample via adaptively chosen queries can rapidly lead to overfitting, wherein the empirical evaluation of queries on the sample significantly deviates from their mean with respect to the underlying data distribution. It turns out that simple noise addition algorithms suffice to prevent this issue, and differential privacy-based analysis of these algorithms shows that they can handle an asymptotically optimal number of queries. However, differential privacy's worst-case nature entails scaling such noise to the range of the queries even for highly-concentrated queries, or introducing more complex algorithms. In this paper, we prove that straightforward noise-addition algorithms already provide variance-dependent guarantees that also extend to unbounded queries. This improvement stems from a novel characterization that illuminates the core problem of adaptive data analysis. We show that the harm of adaptivity results from the covariance between the new query and a Bayes factor-based measure of how much information about the data sample was encoded in the responses given to past queries. We then leverage this characterization to introduce a new data-dependent stability notion that can bound this covariance.


title: Physical and chemical properties of Wolf-Rayet planetary nebulae

abstract: Wolf-Rayet ([WR]) and weak emission-line ($wels$) central stars of planetary nebulae (PNe) have hydrogen-deficient atmospheres, whose origins are not well understood. In the present study, we have conducted plasma diagnostics and abundance analyses of 18 Galactic PNe surrounding [WR] and $wels$ nuclei, using collisionally excited lines (CELs) and optical recombination lines (ORLs) measured with the Wide Field Spectrograph on the ANU 2.3-m telescope at the Siding Spring Observatory complemented with optical archival data. Our plasma diagnostics imply that the electron densities and temperatures derived from CELs are correlated with the intrinsic nebular H$\beta$ surface brightness and excitation class, respectively. Self-consistent plasma diagnostics of heavy element ORLs of N${}^{2+}$ and O${}^{2+}$ suggest that a small fraction of cool ($\lesssim 7000$ K), dense ($\sim 10^4-10^5$ cm$^{-3}$) materials may be present in some objects, though with large uncertainties. Our abundance analyses indicate that the abundance discrepancy factors (ADF$\equiv$ORLs/CELs) of O${}^{2+}$ are correlated with the dichotomies between forbidden-line and He I temperatures. Our results likely point to the presence of a tiny fraction of cool, oxygen-rich dense clumps within the diffuse warm ionized nebulae. Moreover, our elemental abundances derived from CELs are mostly consistent with AGB models in the range of initial masses from 1.5 to 5M$_{\odot}$. Further studies are necessary to understand better the origins of abundance discrepancies in PNe around [WR] and $wels$ stars.


title: In-plane anisotropic quantum confinement effect in ultrasmall SnS sheets

abstract: Black phosphorus (BP) analogous tin(II) sulfide (SnS) has recently emerged as an attractive building block for electronic devices due to its highly anisotropic response. Two-dimensional (2D) SnS has shown to exhibit in-plane anisotropy in optical and electrical properties. However, the limitations in growing ultrasmall structures of SnS hinder the experimental exploration of anisotropic behavior in low dimension. Here, we present an elegant approach of synthesizing highly crystalline nanometer-sized SnS sheets. Ultrasmall SnS exhibits two distinct valleys along armchair and zig-zag directions due to in-plane structural anisotropy like bulk SnS. We show that in such SnS nanosheet dots, the band gaps corresponding to two valleys are increased due to quantum confinement effect. We particularly observe that SnS quantum dots (QDs) show excitation energy dependent photoluminescence (PL), which originates from the two nondegenerate valleys. Our work may open up an avenue to show the potential of SnS QDs for new functionalities in electronics and optoelectronics.


title: Microresonator frequency reference for terahertz precision sensing and metrology

abstract: Highly sensitive terahertz (THz) sensors for a myriad of applications are rapidly evolving. A widespread sensor concept is based on the detection of minute resonance frequency shifts due to a targeted specimen in the sensors environment. Therefore, cutting-edge high resolution continuous wave (CW) THz spectrometers provide very powerful tools to investigate the sensors' performances. However, unpredictable yet non negligible frequency drifts common to state-of-the-art CW THz spectrometers limit the sensors' accuracy for ultra-high precision sensing and metrology. Here, we overcome this deficiency by introducing an ultra-high quality (Q) THz microresonator frequency reference. Measuring the sensor's frequency shift relative to a well-defined frequency reference eliminates the unwanted frequency drift, and fully exploits the capabilities of modern CW THz spectrometers as well as THz sensors. In a proof-of-concept experiment, we demonstrate the accurate and repeated detection of minute resonance frequency shifts of less than 5MHz at 0.6THz of a THz microresonator sensor.


title: Dynamic group testing to control and monitor disease progression in a population

abstract: In the context of a pandemic like COVID-19, and until most people are vaccinated, proactive testing and interventions have been proved to be the only means to contain the disease spread. Recent academic work has offered significant evidence in this regard, but a critical question is still open: Can we accurately identify all new infections that happen every day, without this being forbiddingly expensive, i.e., using only a fraction of the tests needed to test everyone everyday (complete testing)? Group testing offers a powerful toolset for minimizing the number of tests, but it does not account for the time dynamics behind the infections. Moreover, it typically assumes that people are infected independently, while infections are governed by community spread. Epidemiology, on the other hand, does explore time dynamics and community correlations through the well-established continuous-time SIR stochastic network model, but the standard model does not incorporate discrete-time testing and interventions. In this paper, we introduce a "discrete-time SIR stochastic block model" that also allows for group testing and interventions on a daily basis. Our model can be regarded as a discrete version of the continuous-time SIR stochastic network model over a specific type of weighted graph that captures the underlying community structure. We analyze that model w.r.t. the minimum number of group tests needed everyday to identify all infections with vanishing error probability. We find that one can leverage the knowledge of the community and the model to inform nonadaptive group testing algorithms that are order-optimal, and therefore achieve the same performance as complete testing using a much smaller number of tests.


title: Learning to Track Object Position through Occlusion

abstract: Occlusion is one of the most significant challenges encountered by object detectors and trackers. While both object detection and tracking has received a lot of attention in the past, most existing methods in this domain do not target detecting or tracking objects when they are occluded. However, being able to detect or track an object of interest through occlusion has been a long standing challenge for different autonomous tasks. Traditional methods that employ visual object trackers with explicit occlusion modeling experience drift and make several fundamental assumptions about the data. We propose to address this with a `tracking-by-detection` approach that builds upon the success of region based video object detectors. Our video level object detector uses a novel recurrent computational unit at its core that enables long term propagation of object features even under occlusion. Finally, we compare our approach with existing state-of-the-art video object detectors and show that our approach achieves superior results on a dataset of furniture assembly videos collected from the internet, where small objects like screws, nuts, and bolts often get occluded from the camera viewpoint.


title: Simulation of Condensed-Phase Spectroscopy with Near-term Digital Quantum Computer

abstract: Spectroscopy is an indispensable tool in understanding the structures and dynamics of molecular systems. However computational modelling of spectroscopy is challenging due to the exponential scaling of computational complexity with system sizes unless drastic approximations are made. Quantum computer could potentially overcome these classically intractable computational tasks, but existing approaches using quantum computers to simulate spectroscopy can only handle isolated and static molecules. In this work we develop a workflow that combines multi-scale modeling and time-dependent variational quantum algorithm to compute the linear spectroscopy of systems interacting with their condensed-phase environment via the relevant time correlation function. We demonstrate the feasibility of our approach by numerically simulating the UV-Vis absorption spectra of organic semiconductors. We show that our dynamical approach captures several spectral features that are otherwise overlooked by static methods. Our method can be directly used for other linear condensed-phase spectroscopy and could potentially be extended to nonlinear multi-dimensional spectroscopy.


title: Representations and Strategies for Transferable Machine Learning Models in Chemical Discovery

abstract: Strategies for machine-learning(ML)-accelerated discovery that are general across materials composition spaces are essential, but demonstrations of ML have been primarily limited to narrow composition variations. By addressing the scarcity of data in promising regions of chemical space for challenging targets like open-shell transition-metal complexes, general representations and transferable ML models that leverage known relationships in existing data will accelerate discovery. Over a large set (ca. 1000) of isovalent transition-metal complexes, we quantify evident relationships for different properties (i.e., spin-splitting and ligand dissociation) between rows of the periodic table (i.e., 3d/4d metals and 2p/3p ligands). We demonstrate an extension to graph-based revised autocorrelation (RAC) representation (i.e., eRAC) that incorporates the effective nuclear charge alongside the nuclear charge heuristic that otherwise overestimates dissimilarity of isovalent complexes. To address the common challenge of discovery in a new space where data is limited, we introduce a transfer learning approach in which we seed models trained on a large amount of data from one row of the periodic table with a small number of data points from the additional row. We demonstrate the synergistic value of the eRACs alongside this transfer learning strategy to consistently improve model performance. Analysis of these models highlights how the approach succeeds by reordering the distances between complexes to be more consistent with the periodic table, a property we expect to be broadly useful for other materials domains.


title: On realizations of the subalgebra $A^R(1)$ of the $R$-motivic Steenrod Algebra

abstract: In this paper, we show that the finite subalgebra $\mathcal{A}^{\mathbb{R}}(1)$, generated by $\mathrm{Sq}^1$ and $\mathrm{Sq}^2$, of the $\mathbb{R}$-motivic Steenrod algebra $\mathcal{A}^{\mathbb{R}}$ can be given $128$ different $\mathcal{A}^{\mathbb{R}}$-module structures. We also show that all of these $\mathcal{A}^{\mathbb{R}}$-modules can be realized as the cohomology of a $2$-local finite $\mathbb{R}$-motivic spectrum. The realization results are obtained using an $\mathbb{R}$ -motivic analogue of the Toda realization theorem. We notice that each realization of $\mathcal{A}^{\mathbb{R}}(1)$ can be expressed as a cofiber of an $\mathbb{R}$-motivic $v_1$-self-map. The $\mathrm{C}_2$-equivariant analogue of the above results then follows because of the Betti realization functor. We identify a relationship between the $\mathrm{RO}(\mathrm{C}_2)$-graded Steenrod operations on a $\mathrm{C}_2$-equivariant space and the classical Steenrod operations on both its underlying space and its fixed-points. This technique is then used to identify the geometric fixed-point spectra of the $\mathrm{C}_2$-equivariant realizations of $\mathcal{A}^{\mathrm{C}_2}(1)$. We find another application of the $\mathbb{R}$-motivic Toda realization theorem: we produce an $\mathbb{R}$-motivic, and consequently a $\mathrm{C}_2$-equivariant, analogue of the Bhattacharya-Egger spectrum $\mathcal{Z}$, which could be of independent interest.


title: A Neural Frequency-Severity Model and Its Application to Insurance Claims

abstract: This paper proposes a flexible and analytically tractable class of frequency and severity models for predicting insurance claims. The proposed model is able to capture nonlinear relationships in explanatory variables by characterizing the logarithmic mean functions of frequency and severity distributions as neural networks. Moreover, a potential dependence between the claim frequency and severity can be incorporated. In particular, the paper provides analytic formulas for mean and variance of the total claim cost, making our model ideal for many applications such as pricing insurance contracts and the pure premium. A simulation study demonstrates that our method successfully recovers nonlinear features of explanatory variables as well as the dependency between frequency and severity. Then, this paper uses a French auto insurance claim dataset to illustrate that the proposed model is superior to the existing methods in fitting and predicting the claim frequency, severity, and the total claim loss. Numerical results indicate that the proposed model helps in maintaining the competitiveness of an insurer by accurately predicting insurance claims and avoiding adverse selection.


title: Multirate Training of Neural Networks

abstract: We propose multirate training of neural networks: partitioning neural network parameters into "fast" and "slow" parts which are trained on different time scales, where slow parts are updated less frequently. By choosing appropriate partitionings we can obtain substantial computational speed-up for transfer learning tasks. We show for applications in vision and NLP that we can fine-tune deep neural networks in almost half the time, without reducing the generalization performance of the resulting models. We analyze the convergence properties of our multirate scheme and draw a comparison with vanilla SGD. We also discuss splitting choices for the neural network parameters which could enhance generalization performance when neural networks are trained from scratch. A multirate approach can be used to learn different features present in the data and as a form of regularization. Our paper unlocks the potential of using multirate techniques for neural network training and provides several starting points for future work in this area.


title: Conflicts, Assortative Matching, and the Evolution of Signaling Norms

abstract: This paper proposes a model to explain the potential role of inter-group conflicts in determining the rise and fall of signaling norms. Individuals in a population are characterized by high and low productivity types and they are matched in pairs to form social relationships such as mating or foraging relationships. In each relationship, an individual's payoff is increasing in its own type and its partner's type. Hence, the payoff structure of a relationship does not resemble a dilemma situation. Assume that types are not observable. In one population, assortative matching according to types is sustained by signaling. In the other population, individuals do not signal and they are randomly matched. Types evolve within each population. At the same time, the two populations may engage in conflicts. Due to assortative matching, high types grow faster in the population with signaling, yet they bear the cost of signaling, which lowers their population's fitness in the long run. Through simulations, we show that the survival of the signaling population depends crucially on the timing and the efficiency of weapon used in inter-group conflicts.


title: Neural Spectral Marked Point Processes

abstract: Self- and mutually-exciting point processes are popular models in machine learning and statistics for dependent discrete event data. To date, most existing models assume stationary kernels (including the classical Hawkes processes) and simple parametric models. Modern applications with complex event data require more general point process models that can incorporate contextual information of the events, called marks, besides the temporal and location information. Moreover, such applications often require non-stationary models to capture more complex spatio-temporal dependence. To tackle these challenges, a key question is to devise a versatile influence kernel in the point process model. In this paper, we introduce a novel and general neural network-based non-stationary influence kernel with high expressiveness for handling complex discrete events data while providing theoretical performance guarantees. We demonstrate the superior performance of our proposed method compared with the state-of-the-art on synthetic and real data.


title: In Memoriam: Joshua N. Goldberg

abstract: This is a short memoriam celebrating the life and work of the general relativist Joshua N. Goldberg, who passed away in October, 2020.


title: Covariance Matching based robust Adaptive Cubature Kalman Filter

abstract: This letter explores covariance matching-based adaptive robust cubature Kalman filter (CMRACKF). In this method, the innovation sequence is used to determine the covariance matrix of measurement noise that can overcome the limitation of conventional CKF. In the proposed algorithm, weights are adaptively adjusted and used for updating the measurement noise covariance matrices online. It can also enhance the adaptive capability of the ACKF. The simulation results are illustrated to evaluate the performance of the proposed algorithm.


title: Context-Aware Legal Citation Recommendation using Deep Learning

abstract: Lawyers and judges spend a large amount of time researching the proper legal authority to cite while drafting decisions. In this paper, we develop a citation recommendation tool that can help improve efficiency in the process of opinion drafting. We train four types of machine learning models, including a citation-list based method (collaborative filtering) and three context-based methods (text similarity, BiLSTM and RoBERTa classifiers). Our experiments show that leveraging local textual context improves recommendation, and that deep neural models achieve decent performance. We show that non-deep text-based methods benefit from access to structured case metadata, but deep models only benefit from such access when predicting from context of insufficient length. We also find that, even after extensive training, RoBERTa does not outperform a recurrent neural model, despite its benefits of pretraining. Our behavior analysis of the RoBERTa model further shows that predictive performance is stable across time and citation classes.


title: Manifold Matching via Deep Metric Learning for Generative Modeling

abstract: We propose a manifold matching approach to generative models which includes a distribution generator (or data generator) and a metric generator. In our framework, we view the real data set as some manifold embedded in a high-dimensional Euclidean space. The distribution generator aims at generating samples that follow some distribution condensed around the real data manifold. It is achieved by matching two sets of points using their geometric shape descriptors, such as centroid and $p$-diameter, with learned distance metric; the metric generator utilizes both real data and generated samples to learn a distance metric which is close to some intrinsic geodesic distance on the real data manifold. The produced distance metric is further used for manifold matching. The two networks are learned simultaneously during the training process. We apply the approach on both unsupervised and supervised learning tasks: in unconditional image generation task, the proposed method obtains competitive results compared with existing generative models; in super-resolution task, we incorporate the framework in perception-based models and improve visual qualities by producing samples with more natural textures. Experiments and analysis demonstrate the feasibility and effectiveness of the proposed framework.


title: Generalizing the Constant-roll Condition in Scalar Inflation

abstract: In this work we generalize the constant-roll condition for minimally coupled canonical scalar field inflation. Particularly, we shall assume that the scalar field satisfies the condition $\ddot{\phi}=\alpha (\phi) V'(\phi)$, and we derive the field equations under this assumption. We call the framework extended constant-roll framework. Accordingly we calculate the inflationary indices and the corresponding observational indices of inflation. In order to demonstrate the inflationary viability, we choose three potentials that are problematic in the context of slow-roll dynamics, namely chaotic, linear power-law and exponential inflation, and by choosing a simple power-law form for the smooth function $\alpha (\phi)$, we show that in the extended constant-roll framework, the models are compatible with the latest 2018 Planck constraints on inflation. We also justify appropriately why we called this new framework extended constant-roll framework, and we show that the condition $\ddot{\phi}=\alpha (\phi) V'(\phi)$ is equivalent to the condition $\ddot{\phi}=\beta (\phi) H \dot{\phi}$, with the latter condition being a simple generalization of the constant-roll condition. Finally, we examine an interesting physical situation, in which a general extended constant-roll scalar field model is required to satisfy the cosmological tracker condition used in quintessence models. In contrast to the slow-roll and ordinary constant-roll cases, in which case the tracker condition is not compatible with neither the slow-roll or the ordinary constant-roll conditions, the extended constant-roll condition can be compatible with the tracker condition. This feature leads to a new inflationary phenomenological framework, the essential features of which we develop in brief.


title: Enhancing the third-order optical nonlinear performance in CMOS devices with integrated 2D graphene oxide films

abstract: We report enhanced nonlinear optics in complementary metal oxide semiconductor compatible photonic platforms through the use of layered two dimensional (2D) graphene oxide (GO) films. We integrate GO films with silicon on insulator nanowires (SOI), high index doped silica glass (Hydex) and silicon nitride (SiN) waveguides and ring resonators, to demonstrate an enhanced optical nonlinearity including Kerr nonlinearity and four wave mixing (FWM). The GO films are integrated using a large area, transfer free, layer by layer method while the film placement and size are controlled by photolithography. In SOI nanowires we observe a dramatic enhancement in both the Kerr nonlinearity and nonlinear figure of merit (FOM) due to the highly nonlinear GO films. Self phase modulation (SPM) measurements show significant spectral broadening enhancement for SOI nanowires coated with patterned films of GO. The dependence of GO Kerr nonlinearity on layer number and pulse energy shows trends of the layered GO films from 2D to quasi bulk like behavior. The nonlinear parameter of GO coated SOI nanowires is increased 16 fold, with the nonlinear FOM increasing over 20 times to a FOM greater than 5. We also observe an improved FWM efficiency in SiN waveguides integrated with 2D layered GO films. FWM measurements for samples with different numbers of GO layers and at different pump powers are performed, achieving up to 7.3 dB conversion efficiency (CE) enhancement for a uniformly coated device with 1 layer of GO and 9.1 dB for a patterned device with 5 layers of GO. These results reveal the strong potential of GO films to improve the nonlinear optics of silicon, Hydex and SiN photonic devices.


title: Relative Gorenstein dimensions over triangular matrix rings

abstract: Let $A$ and $B$ be rings, $U$ a $(B,A)$-bimodule and $T=\begin{pmatrix} A&0\\U&B \end{pmatrix}$ the triangular matrix ring. In this paper, several notions in relative Gorenstein algebra over a triangular matrix ring are investigated. We first study how to construct w-tilting (tilting, semidualizing) over $T$ using the corresponding ones over $A$ and $B$. We show that when $U$ is relative (weakly) compatible we are able to describe the structure of $G_C$-projective modules over $T$. As an application, we study when a morphism in $T$-Mod has a special $G_CP(T)$-precover and when the class $G_CP(T)$ is a special precovering class. In addition, we study the relative global dimension of $T$. In some cases, we show that it can be computed from the relative global dimensions of $A$ and $B$. We end the paper with a counterexample to a result that characterizes when a $T$-module has a finite projective dimension.


title: Nanocrystalline superconducting $\gamma$-Mo$_2$N ultra-thin films for single-photon detectors

abstract: We analyze the influence of the surface passivation produced by oxides on the superconducting properties of $\gamma$-Mo$_2$N ultra-thin films. The superconducting critical temperature of thin films grown directly on Si (100) with those using a buffer and a capping layer of AlN are compared. The results show that the cover layer avoids the presence of surface oxides, maximizing the superconducting critical temperature for films with thicknesses of a few nanometers. We characterize the flux-flow instability measuring current-voltage curves in a 6.4 nm thick Mo$_2$N film with a superconducting critical temperature of 6.4 K. The data is analyzed using the Larkin and Ovchinnikov model. Considering self-heating effects due to finite heat removal from the substrate, we determine a fast quasiparticle relaxation time $\approx$ 45 ps. This value is promising for its applications in single-photon detectors.


title: Coordinate-ordering-free Upper Bounds for Linear Insertion-Deletion Codes

abstract: The insertion-deletion codes were motivated to correct the synchronization errors. In this paper we prove several coordinate-ordering-free upper bounds on the insdel distances of linear codes, which are based on the generalized Hamming weights and the formation of minimum Hamming weight codewords. Our bounds are stronger than some previous known bounds. We apply these upper bounds to some cyclic codes and one algebraic-geometric code with any rearrangement of coordinate positions. Some strong upper bounds on the insdel distances of Reed-Muller codes with special coordinate-ordering are also given.


title: OptiDICE: Offline Policy Optimization via Stationary Distribution Correction Estimation

abstract: We consider the offline reinforcement learning (RL) setting where the agent aims to optimize the policy solely from the data without further environment interactions. In offline RL, the distributional shift becomes the primary source of difficulty, which arises from the deviation of the target policy being optimized from the behavior policy used for data collection. This typically causes overestimation of action values, which poses severe problems for model-free algorithms that use bootstrapping. To mitigate the problem, prior offline RL algorithms often used sophisticated techniques that encourage underestimation of action values, which introduces an additional set of hyperparameters that need to be tuned properly. In this paper, we present an offline RL algorithm that prevents overestimation in a more principled way. Our algorithm, OptiDICE, directly estimates the stationary distribution corrections of the optimal policy and does not rely on policy-gradients, unlike previous offline RL algorithms. Using an extensive set of benchmark datasets for offline RL, we show that OptiDICE performs competitively with the state-of-the-art methods.


title: iDARTS: Differentiable Architecture Search with Stochastic Implicit Gradients

abstract: \textit{Differentiable ARchiTecture Search} (DARTS) has recently become the mainstream of neural architecture search (NAS) due to its efficiency and simplicity. With a gradient-based bi-level optimization, DARTS alternately optimizes the inner model weights and the outer architecture parameter in a weight-sharing supernet. A key challenge to the scalability and quality of the learned architectures is the need for differentiating through the inner-loop optimisation. While much has been discussed about several potentially fatal factors in DARTS, the architecture gradient, a.k.a. hypergradient, has received less attention. In this paper, we tackle the hypergradient computation in DARTS based on the implicit function theorem, making it only depends on the obtained solution to the inner-loop optimization and agnostic to the optimization path. To further reduce the computational requirements, we formulate a stochastic hypergradient approximation for differentiable NAS, and theoretically show that the architecture optimization with the proposed method, named iDARTS, is expected to converge to a stationary point. Comprehensive experiments on two NAS benchmark search spaces and the common NAS search space verify the effectiveness of our proposed method. It leads to architectures outperforming, with large margins, those learned by the baseline methods.


title: Adversarial Attack on Graph Neural Networks as An Influence Maximization Problem

abstract: Graph neural networks (GNNs) have attracted increasing interests. With broad deployments of GNNs in real-world applications, there is an urgent need for understanding the robustness of GNNs under adversarial attacks, especially in realistic setups. In this work, we study the problem of attacking GNNs in a restricted and realistic setup, by perturbing the features of a small set of nodes, with no access to model parameters and model predictions. Our formal analysis draws a connection between this type of attacks and an influence maximization problem on the graph. This connection not only enhances our understanding on the problem of adversarial attack on GNNs, but also allows us to propose a group of effective and practical attack strategies. Our experiments verify that the proposed attack strategies significantly degrade the performance of three popular GNN models and outperform baseline adversarial attack strategies.


title: ROPE: Reading Order Equivariant Positional Encoding for Graph-based Document Information Extraction

abstract: Natural reading orders of words are crucial for information extraction from form-like documents. Despite recent advances in Graph Convolutional Networks (GCNs) on modeling spatial layout patterns of documents, they have limited ability to capture reading orders of given word-level node representations in a graph. We propose Reading Order Equivariant Positional Encoding (ROPE), a new positional encoding technique designed to apprehend the sequential presentation of words in documents. ROPE generates unique reading order codes for neighboring words relative to the target word given a word-level graph connectivity. We study two fundamental document entity extraction tasks including word labeling and word grouping on the public FUNSD dataset and a large-scale payment dataset. We show that ROPE consistently improves existing GCNs with a margin up to 8.4% F1-score.


title: Calculation of Energy Loss in Antiproton Collisions with Many-Electron Systems using Ehrenfest's Theorem

abstract: Energy loss in collisions of charged projectiles with many-electron systems can be dealt with in time-dependent density functional theory by invoking Ehrenfest's theorem for the time evolution of expectation values of observables. We derive an exact expression for the evaluation of energy loss for systems described in a target reference frame, which is a functional of the electron density. Using an approximation scheme we then apply the expression to antiproton-atom collisions at intermediate and high energies within the framework of the basis generator method. The calculations are performed within the semiclassical approximation for the nuclear motion, and a straight-line trajectory is employed. The energy loss is evaluated from an expectation value of the time derivative of the time-dependent projectile potential and avoids the problem of identifying the excited and ionized many-electron contributions in the many-electron wavefunction. There is also no need to invoke the independent-event model, since the calculations are performed within the framework of the independent-electron mean-field model. Detailed comparisons are provided for net ionization and total energy loss of antiprotons colliding with hydrogen, helium, neon, carbon, nitrogen and oxygen. Reasonable agreement is found with the results from one-electron and two-electron calculations for atomic hydrogen and helium, and with experiment in the latter case. For the $\bar p - \rm Ne$ system at intermediate collision energies we find discrepancies with previous work that included only single-electron transitions. The sequence of results for C, N, O, Ne allows one to paint a consistent picture which awaits experimental verification.


title: The Simplest Viscous Flow

abstract: We illustrate an atomistic periodic two-dimensional stationary shear flow, $u_x = \langle \ \dot x \ \rangle = \dot \epsilon y$, using the simplest possible example, the periodic shear of just two particles ! We use a short-ranged "realistic" pair potential, $\phi(r<2) = (2-r)^6 - 2(2-r)^3$. Many body simulations with it are capable of modelling the gas, liquid, and solid states of matter. A useful mechanics generating steady shear follows from a special ("Kewpie-Doll" $\sim$ "$qp$-Doll") Hamiltonian based on the Hamiltonian coordinates $\{ q \}$ and momenta $\{ p \}$ : ${\cal H}(q,p) \equiv K(p) + \Phi(q) + \dot \epsilon \sum qp$. Choosing $qp \rightarrow yp_x$ the resulting motion equations are consistent with steadily shearing periodic boundaries with a strain rate $(du_x/dy) = \dot \epsilon$. The occasional $x$ coordinate jumps associated with periodic boundary crossings in the $y$ direction provide a Hamiltonian that is a piecewise-continuous function of time. A time-periodic isothermal steady state results when the Hamiltonian motion equations are augmented with a continuously variable thermostat generalizing Shuichi Nos\'e's revolutionary ideas from 1984. The resulting distributions of coordinates and momenta are interesting multifractals, with surprising irreversible consequences from strictly time-reversible motion equations.


title: An empirical evaluation of the usefulness of Tree Kernels for Commit-time Defect Detection in large software systems

abstract: Defect detection at commit check-in time prevents the introduction of defects into software systems. Current defect detection approaches rely on metric-based models which are not very accurate and whose results are not directly useful for developers. We propose a method to detect bug-inducing commits by comparing the incoming changes with all past commits in the project, considering both those that introduced defects and those that did not. Our method considers individual changes in the commit separately, at the method-level granularity. Doing so helps developers as they are informed of specific methods that need further attention instead of being told that the entire commit is problematic. Our approach represents source code as abstract syntax trees and uses tree kernels to estimate the similarity of the code with previous commits. We experiment with subtree kernels (STK), subset tree kernels (SSTK), or partial tree kernels (PTK). An incoming change is then classified using a K-NN classifier on the past changes. We evaluate our approach on the BigCloneBench benchmark and on the Technical Debt dataset, using the NiCad clone detector as the baseline. Our experiments with the BigCloneBench benchmark show that the tree kernel approach can detect clones with a comparable MAP to that of NiCad. Also, on defect detection with the Technical Debt dataset, tree kernels are least as effective as NiCad with MRR, F-score, and Accuracy of 0.87, 0.80, and 0.82 respectively.


title: Fuzzy instantons in landscape and swampland: review of the Hartle-Hawking wave function and several applications

abstract: The Euclidean path integral is well approximated by instantons. If instantons are dynamical, then instantons are necessarily complexified. These fuzzy instantons can have various physical applications. In slow-roll inflation models, fuzzy instantons can explain the probability distribution of the initial conditions of the universe. Even though the potential shape does not satisfy the slow-roll conditions following the swampland criteria, still the fuzzy instantons can explain the origin of the universe. If we extend the Euclidean path integral beyond the no-boundary proposal, we may study fuzzy Euclidean wormholes that have various physical applications in cosmology and black hole physics. We summarize them and discuss possible future research topics.


title: Re-discovering micro-emulsion electrolytes: a biphasic electrolyte platform for Organic redox flow batteries

abstract: Redox flow batteries (RFBs) have gained popularity as large-scale energy storage systems for wind and solar powered grids. Modern RFB systems are based on highly corrosive and/or flammable electrolytes. Organic redox active species for RFBs are gaining commercial traction, but there is a trade-off in choosing aqueous or non-aqueous electrolytes in terms of rate capabilities, energy density, safety and cost. While modification of organic redox molecules to mitigate these issues is prevalent in the literature, the search for novel electrolyte systems is scarce. Here we present microemulsion-based electrolytes as an alternative for the next generation of organic RFBs. Micro-emulsion electrolytes (MEs) offer the advantages of decoupled solubility and ionic conductivity, broad electrochemical windows, non-flammability, simple fabrication modes and low cost of constituent chemicals. The electrochemical properties of organic redox species in MEs have been investigated for RFB requirements and a proof-of-concept flow cell with a widely studied redox system and a commercial membrane is shown. The compositions of MEs can be tailored to the redox system, making them a platform of electrolytes for all organic redox systems under consideration and benefit.


title: Double-peaked inflation model: Scalar induced gravitational waves and primordial-black-hole suppression from primordial non-Gaussianity

abstract: A significant abundance of primordial black hole (PBH) dark matter can be produced by curvature perturbations with power spectrum $\Delta_\zeta^2(k_{\mathrm{peak}})\sim \mathcal{O}(10^{-2})$ at small scales, associated with the generation of observable scalar induced gravitational waves (SIGWs). However, the primordial non-Gaussianity may play a non-negligible role, which is not usually considered. We propose two inflation models that predict double peaks of order $\mathcal{O}(10^{-2})$ in the power spectrum and study the effects of primordial non-Gaussianity on PBHs and SIGWs. This model is driven by a power-law potential, and has a noncanonical kinetic term whose coupling function admits two peaks. By field-redefinition, it can be recast into a canonical inflation model with two quasi-inflection points in the potential. We find that the PBH abundance will be altered saliently if non-Gaussianity parameter satisfies $|f_{\mathrm{NL}}(k_{\text{peak}},k_{\text{peak}},k_{\text{peak}})|\gtrsim \Delta^2_{\zeta}(k_{\mathrm{peak}})/(23\delta^3_c) \sim \mathcal{O}(10^{-2})$. Whether the PBH abundance is suppressed or enhanced depends on the $f_{\mathrm{NL}}$ being positive or negative, respectively. In our model, non-Gaussianity parameter $f_{\mathrm{NL}}(k_{\mathrm{peak}},k_{\mathrm{peak}},k_{\mathrm{peak}})\sim \mathcal{O}(1)$ takes positive sign, thus PBH abundance is suppressed dramatically. On the contrary, SIGWs are insensitive to primordial non-Gaussianity and hardly affected, so they are still within the sensitivities of space-based GWs observatories and Square Kilometer Array.


title: Holomorphicity, Vortex Attachment, Gauge Invariance and the Fractional Quantum Hall Effect

abstract: A gauge invariant reformulation of nonrelativistic fermions in background magnetic fields is used to obtain the Laughlin and Jain wave functions as exact results in Mean Field Theory (MFT). The gauge invariant framework trades the U(1) gauge symmetry for an emergent holomorphic symmetry and fluxes for vortices. The novel holomorphic invariance is used to develop an analytical method for attaching vortices to particles. Vortex attachment methods introduced in this paper are subsequently employed to construct the Read operator within a second quantized framework and obtain the Laughlin and Jain wave functions as exact results entirely within a mean-field approximation. The gauge invariant framework and vortex attachment techniques are generalized to the case of spherical geometry and spherical counterparts of Laughlin and Jain wave functions are also obtained exactly within MFT.


title: Secular resonance of inner test particles in hierarchical planetary systems

abstract: The present work studies the secular resonance associated with the critical argument $\sigma = \varpi$ ($\varpi$ is the longitude of pericentre) for inner test particles moving in low-eccentricity region with inclination $i$ smaller than $39^{\circ}$. To formulate the dynamical model, the double-averaged Hamiltonian is formulated up to an arbitrary order in the semimajor axis ratio, and then those high-order periodic terms are removed from the double-averaged Hamiltonian by means of Hori--Deprit transformation technique. The resulting Hamiltonian determines a resonant model with a single degree of freedom. Based on the resonant model, it becomes possible to explore the phase-space structure, resonant centre, and resonant width in an analytical manner. In particular, an excellent correspondence is found between the resonant width in terms of the eccentricity variation and the maximum variation of eccentricity ($\Delta e$) for test particles initially placed on quasi-circular orbits. It means that the secular dynamics in the low-eccentricity space with $i < 39^{\circ}$ is dominantly governed by the secular resonance associated with $\sigma = \varpi$.


title: Large-scale image segmentation based on distributed clustering algorithms

abstract: Many approaches to 3D image segmentation are based on hierarchical clustering of supervoxels into image regions. Here we describe a distributed algorithm capable of handling a tremendous number of supervoxels. The algorithm works recursively, the regions are divided into chunks that are processed independently in parallel by multiple workers. At each round of the recursive procedure, the chunk size in all dimensions are doubled until a single chunk encompasses the entire image. The final result is provably independent of the chunking scheme, and the same as if the entire image were processed without division into chunks. This is nontrivial because a pair of adjacent regions is scored by some statistical property (e.g. mean or median) of the affinities at the interface, and the interface may extend over arbitrarily many chunks. The trick is to delay merge decisions for regions that touch chunk boundaries, and only complete them in a later round after the regions are fully contained within a chunk. We demonstrate the algorithm by clustering an affinity graph with over 1.5 trillion edges between 135 billion supervoxels derived from a 3D electron microscopic brain image.


title: CD-SGD: Distributed Stochastic Gradient Descent with Compression and Delay Compensation

abstract: Communication overhead is the key challenge for distributed training. Gradient compression is a widely used approach to reduce communication traffic. When combining with parallel communication mechanism method like pipeline, gradient compression technique can greatly alleviate the impact of communication overhead. However, there exists two problems of gradient compression technique to be solved. Firstly, gradient compression brings in extra computation cost, which will delay the next training iteration. Secondly, gradient compression usually leads to the decrease of convergence accuracy.