title: Filtering Context Mitigates Scarcity and Selection Bias in Political Ideology Prediction

abstract: We propose a novel supervised learning approach for political ideology prediction (PIP) that is capable of predicting out-of-distribution inputs. This problem is motivated by the fact that manual data-labeling is expensive, while self-reported labels are often scarce and exhibit significant selection bias. We propose a novel statistical model that decomposes the document embeddings into a linear superposition of two vectors; a latent neutral \emph{context} vector independent of ideology, and a latent \emph{position} vector aligned with ideology. We train an end-to-end model that has intermediate contextual and positional vectors as outputs. At deployment time, our model predicts labels for input documents by exclusively leveraging the predicted positional vectors. On two benchmark datasets we show that our model is capable of outputting predictions even when trained with as little as 5\% biased data, and is significantly more accurate than the state-of-the-art. Through crowd-sourcing we validate the neutrality of contextual vectors, and show that context filtering results in ideological concentration, allowing for prediction on out-of-distribution examples.


title: Toward Efficient Transportation Electrification of Heavy-Duty Trucks: Joint Scheduling of Truck Routing and Charging

abstract: The timely transportation of goods to customers is an essential component of economic activities. However, heavy-duty diesel trucks used for goods delivery significantly contribute to greenhouse gas emissions within many large metropolitan areas, including Los Angeles, New York, and San Francisco. To reduce GHG emissions by facilitating freight electrification, this paper proposes Joint Routing and Charging scheduling for electric trucks. The objective of the associated optimization problem is to minimize the cost of transportation, charging, and tardiness. A large number of possible combinations of road segments as well as a large number of combinations of charging decisions and charging durations leads to a combinatorial explosion in the possible decisions electric trucks can make. The resulting mixed-integer linear programming problem is thus extremely challenging because of the combinatorial complexity even in the deterministic case. Therefore, a Surrogate Level-Based Lagrangian Relaxation (SLBLR) method is employed to decompose the overall problem into significantly less complex truck subproblems. In the coordination aspect, each truck subproblem is solved independently of other subproblems based on the values of Lagrangian multipliers. In addition to serving as a means of guiding and coordinating trucks, multipliers can also serve as a basis for transparent and explanatory decision-making by trucks. Testing results demonstrate that even small instances cannot be solved using the off-the-shelf solver CPLEX after several days of solving. The SLBLR method, on the other hand, can obtain near-optimal solutions within a few minutes for small cases, and within 30 minutes for large ones. Furthermore, it has been demonstrated that as battery capacity increases, the total cost decreases significantly; moreover, as the charging power increases, the number of trucks required decreases as well.


title: Controlled longitudinal spin-orbit separation of complex vector modes

abstract: Complex vector modes, entangled in spin and orbital angular momentum, are opening burgeoning opportunities for a wide variety of applications. Importantly, the flexible manipulation the various properties of such beams will pave the way to novel applications. As such, in this manuscript, we demonstrate a longitudinal spin-orbit separation of complex vector modes propagating in free space. To achieve this we employed the recently demonstrated circular Airy Gaussian vortex vector (CAGVV) modes, which feature a self-focusing property. More precisely, by properly manipulating the intrinsic parameters of CAGVV modes, the strong coupling between the two constituting orthogonal components of CAGVV mode undergo a spin-orbit separation along the propagation direction namely, while one polarisation component, focuses at a specific plane, the other focuses at a different plane. Such spin-orbit separation, which we demonstrated by numerical simulations and corroborated experimentally, can be adjusted on-demand by simply changing the initial parameters of CAGVV modes. Our findings will be of great relevance, for example in optical tweezers, to manipulate micro- or nano-particles at two different parallel planes.


title: The Parametric Stability of Well-separated Spherical Gaussian Mixtures

abstract: We quantify the parameter stability of a spherical Gaussian Mixture Model (sGMM) under small perturbations in distribution space. Namely, we derive the first explicit bound to show that for a mixture of spherical Gaussian $P$ (sGMM) in a pre-defined model class, all other sGMM close to $P$ in this model class in total variation distance has a small parameter distance to $P$. Further, this upper bound only depends on $P$. The motivation for this work lies in providing guarantees for fitting Gaussian mixtures; with this aim in mind, all the constants involved are well defined and distribution free conditions for fitting mixtures of spherical Gaussians. Our results tighten considerably the existing computable bounds, and asymptotically match the known sharp thresholds for this problem.


title: Agility and Target Distribution in the Dynamic Stochastic Traveling Salesman Problem

abstract: An important variant of the classic Traveling Salesman Problem (TSP) is the Dynamic TSP, in which a system with dynamic constraints is tasked with visiting a set of n target locations (in any order) in the shortest amount of time. Such tasks arise naturally in many robotic motion planning problems, particularly in exploration, surveillance and reconnaissance, and classical TSP algorithms on graphs are typically inapplicable in this setting. An important question about such problems is: if the target points are random, what is the length of the tour (either in expectation or as a concentration bound) as n grows? This problem is the Dynamic Stochastic TSP (DSTSP), and has been studied both for specific important vehicle models and for general dynamic systems; however, in general only the order of growth is known. In this work, we explore the connection between the distribution from which the targets are drawn and the dynamics of the system, yielding a more precise lower bound on tour length as well as a matching upper bound for the case of symmetric (or driftless) systems. We then extend the symmetric dynamics results to the case when the points are selected by a (non-random) adversary whose goal is to maximize the length, thus showing worst-case bounds on the tour length.


title: Learning Cut Selection for Mixed-Integer Linear Programming via Hierarchical Sequence Model

abstract: Cutting planes (cuts) are important for solving mixed-integer linear programs (MILPs), which formulate a wide range of important real-world applications. Cut selection -- which aims to select a proper subset of the candidate cuts to improve the efficiency of solving MILPs -- heavily depends on (P1) which cuts should be preferred, and (P2) how many cuts should be selected. Although many modern MILP solvers tackle (P1)-(P2) by manually designed heuristics, machine learning offers a promising approach to learn more effective heuristics from MILPs collected from specific applications. However, many existing learning-based methods focus on learning which cuts should be preferred, neglecting the importance of learning the number of cuts that should be selected. Moreover, we observe from extensive empirical results that (P3) what order of selected cuts should be preferred has a significant impact on the efficiency of solving MILPs as well. To address this challenge, we propose a novel hierarchical sequence model (HEM) to learn cut selection policies via reinforcement learning. Specifically, HEM consists of a two-level model: (1) a higher-level model to learn the number of cuts that should be selected, (2) and a lower-level model -- that formulates the cut selection task as a sequence to sequence learning problem -- to learn policies selecting an ordered subset with the size determined by the higher-level model. To the best of our knowledge, HEM is the first method that can tackle (P1)-(P3) in cut selection simultaneously from a data-driven perspective. Experiments show that HEM significantly improves the efficiency of solving MILPs compared to human-designed and learning-based baselines on both synthetic and large-scale real-world MILPs, including MIPLIB 2017. Moreover, experiments demonstrate that HEM well generalizes to MILPs that are significantly larger than those seen during training.


title: Convergence of a quantum lattice Boltzmann scheme to the nonlinear Dirac equation for Gross-Neveu model in $1+1$ dimensions

abstract: This paper studies the quantum lattice Boltzmann scheme for the nonlinear Dirac equations for Gross-Neveu model in $1+1$ dimensions. The initial data for the scheme are assumed to be convergent in $L^2$. Then for any $T\ge 0$ the corresponding solutions for the quantum lattice Boltzmann scheme are shown to be convergent in $C([0,T];L^2(R^1))$ to the strong solution to the nonlinear Dirac equations as the mesh sizes converge to zero. In the proof, at first a Glimm type functional is introduced to establish the stability estimates for the difference between two solutions for the corresponding quantum lattice Boltzmann scheme, which leads to the compactness of the set of the solutions for the quantum lattice Boltzmann scheme. Finally, the limit of any convergent subsequence of the solutions for the quantum lattice Boltzmann scheme is shown to coincide with the strong solution to a Cauchy problem for the nonlinear Dirac equations.


title: Target of Opportunity Observations Detectability of Kilonovae with WFST

abstract: Kilonovae are approximately thermal transients, produced by mergers of binary neutron stars (BNSs) and NS-black hole binaries. As the optical counterpart of the gravitational wave event GW170817, AT2017gfo is the first kilonova detected with smoking-gun evidence. Its observation offers vital information for constraining the Hubble constant, the source of cosmic $r$-process enrichment, and the equation of state of neutron stars. The 2.5-meter Wide-Field Survey Telescope (WFST) operates at six bands (u, g, r, i, z, w), spanning from 320 to 925 nm. It will be completed in the first half of 2023, and with a field-of-view diameter of 3 degrees, aims to detect kilonovae in the near future. In this article, considering the influence of the host galaxies and sky brightness, we generate simulated images to investigate WFST's ability to detect AT2017gfo-like kilonovae. Due to their spectra, host galaxies can significantly impact kilonova detection at a longer wavelength. When kilonovae are at peak luminosity, we find that WFST performs better in the g and r bands and can detect 90\% (50\%) kilonovae at a luminosity distance of 248 Mpc (338 Mpc) with 30 s exposures. Furthermore, to reflect actual efficiency under target-of-opportunity observations, we calculate the total time of follow-up under various localization areas and distances. We find that if the localization areas of most BNS events detected during the fourth observing (O4) run of LIGO and Virgo are hundreds of deg$^2$, WFST is expected to find $\sim$30\% kilonovae in the first two nights during O4 period.


title: TAP: Accelerating Large-Scale DNN Training Through Tensor Automatic Parallelisation

abstract: Model parallelism has become necessary to train large neural networks. However, finding a suitable model parallel schedule for an arbitrary neural network is a non-trivial task due to the exploding search space. In this work, we present a model parallelism framework TAP that automatically searches for the best data and tensor parallel schedules. Leveraging the key insight that a neural network can be represented as a directed acyclic graph, within which may only exist a limited set of frequent subgraphs, we design a graph pruning algorithm to fold the search space efficiently. TAP runs at sub-linear complexity concerning the neural network size. Experiments show that TAP is $20\times- 160\times$ faster than the state-of-the-art automatic parallelism framework, and the performance of its discovered schedules is competitive with the expert-engineered ones.


title: A Nearly-Optimal Bound for Fast Regression with $\ell_\infty$ Guarantee

abstract: Given a matrix $A\in \mathbb{R}^{n\times d}$ and a vector $b\in \mathbb{R}^n$, we consider the regression problem with $\ell_\infty$ guarantees: finding a vector $x'\in \mathbb{R}^d$ such that $ \|x'-x^*\|_\infty \leq \frac{\epsilon}{\sqrt{d}}\cdot \|Ax^*-b\|_2\cdot \|A^\dagger\|$ where $x^*=\arg\min_{x\in \mathbb{R}^d}\|Ax-b\|_2$. One popular approach for solving such $\ell_2$ regression problem is via sketching: picking a structured random matrix $S\in \mathbb{R}^{m\times n}$ with $m\ll n$ and $SA$ can be quickly computed, solve the ``sketched'' regression problem $\arg\min_{x\in \mathbb{R}^d} \|SAx-Sb\|_2$. In this paper, we show that in order to obtain such $\ell_\infty$ guarantee for $\ell_2$ regression, one has to use sketching matrices that are dense. To the best of our knowledge, this is the first user case in which dense sketching matrices are necessary. On the algorithmic side, we prove that there exists a distribution of dense sketching matrices with $m=\epsilon^{-2}d\log^3(n/\delta)$ such that solving the sketched regression problem gives the $\ell_\infty$ guarantee, with probability at least $1-\delta$. Moreover, the matrix $SA$ can be computed in time $O(nd\log n)$. Our row count is nearly-optimal up to logarithmic factors, and significantly improves the result in [Price, Song and Woodruff, ICALP'17], in which a super-linear in $d$ rows, $m=\Omega(\epsilon^{-2}d^{1+\gamma})$ for $\gamma=\Theta(\sqrt{\frac{\log\log n}{\log d}})$ is required. We also develop a novel analytical framework for $\ell_\infty$ guarantee regression that utilizes the Oblivious Coordinate-wise Embedding (OCE) property introduced in [Song and Yu, ICML'21]. Our analysis is arguably much simpler and more general than [Price, Song and Woodruff, ICALP'17], and it extends to dense sketches for tensor product of vectors.


title: On the growth of high Sobolev norms of the cubic nonlinear Schr\"odinger equation on $\mathbb{R}\times \mathbb{T}$

abstract: We consider the cubic nonlinear Schr\"odinger equation on product manifolds $\mathbb{R}\times \mathbb{T}$. In this paper, we obtain polynomial bounds on the growth in time of high Sobolev norms of the solutions. The main ingredient of the proof is to establish an iteration bound, which is based on the idea used by Bourgain in \cite{B1}.


title: Quickest Change Detection for Unnormalized Statistical Models

abstract: Classical quickest change detection algorithms require modeling pre-change and post-change distributions. Such an approach may not be feasible for various machine learning models because of the complexity of computing the explicit distributions. Additionally, these methods may suffer from a lack of robustness to model mismatch and noise. This paper develops a new variant of the classical Cumulative Sum (CUSUM) algorithm for the quickest change detection. This variant is based on Fisher divergence and the Hyv\"arinen score and is called the Score-based CUSUM (SCUSUM) algorithm. The SCUSUM algorithm allows the applications of change detection for unnormalized statistical models, i.e., models for which the probability density function contains an unknown normalization constant. The asymptotic optimality of the proposed algorithm is investigated by deriving expressions for average detection delay and the mean running time to a false alarm. Numerical results are provided to demonstrate the performance of the proposed algorithm.


title: Adaptive hedging horizon and hedging performance estimation

abstract: In this study, we constitute an adaptive hedging method based on empirical mode decomposition (EMD) method to extract the adaptive hedging horizon and build a time series cross-validation method for robust hedging performance estimation. Basing on the variance reduction criterion and the value-at-risk (VaR) criterion, we find that the estimation of in-sample hedging performance is inconsistent with that of the out-sample hedging performance. The EMD hedging method family exhibits superior performance on the VaR criterion compared with the minimum variance hedging method. The matching degree of the spot and futures contracts at the specific time scale is the key determinant of the hedging performance in the corresponding hedging horizon.


title: QLABGrad: a Hyperparameter-Free and Convergence-Guaranteed Scheme for Deep Learning

abstract: The learning rate is a critical hyperparameter for deep learning tasks since it determines the extent to which the model parameters are updated during the learning course. However, the choice of learning rates typically depends on empirical judgment, which may not result in satisfactory outcomes without intensive try-and-error experiments. In this study, we propose a novel learning rate adaptation scheme called QLABGrad. Without any user-specified hyperparameter, QLABGrad automatically determines the learning rate by optimizing the Quadratic Loss Approximation-Based (QLAB) function for a given gradient descent direction, where only one extra forward propagation is required. We theoretically prove the convergence of QLABGrad with a smooth Lipschitz condition on the loss function. Experiment results on multiple architectures, including MLP, CNN, and ResNet, on MNIST, CIFAR10, and ImageNet datasets, demonstrate that QLABGrad outperforms various competing schemes for deep learning.


title: The Attractor of the Replicator Dynamic in Zero-Sum Games

abstract: In this paper we characterise the long-run behaviour of the replicator dynamic in zero-sum games (symmetric or non-symmetric). Specifically, we prove that every zero-sum game possesses a unique global replicator attractor, which we then characterise. Most surprisingly, this attractor depends only on each player's preference order over their own strategies and not on the cardinal payoff values, defined by a finite directed graph we call the game's preference graph. When the game is symmetric, this graph is a tournament whose nodes are strategies; when the game is not symmetric, this graph is the game's response graph. We discuss the consequences of our results on chain recurrence and Nash equilibria.


title: Wheeler-DeWitt equation beyond the cosmological horizon: Annihilation to nothing, infinity avoidance, and loss of quantum coherence

abstract: We investigate the Schwarzschild-(anti) de Sitter spacetime with the anisotropic metric ansatz. The Wheeler-DeWitt equation for such a metric is solved numerically. In the presence of the cosmological constant $\Lambda$, we show that two classical wave packets can be annihilated inside the black hole horizon, i.e., the annihilation-to-nothing scenario. It is interesting that the Wheeler-DeWitt equation can be extended to the asymptotic de Sitter spacetime outside the cosmological horizon. Surprisingly, the only bounded nontrivial wave function beyond the cosmological horizon satisfies the DeWitt boundary condition, i.e., the wave function must vanish at a certain finite radius. This might be an alternative explanation to the classicalization of quantum fluctuations in the de Sitter space, where this topic is also related to decoherence.


title: Discovery of 37 new pulsars through GPU-accelerated reprocessing of archival data of the Parkes Multibeam Pulsar Survey

abstract: We present the discovery of 37 pulsars from $\sim$ 20 years old archival data of the Parkes Multibeam Pulsar Survey using a new FFT-based search pipeline optimised for discovering narrow-duty cycle pulsars. When developing our pulsar search pipeline, we noticed that the signal-to-noise ratios of folded and optimised pulsars often exceeded that achieved in the spectral domain by a factor of two or greater, in particular for narrow duty cycle ones. Based on simulations, we verified that this is a feature of search codes that sum harmonics incoherently and found that many promising pulsar candidates are revealed when hundreds of candidates per beam with even with modest spectral signal-to-noise ratios of S/N$\sim$5--6 in higher-harmonic folds (up to 32 harmonics) are folded. Of these candidates, 37 were confirmed as new pulsars and a further 37 would have been new discoveries if our search strategies had been used at the time of their initial analysis. While 19 of these newly discovered pulsars have also been independently discovered in more recent pulsar surveys, 18 are exclusive to only the Parkes Multibeam Pulsar Survey data. Some of the notable discoveries include: PSRs J1635$-$47 and J1739$-$31, which show pronounced high-frequency emission; PSRs J1655$-$40 and J1843$-$08, which belong to the nulling/intermittent class of pulsars; and PSR J1636$-$51, which is an interesting binary system in a $\sim$0.75 d orbit and shows hints of eclipsing behaviour -- unusual given the 340 ms rotation period of the pulsar. Our results highlight the importance of reprocessing archival pulsar surveys and using refined search techniques to increase the normal pulsar population.


title: Charged AdS black holes with higher derivative corrections in presence of string cloud

abstract: We have obtained charged asymptotically AdS black hole solutions in Einstein Gauss Bonnet gravity in presence of string cloud. It turns out that there exist three black holes in certain range of parameters for small enough chemical potential. However, for large chemical potential, these black holes merge into a single one. The free energy of the black holes is computed from the on shell Euclidean action by subtracting the contribution of an extremal black hole. We have studied the free energy and specific heat of the solutions, which shows that the medium sized black hole is unstable. This study may provide necessary ingredients for analysis of the behaviour of quark-antiquark potential in the dual gauge theory.


title: Implicit Regularization Leads to Benign Overfitting for Sparse Linear Regression

abstract: In deep learning, often the training process finds an interpolator (a solution with 0 training loss), but the test loss is still low. This phenomenon, known as benign overfitting, is a major mystery that received a lot of recent attention. One common mechanism for benign overfitting is implicit regularization, where the training process leads to additional properties for the interpolator, often characterized by minimizing certain norms. However, even for a simple sparse linear regression problem $y = \beta^{*\top} x +\xi$ with sparse $\beta^*$, neither minimum $\ell_1$ or $\ell_2$ norm interpolator gives the optimal test loss. In this work, we give a different parametrization of the model which leads to a new implicit regularization effect that combines the benefit of $\ell_1$ and $\ell_2$ interpolators. We show that training our new model via gradient descent leads to an interpolator with near-optimal test loss. Our result is based on careful analysis of the training dynamics and provides another example of implicit regularization effect that goes beyond norm minimization.


title: Extended R-matrix description of two-proton radioactivity

abstract: Two-proton ($2p$) radioactivity provides fundamental knowledge on the three-body decay mechanism and the residual nuclear interaction. In this work, we propose decay width formulae in the extended R-matrix framework for different decay mechanisms, including sequential $2p$ decay, diproton decay, tri-body decay, and sequential two-diproton decay. The diproton and tri-body formulae, combined with information on the two-nucleon transfer amplitude and Wigner single-particle reduced width, can reproduce well experimental $2p$ radioactivity half-lives. For the case of $^{67}$Kr, theoretical predictions for direct $2p$ decay give much larger half-lives than the recent measurement from RIKEN. A combination of direct and sequential $2p$ emission is analyzed by considering a small negative one-proton separation energy and a possible enhanced contribution from the $p$-wave component. The present method predicts that $^{71}$Sr and $^{74}$Zr may be the most promising candidates for future study on $2p$ radioactivity. Our model gives an upper limit of 55(4) keV for the decay width of $4p$ emission in recently found four-proton resonant nuclide, $^{18}$Mg, which agrees with the observed width of 115(100) keV.


title: On the Schr\"odinger-Poisson system with $(p,q)$-Laplacian

abstract: We study a class of Schr\"{o}dinger-Poisson systems with $(p,q)$-Laplacian. Using fixed point theory, we obtain a new existence result for nontrivial solutions. The main novelty of the paper is the combination of a double phase operator and the nonlocal term. Our results generalize some known results.


title: Monitoring observations of SMC X-1's excursions (MOOSE)-II: A new excursion accompanies spin-up acceleration

abstract: SMC X-1 is a high-mass X-ray binary showing superorbital modulation with an unstable period. Previous monitoring shows three excursion events in 1996--1998, 2005--2007, and 2014--2016. The superorbital period drifts from >60 days to <40 days and then evolves back during an excursion. Here we report a new excursion event of SMC X-1 in 2020--2021, indicating that the superorbital modulation has an unpredictable, chaotic nature. We trace the spin-period evolution and find that the spin-up rate accelerated one year before the onset of this new excursion, which suggests a possible inside-out process connecting the spin-up acceleration and the superorbital excursion. This results in a deviation of the spin period residual, similar to the behaviour of the first excursion in 1996--1998. In further analysis of the pulse profile evolution, we find that the pulsed fraction shows a long-term evolution and may be connected to the superorbital excursion. These discoveries deepen the mystery of SMC X-1 because they cannot be solely interpreted by the warped disc model. Upcoming pointed observations and theoretical studies may improve our understanding of the detailed accretion mechanisms taking place.


title: Deep Learning Model for Inverse Design of Semiconductor Heterostructures with Desired Electronic Band Structures

abstract: First-principles modeling techniques have shown remarkable success in predicting electronic band structures of materials. However, the computational costs make it challenging to use them for predicting band structures of semiconductor heterostructures, that show high variability of atomic structures. We propose a machine learning-assisted first-principles framework that bypasses expensive computations and predicts band structures from the knowledge of atomic structural features. Additionally, the framework directly connects modeling results and experimental data. For example, it accepts images obtained with angle-resolved photoemission spectroscopy as input and predicts the corresponding atomic structures. The framework leverages the physical relationship between atomic environments and bands. We demonstrate the framework using silicon/germanium based superlattices and heterostructures. Once trained on silicon-based systems, the framework can even predict band structures of gallium arsenide thin films. The physics-informed framework establishes an approach to expedite the design and discovery of complex materials with desired band structures, going beyond combinatorial approaches.


title: Kpc-scale properties of dust temperature in terms of dust mass and star formation activity

abstract: We investigate how the dust temperature is affected by local environmental quantities, especially dust surface density ($\Sigma_\mathrm{dust}$), dust-to-gas ratio (D/G) and interstellar radiation field. We compile multi-wavelength observations in 46 nearby galaxies, uniformly processed with a common physical resolution of $2~$kpc. A physical dust model is used to fit the infrared dust emission spectral energy distribution (SED) observed with WISE and Herschel. The star formation rate (SFR) is traced with GALEX ultraviolet data corrected by WISE infrared. We find that the dust temperature correlates well with the SFR surface density ($\Sigma_{\rm SFR}$), which traces the radiation from young stars. The dust temperature decreases with increasing D/G at fixed $\Sigma_{\rm SFR}$ as expected from stronger dust shielding at high D/G, when $\Sigma_\mathrm{SFR}$ is higher than $\sim 2\times 10^{-3}~\rm M_\odot~yr^{-1}~kpc^{-2}$. These measurements are in good agreement with the dust temperature predicted by our proposed analytical model. Below this range of $\Sigma_\mathrm{SFR}$, the observed dust temperature is higher than the model prediction and is only weakly dependent on D/G, which is possibly due to the dust heating from old stellar population or the variation of SFR within the past $10^{10}~$yr. Overall, the dust temperature as a function of $\Sigma_\mathrm{SFR}$ and $\Sigma_\mathrm{dust}$ predicted by our analytical model is consistent with observations. We also notice that at fixed gas surface density, $\Sigma_{\rm SFR}$ tends to increase with D/G, i.e. we can empirically modify the Kennicutt-Schmidt law with a dependence on D/G to better match observations.


title: Dictionary-based Manifold Learning

abstract: We propose a paradigm for interpretable Manifold Learning for scientific data analysis, whereby we parametrize a manifold with $d$ smooth functions from a scientist-provided dictionary of meaningful, domain-related functions. When such a parametrization exists, we provide an algorithm for finding it based on sparse non-linear regression in the manifold tangent bundle, bypassing more standard manifold learning algorithms. We also discuss conditions for the existence of such parameterizations in function space and for successful recovery from finite samples. We demonstrate our method with experimental results from a real scientific domain.


title: On Lower Bounds for Maximin Share Guarantees

abstract: We study the problem of fairly allocating a set of indivisible items to a set of agents with additive valuations. Recently, Feige et al. (WINE'21) proved that a maximin share (MMS) allocation exists for all instances with $n$ agents and no more than $n + 5$ items. Moreover, they proved that an MMS allocation is not guaranteed to exist for instances with $3$ agents and at least $9$ items, or $n \ge 4$ agents and at least $3n + 3$ items. In this work, we shrink the gap between these upper and lower bounds for guaranteed existence of MMS allocations. We prove that for any integer $c > 0$, there exists a number of agents $n_c$ such that an MMS allocation exists for any instance with $n \ge n_c$ agents and at most $n + c$ items, where $n_c \le \lfloor 0.6597^c \cdot c!\rfloor$ for allocation of goods and $n_c \le \lfloor 0.7838^c \cdot c!\rfloor$ for chores. Furthermore, we show that for $n \neq 3$ agents, all instances with $n + 6$ goods have an MMS allocation.


title: Fitting the Distribution of Linear Combinations of t-Variables with more than 2 Degrees of Freedom

abstract: The linear combination of Student's $t$ random variables (RVs) appears in many statistical applications. Unfortunately, the Student's $t$ distribution is not closed under convolution, thus, deriving an exact and general distribution for the linear combination of $K$ Student's $t$ RVs is infeasible, which motivates a fitting/approximation approach. Here, we focus on the scenario where the only constraint is that the number of degrees of freedom of each $t-$RV is greater than two. Notice that since the odd moments/cumulants of the Student's $t$ distribution are zero, and the even moments/cumulants do not exist when their order is greater than the number of degrees of freedom, it becomes impossible to use conventional approaches based on moments/cumulants of order one or higher than two. To circumvent this issue, herein we propose fitting such a distribution to that of a scaled Student's $t$ RV by exploiting the second moment together with either the first absolute moment or the characteristic function (CF). For the fitting based on the absolute moment, we depart from the case of the linear combination of $K= 2$ Student's $t$ RVs and then generalize to $K\ge 2$ through a simple iterative procedure. Meanwhile, the CF-based fitting is direct, but its accuracy (measured in terms of the Bhattacharyya distance metric) depends on the CF parameter configuration, for which we propose a simple but accurate approach. We numerically show that the CF-based fitting usually outperforms the absolute moment -based fitting and that both the scale and number of degrees of freedom of the fitting distribution increase almost linearly with $K$.


title: Electron as a Tiny Mirror: Radiation From a Worldline With Asymptotic Inertia

abstract: We present a moving mirror analog of the electron, whose worldline possesses asymptotic constant velocity with corresponding beta Bogolubov coefficients that are consistent with finite total emitted energy. Furthermore, the quantum analog model is in agreement with the total energy obtained by integrating the classical Larmor power.


title: InQuIR: Intermediate Representation for Interconnected Quantum Computers

abstract: Various physical constraints limit the number of qubits that can be implemented in a single quantum processor, and thus it is necessary to connect multiple quantum processors via quantum interconnects. While several compiler implementations for interconnected quantum computers have been proposed, there is no suitable representation as their compilation target. The lack of such representation impairs the reusability of compiled programs and makes it difficult to reason formally about the complicated behavior of distributed quantum programs. We propose InQuIR, an intermediate representation that can express communication and computation on distributed quantum systems. InQuIR has formal semantics that allows us to describe precisely the behaviors of distributed quantum programs. We give examples written in InQuIR to illustrate the problems arising in distributed programs, such as deadlock. We present a roadmap for static verification using type systems to deal with such a problem. We also provide software tools for InQuIR and evaluate the computational costs of quantum circuits under various conditions. Our tools are available at https://github.com/team-InQuIR/InQuIR.


title: Compositional Prompt Tuning with Motion Cues for Open-vocabulary Video Relation Detection

abstract: Prompt tuning with large-scale pretrained vision-language models empowers open-vocabulary predictions trained on limited base categories, e.g., object classification and detection. In this paper, we propose compositional prompt tuning with motion cues: an extended prompt tuning paradigm for compositional predictions of video data. In particular, we present Relation Prompt (RePro) for Open-vocabulary Video Visual Relation Detection (Open-VidVRD), where conventional prompt tuning is easily biased to certain subject-object combinations and motion patterns. To this end, RePro addresses the two technical challenges of Open-VidVRD: 1) the prompt tokens should respect the two different semantic roles of subject and object, and 2) the tuning should account for the diverse spatio-temporal motion patterns of the subject-object compositions. Without bells and whistles, our RePro achieves a new state-of-the-art performance on two VidVRD benchmarks of not only the base training object and predicate categories, but also the unseen ones. Extensive ablations also demonstrate the effectiveness of the proposed compositional and multi-mode design of prompts. Code is available at https://github.com/Dawn-LX/OpenVoc-VidVRD.


title: On the use of temporal filtering for mitigating galactic synchrotron calibration bias in 21 cm reionization observations

abstract: Precision antenna calibration is required for mitigating the impact of foreground contamination in 21 cm cosmological radio surveys. One widely studied source of error is the effect of missing point sources in the calibration sky model; however, poorly understood diffuse galactic emission also creates a calibration bias that can complicate the clean separation of foregrounds from the 21 cm signal. In this work, we present a technique for suppressing this bias with temporal filtering of radio interferometric visibilities observed in a drift-scan mode. We demonstrate this technique on mock simulations of the Hydrogen Epoch of Reionization Array (HERA) experiment. Inspecting the recovered calibration solutions, we find that our technique reduces spurious errors by over an order of magnitude. This improved accuracy approaches the required accuracy needed to make a fiducial detection of the 21 cm signal with HERA, but is dependent on a number of external factors that we discuss. We also explore different types of temporal filtering techniques and discuss their relative performance and tradeoffs.


abstract: We study a class of reinforcement learning problems where the reward signals for policy learning are generated by an internal reward model that is dependent on and jointly optimized with the policy. This interdependence between the policy and the reward model leads to an unstable learning process because reward signals from an immature reward model are noisy and impede policy learning, and conversely, an under-optimized policy impedes reward estimation learning. We call this learning setting $\textit{Internally Rewarded Reinforcement Learning}$ (IRRL) as the reward is not provided directly by the environment but $\textit{internally}$ by a reward model. In this paper, we formally formulate IRRL and present a class of problems that belong to IRRL. We theoretically derive and empirically analyze the effect of the reward function in IRRL and based on these analyses propose the clipped linear reward function. Experimental results show that the proposed reward function can consistently stabilize the training process by reducing the impact of reward noise, which leads to faster convergence and higher performance compared with baselines in diverse tasks.


title: CATFL: Certificateless Authentication-based Trustworthy Federated Learning for 6G Semantic Communications

abstract: Federated learning (FL) provides an emerging approach for collaboratively training semantic encoder/decoder models of semantic communication systems, without private user data leaving the devices. Most existing studies on trustworthy FL aim to eliminate data poisoning threats that are produced by malicious clients, but in many cases, eliminating model poisoning attacks brought by fake servers is also an important objective. In this paper, a certificateless authentication-based trustworthy federated learning (CATFL) framework is proposed, which mutually authenticates the identity of clients and server. In CATFL, each client verifies the server's signature information before accepting the delivered global model to ensure that the global model is not delivered by false servers. On the contrary, the server also verifies the server's signature information before accepting the delivered model updates to ensure that they are submitted by authorized clients. Compared to PKI-based methods, the CATFL can avoid too high certificate management overheads. Meanwhile, the anonymity of clients shields data poisoning attacks, while real-name registration may suffer from user-specific privacy leakage risks. Therefore, a pseudonym generation strategy is also presented in CATFL to achieve a trade-off between identity traceability and user anonymity, which is essential to conditionally prevent from user-specific privacy leakage. Theoretical security analysis and evaluation results validate the superiority of CATFL.


title: W2SAT: Learning to generate SAT instances from Weighted Literal Incidence Graphs

abstract: The Boolean Satisfiability (SAT) problem stands out as an attractive NP-complete problem in theoretic computer science and plays a central role in a broad spectrum of computing-related applications. Exploiting and tuning SAT solvers under numerous scenarios require massive high-quality industry-level SAT instances, which unfortunately are quite limited in the real world. To address the data insufficiency issue, in this paper, we propose W2SAT, a framework to generate SAT formulas by learning intrinsic structures and properties from given real-world/industrial instances in an implicit fashion. To this end, we introduce a novel SAT representation called Weighted Literal Incidence Graph (WLIG), which exhibits strong representation ability and generalizability against existing counterparts, and can be efficiently generated via a specialized learning-based graph generative model. Decoding from WLIGs into SAT problems is then modeled as finding overlapping cliques with a novel hill-climbing optimization method termed Optimal Weight Coverage (OWC). Experiments demonstrate the superiority of our WLIG-induced approach in terms of graph metrics, efficiency, and scalability in comparison to previous methods. Additionally, we discuss the limitations of graph-based SAT generation for real-world applications, especially when utilizing generated instances for SAT solver parameter-tuning, and pose some potential directions.


title: Hardness of braided quantum circuit optimization in the surface code

abstract: Large-scale quantum information processing requires the use of quantum error correcting codes to mitigate the effects of noise in quantum devices. Topological error-correcting codes, such as surface codes, are promising candidates as they can be implemented using only local interactions in a two-dimensional array of physical qubits. Procedures such as defect braiding and lattice surgery can then be used to realize a fault-tolerant universal set of gates on the logical space of such topological codes. However, error correction also introduces a significant overhead in computation time, the number of physical qubits, and the number of physical gates. While optimizing fault-tolerant circuits to minimize this overhead is critical, the computational complexity of such optimization problems remains unknown. This ambiguity leaves room for doubt surrounding the most effective methods for compiling fault-tolerant circuits for a large-scale quantum computer. In this paper, we show that the optimization of a special subset of braided quantum circuits is NP-hard by a polynomial-time reduction of the optimization problem into a specific problem called Planar Rectilinear 3SAT.


title: Identifying the SN 2022acko progenitor with JWST

abstract: We report on analysis using the James Webb Space Telescope (JWST) to identify a candidate progenitor star of the Type II-plateau supernova SN 2022acko in the nearby, barred spiral galaxy NGC 1300. To our knowledge, our discovery represents the first time JWST has been used to localize a progenitor system in pre-explosion archival Hubble Space Telescope (HST) images. We astrometrically registered a JWST NIRCam image from 2023 January, in which the SN was serendipitously captured, to pre-SN HST F160W and F814W images from 2017 and 2004, respectively. An object corresponding precisely to the SN position has been isolated with reasonable confidence. That object has a spectral energy distribution (SED) and overall luminosity consistent with a single-star model having an initial mass possibly somewhat less than the canonical 8 Msun theoretical threshold for core collapse (although masses as high as 9 Msun for the star are also possible); however, the star's SED and luminosity are inconsistent with that of a super-asymptotic giant branch star which might be a forerunner of an electron-capture SN. The properties of the progenitor alone imply that SN 2022acko is a relatively normal SN II-P, albeit most likely a low-luminosity one. The progenitor candidate should be confirmed with follow-up HST imaging at late times, when the SN has sufficiently faded. This potential use of JWST opens a new era of identifying SN progenitor candidates at high spatial resolution.


title: Learning Generalized Zero-Shot Learners for Open-Domain Image Geolocalization

abstract: Image geolocalization is the challenging task of predicting the geographic coordinates of origin for a given photo. It is an unsolved problem relying on the ability to combine visual clues with general knowledge about the world to make accurate predictions across geographies. We present $\href{https://huggingface.co/geolocal/StreetCLIP}{\text{StreetCLIP}}$, a robust, publicly available foundation model not only achieving state-of-the-art performance on multiple open-domain image geolocalization benchmarks but also doing so in a zero-shot setting, outperforming supervised models trained on more than 4 million images. Our method introduces a meta-learning approach for generalized zero-shot learning by pretraining CLIP from synthetic captions, grounding CLIP in a domain of choice. We show that our method effectively transfers CLIP's generalized zero-shot capabilities to the domain of image geolocalization, improving in-domain generalized zero-shot performance without finetuning StreetCLIP on a fixed set of classes.


title: Coherence Transfer and Destructive Interference in Two-Dimensional Coherence Maps

abstract: Coherence maps (CMs) in multidimensional spectroscopy report total interference of all quantum coherent pathways. Detailed understanding of how this interference manifests spectroscopically is vital for deciphering mechanistic origins of impulsively generated wavepackets, but currently lacking. Here we explain the origin of recently reported diagonal node-like features in CMs of bacteriochlorophyll monomers and photosynthetic reaction centers (RCs), where the apparent resemblance in the two disparate systems was reportedly perplexing. We show that both spectroscopic signatures have distinct physical origins. Node-like lineshapes in monomers arise from unique phase twists caused by destructive interference between ground and excited state vibrational coherences. In contrast, nodal lines in RCs are explained by coherence transfer of vibrational wavepackets which do not participate in the ultrafast energy transfer and their destructive interference with ground state pathways. Our results resolve recent spectroscopic observations and illustrate new mechanistic insights gained from understanding interference effects in multidimensional spectroscopy.


title: Anti-unification and Generalization: A Survey

abstract: Anti-unification (AU) is a fundamental operation for generalization computation used for inductive inference. It is the dual operation to unification, an operation at the foundation of automated theorem proving. Interest in AU from the AI and related communities is growing, but without a systematic study of the concept nor surveys of existing work, investigations often resort to developing application-specific methods that existing approaches may cover. We provide the first survey of AU research and its applications and a general framework for categorizing existing and future developments.


title: Effect of surface morphology on magnetization dynamics of cobalt ultrathin films

abstract: Growth of Co film on SiO2 substrates with the surface roughness of 0.5 nm and 1.6 nm has been studied in situ using the magneto-optical Kerr effect (MOKE) and four probe resistivity measurements. In-situ measurements jointly suggest the Volmer-Weber growth process and proceed via a nonmagnetic, superparamagnetic and ferromagnetic phase formation on both substrates. Islands are found to coalesce at film thicknesses of 0.6 nm and at 1.5 nm with continuous film formation around film thicknesses of 1.5 nm and 3.0 nm for smooth and rough substrates, respectively. Ferromagnetic long-range ordering i.e., the appearance of a magnetic hysteresis loop in both films, is observed just after coalescing stage. Observed azimuthal angular dependence of coercivity confirmed the presence of a weak uniaxial magnetic anisotropy in both films, whereas the difference in uniaxial magnetic anisotropy with substrate roughness is interpreted in terms of the combined effect of domain wall pinning and internal stresses in the films. The origin of much higher UMA in the case of the Co film deposited on a ripple-patterned substrate of similar root means square roughness is attributed to the modified long-range dipolar stray fields on the surface.


title: Quantitative KAM theory, with an application to the three-body problem

abstract: Based on quantitative ``{\sc kam} theory'', we state and prove two theorems about the continuation of maximal and whiskered quasi--periodic motions to slightly perturbed systems exhibiting proper degeneracy. Next, we apply such results to prove that, in the three--body problem, there is a small set in phase space where it is possible to detect both such families of tori. We also estimate the density of such motions in proper ambient spaces. Up to our knowledge, this is the first proof of co--existence of stable and whiskered tori in a physical system.


title: Threshold velocity for collisional growth of porous dust aggregates consisting of cohesive frictionless spheres

abstract: Understanding the collisional outcomes of dust aggregates and dependence on material properties of the constituting particles is of great importance toward understanding planet formation. Recent numerical simulations have revealed that interparticle tangential friction plays a crucial role in energy dissipation during collisions between porous dust aggregates; however, the importance of friction on the collisional growth of dust aggregates remains poorly understood. Here we demonstrate the effects of interparticle tangential friction on the collisional growth of dust aggregates. We performed numerical simulations of collisions between equal-mass porous dust aggregates consisting of cohesive and frictionless spheres. We changed the collision velocity and impact angle systematically and calculated the collisional growth efficiency as a function of the collision velocity. We found that the threshold velocity for collisional growth decreases when dust aggregates are made of frictionless spheres as compared to frictional spheres. Our results highlight the importance of tangential interactions on the collisional behavior of dust aggregates and indicate that the predictive equation for threshold velocity should be reconstructed.


title: Informationally Robust Cheap-Talk

abstract: We study the robustness of cheap-talk equilibria to infinitesimal private information of the receiver in a model with a binary state-space and state-independent sender-preferences. We show that the sender-optimal equilibrium is robust if and only if this equilibrium either reveals no information to the receiver or fully reveals one of the states with positive probability. We then characterize the actions that can be played with positive probability in any robust equilibrium. Finally, we fully characterize the optimal sender-utility under binary receiver's private information, and provide bounds for the optimal sender-utility under general private information.


title: Xenos: Dataflow-Centric Optimization to Accelerate Model Inference on Edge Devices

abstract: Edge computing has been emerging as a popular scenario for model inference. However, the inference performance on edge devices (e.g., Multi-Core DSP, FGPA, etc.) suffers from inefficiency due to the lack of highly optimized inference frameworks. Previous model inference frameworks are mainly developed in an operator-centric way, which provides insufficient acceleration to edge-based inference. Besides, the operator-centric framework incurs significant costs for continuous development and maintenance. In this paper, we propose Xenos, which can automatically conduct dataflow-centric optimization of the computation graph and accelerate inference in two dimensions. Vertically, Xenos develops operator linking technique to improve data locality by restructuring the inter-operator dataflow. Horizontally, Xenos develops DSP-aware operator split technique to enable higher parallelism across multiple DSP units. Our evaluation proves the effectiveness of vertical and horizontal dataflow optimization, which reduce the inference time by 21.2\%--84.9\% and 17.9\%--96.2\% , respectively. Besides, Xenos also outperforms the widely-used TVM by 3.22$\times$--17.92$\times$. Moreover, we extend Xenos to a distributed solution, which we call d-Xenos. d-Xenos employs multiple edge devices to jointly conduct the inference task and achieves a speedup of 3.68x--3.78x compared with the single device.


title: Evolution of interface magnetism in Fe/Alq3 bilayer

abstract: Interface magnetism and topological structure of Fe on organic semiconductor film (Alq3) have been studied and compared with Fe film deposited directly on Si (100) substrate. To get information on the diffused Fe layer at the Fe/Alq3 interface, grazing incident nuclear resonance scattering (GINRS) measurements are made depth selective by introducing a 95% enriched thin 57Fe layer at the Interface and producing x-ray standing wave within the layered structure. Compared with Fe growth on Si substrate, where film exhibits a hyperfine field value of 32 T (Bulk Fe), a thick Fe- Alq3 interface has been found with reduced electron density and hyperfine fields providing evidence of deep penetration of Fe atoms into Alq3 film. Due to the soft nature of Alq3, Fe moments relax in the film plane. At the same time, Fe on Si has a resultant ~43 deg out-of-plane orientation of Fe moments at the Interface due to the stressed and rough Fe layer near Si. The evolution of magnetism at the Fe-Alq3 Interface is monitored using in-situ magneto-optical Kerr effect (MOKE) during the growth of Fe on the Alq3 surface and small-angle x-ray scattering (SAXS) measurements. It is found that the Fe atom tries to organize into clusters to minimize their surface/interface energy. The origin of the 2.4 nm thick magnetic dead layer at the Interface is attributed to the small Fe clusters of paramagnetic or superparamagnetic nature. The present work provides an understanding of interfacial magnetism at metal-organic interfaces and the topological study using the GI-NRS technique, which is made depth selective to probe magnetism of the diffused ferromagnetic layer, which is otherwise difficult for lab-based techniques.


title: Selective Uncertainty Propagation in Offline RL

abstract: We consider the finite-horizon offline reinforcement learning (RL) setting, and are motivated by the challenge of learning the policy at any step h in dynamic programming (DP) algorithms. To learn this, it is sufficient to evaluate the treatment effect of deviating from the behavioral policy at step h after having optimized the policy for all future steps. Since the policy at any step can affect next-state distributions, the related distributional shift challenges can make this problem far more statistically hard than estimating such treatment effects in the stochastic contextual bandit setting. However, the hardness of many real-world RL instances lies between the two regimes. We develop a flexible and general method called selective uncertainty propagation for confidence interval construction that adapts to the hardness of the associated distribution shift challenges. We show benefits of our approach on toy environments and demonstrate the benefits of these techniques for offline policy learning.


title: Selling Data to a Competitor

abstract: We study the costs and benefits of selling data to a competitor. Although selling all consumers' data may decrease total firm profits, there exist other selling mechanisms -- in which only some consumers' data is sold -- that render both firms better off. We identify the profit-maximizing mechanism, and show that the benefit to firms comes at a cost to consumers. We then construct Pareto-improving mechanisms, in which each consumers' welfare, as well as both firms' profits, increase. Finally, we show that consumer opt-in can serve as an instrument to induce firms to choose a Pareto-improving mechanism over a profit-maximizing one.


title: Jointist: Simultaneous Improvement of Multi-instrument Transcription and Music Source Separation via Joint Training

abstract: In this paper, we introduce Jointist, an instrument-aware multi-instrument framework that is capable of transcribing, recognizing, and separating multiple musical instruments from an audio clip. Jointist consists of an instrument recognition module that conditions the other two modules: a transcription module that outputs instrument-specific piano rolls, and a source separation module that utilizes instrument information and transcription results. The joint training of the transcription and source separation modules serves to improve the performance of both tasks. The instrument module is optional and can be directly controlled by human users. This makes Jointist a flexible user-controllable framework. Our challenging problem formulation makes the model highly useful in the real world given that modern popular music typically consists of multiple instruments. Its novelty, however, necessitates a new perspective on how to evaluate such a model. In our experiments, we assess the proposed model from various aspects, providing a new evaluation perspective for multi-instrument transcription. Our subjective listening study shows that Jointist achieves state-of-the-art performance on popular music, outperforming existing multi-instrument transcription models such as MT3. We conducted experiments on several downstream tasks and found that the proposed method improved transcription by more than 1 percentage points (ppt.), source separation by 5 SDR, downbeat detection by 1.8 ppt., chord recognition by 1.4 ppt., and key estimation by 1.4 ppt., when utilizing transcription results obtained from Jointist. Demo available at \url{https://jointist.github.io/Demo}.


title: Limits of graded Gorenstein algebras of Hilbert function $(1,3^k,1)$

abstract: Let $R={\sf k}[x,y,z]$, the polynomial ring over a field $\sf k$. Several of the authors previously classified nets of ternary conics and their specializations over an algebraically closed field. We here show that when $\sf k$ is algebraically closed, and the Hilbert function sequence $T=(1,3^k,1), k\ge 2$ (i.e. $T=(1,3,3,\ldots,3,1)$ where $k$ is the multiplicity of $3$) then the family $G_T$ parametrizing graded Artinian algebra quotients $A=R/I$ of $R$ having Hilbert function $T$ is irreducible, and $G_T$ is the closure of the family $\mathrm{Gor}(T)$ of Artinian Gorenstein algebras of Hilbert function $T$. We then classify up to isomorphism the elements of these families $\mathrm{Gor}(T)$ and of $G_T$. Finally, we give examples of codimension three Gorenstein sequences, such as $(1,3,5,3,1)$, for which $G_T$ has several irreducible components, one being the Zariski closure of $\mathrm{Gor}(T)$.


title: CoderEval: A Benchmark of Pragmatic Code Generation with Generative Pre-trained Models

abstract: Code generation models based on the pre-training and fine-tuning paradigm have been increasingly attempted by both academia and industry, resulting in well-known industrial models such as Codex, CodeGen, and PanGu-Coder. To evaluate the effectiveness of these models, multiple existing benchmarks are proposed, including only cases of generating a standalone function, i.e., a function that may invoke or access only built-in functions and standard libraries. However, non-standalone functions, which typically are not included in the existing benchmarks, constitute more than 70% of the functions in popular open-source projects, and evaluating models' effectiveness on standalone functions cannot reflect these models' effectiveness on pragmatic code generation scenarios. To help bridge the preceding gap, in this paper, we propose a benchmark named CoderEval, consisting of 230 Python and 230 Java code generation tasks carefully curated from popular real-world open-source projects and a self-contained execution platform to automatically assess the functional correctness of generated code. CoderEval supports code generation tasks from six levels of context dependency, where context refers to code elements such as types, APIs, variables, and consts defined outside the function under generation but within the dependent third-party libraries, current class, file, or project. CoderEval can be used to evaluate the effectiveness of models in generating code beyond only standalone functions. By evaluating three code generation models on CoderEval, we find that the effectiveness of these models in generating standalone functions is substantially higher than that in generating non-standalone functions. Our analysis highlights the current progress and pinpoints future directions to further improve a model's effectiveness by leveraging contextual information for pragmatic code generation.


title: Solar radio bursts observations by Egypt- Alexandria CALLISTO spectrometer: First results

abstract: The newly installed CALLISTO spectrometer, hosted by the Department of Space Environment, Institute of Basic and Applied Sciences- EJUST, commenced operation on August 14, 2021. The system contains a cross dipole long-wavelength array antenna with high sensitivity to monitor solar radio transients. Its antenna was strategically positioned and appeared to be in the center of the CALLISTO network of spectrometers. Moreover, in the northern section of Africa, the Egypt-Alexandria CALLISTO and ALGERIA-CRAAG stations are the only ones operating. There are no stations in the West African region, while stations in the eastern part of Africa are not working. Thus, Egypt- Alexandria station serves as a reference for other stations within the e-CALLISTO network. Despite the low solar activity, the instrument detected several solar radio bursts not limited to type II, type III, and type V. A vigorous case study was conducted on two selected radio burst events to validate the authenticity of the recorded events. Other solar radio stations at different geographical locations recorded all the radio bursts detected by the spectrometer. The case study included brief analyses that indicated a type II radio burst observed on October 09, 2021, between 06:30 and 07:00 UT, was associated with an M1.6 solar flare located at N18E08 within NOAA-AR 12882 and a CME with a shock front speed of ~978 km/s. However, the type III radio burst is neither CME nor solar flare associated. These analyses examine the instrument's capacity to provide real-time solar radio transient data 24 hours a day to mitigate the challenges of data gaps faced in the African continent. Hence, the instrument has become an integral part of space weather monitoring and forecasting over the region and other parts of the globe.


title: MS-DETR: Multispectral Pedestrian Detection Transformer with Loosely Coupled Fusion and Modality-Balanced Optimization

abstract: Multispectral pedestrian detection is an important task for many around-the-clock applications, since the visible and thermal modalities can provide complementary information especially under low light conditions. Most of the available multispectral pedestrian detectors are based on non-end-to-end detectors, while in this paper, we propose MultiSpectral pedestrian DEtection TRansformer (MS-DETR), an end-to-end multispectral pedestrian detector, which extends DETR into the field of multi-modal detection. MS-DETR consists of two modality-specific backbones and Transformer encoders, followed by a multi-modal Transformer decoder, and the visible and thermal features are fused in the multi-modal Transformer decoder. To well resist the misalignment between multi-modal images, we design a loosely coupled fusion strategy by sparsely sampling some keypoints from multi-modal features independently and fusing them with adaptively learned attention weights. Moreover, based on the insight that not only different modalities, but also different pedestrian instances tend to have different confidence scores to final detection, we further propose an instance-aware modality-balanced optimization strategy, which preserves visible and thermal decoder branches and aligns their predicted slots through an instance-wise dynamic loss. Our end-to-end MS-DETR shows superior performance on the challenging KAIST, CVC-14 and LLVIP benchmark datasets. The source code is available at https://github.com/YinghuiXing/MS-DETR .


title: Development of Real-time Rendering Technology for High-Precision Models in Autonomous Driving

abstract: Our autonomous driving simulation lab produces a high-precision 3D model simulating the parking lot. However, the current model still has poor rendering quality in some aspects. In this work, we develop a system to improve the rendering of the model and evaluate the quality of the rendered model.


title: Long-term gravitational wave asteroseismology of supernova: from core collapse to 20 seconds postbounce

abstract: We use an asteroseismology method to calculate the frequencies of gravitational waves in a long-term core-collapse supernova simulation, with a mass of 9.6 $M_\odot$. The simulation, which includes neutrino transport in general relativity is performed from core-collapse, bounce, explosion and cooling of protoneutron stars (PNSs) up to 20 s after the bounce self-consistently. Based on the hydrodynamics background, we calculate eigenmodes of the PNS oscillation through a perturbation analysis on fluid and metric. We classify the modes by the number of nodes and find that there are several eigenmodes. In the early phase before 1 s, there are a low-frequency g-mode around 0.5 kHz, a mid-frequency f-modes around 1 kHz, and high-frequency p-modes above them. Beyond 1 s, the g-modes drop too low in frequency and the p-modes become too high to be detected by ground-based interferometers. However, the f-mode persists at 1 kHz. We present a novel fitting formula for the ramp-up mode, comprising a mixture of g-mode and f-mode, using postbounce time as a fitting parameter. Our approach yields improved results for the long-term simulation compared to prior quadratic formulas. We also fit frequencies using combinations of gravitational mass and radius of the PNS. We test three types of fitting variables: compactness, surface gravity, and average density. We present results of the time evolution of each mode and the fitting for three different ranges, from 0.2 to 1, 4, and 20 s for each formula. We compare the deviation of the formulas from the eigenmodes to determine which fitting formula is the best. In conclusion, any variable fits the eigenmodes well to a similar degree. Comparing 3 variables in detail, the fitting with compactness is slightly the best among them. We also find that the fitting using less than 1 s of simulation data cannot be extrapolated to the long-term frequency prediction.


title: A Survey of Methods, Challenges and Perspectives in Causality

abstract: Deep Learning models have shown success in a large variety of tasks by extracting correlation patterns from high-dimensional data but still struggle when generalizing out of their initial distribution. As causal engines aim to learn mechanisms independent from a data distribution, combining Deep Learning with Causality can have a great impact on the two fields. In this paper, we further motivate this assumption. We perform an extensive overview of the theories and methods for Causality from different perspectives, with an emphasis on Deep Learning and the challenges met by the two domains. We show early attempts to bring the fields together and the possible perspectives for the future. We finish by providing a large variety of applications for techniques from Causality.


title: The geometry of hidden representations of large transformer models

abstract: Large transformers are powerful architectures used for self-supervised data analysis across various data types, including protein sequences, images, and text. In these models, the semantic structure of the dataset emerges from a sequence of transformations between one representation and the next. We characterize the geometric and statistical properties of these representations and how they change as we move through the layers. By analyzing the intrinsic dimension (ID) and neighbor composition, we find that the representations evolve similarly in transformers trained on protein language tasks and image reconstruction tasks. In the first layers, the data manifold expands, becoming high-dimensional, and then contracts significantly in the intermediate layers. In the last part of the model, the ID remains approximately constant or forms a second shallow peak. We show that the semantic information of the dataset is better expressed at the end of the first peak, and this phenomenon can be observed across many models trained on diverse datasets. Based on our findings, we point out an explicit strategy to identify, without supervision, the layers that maximize semantic content: representations at intermediate layers corresponding to a relative minimum of the ID profile are more suitable for downstream learning tasks.


title: Self-supervised learning for gravitational wave signal identification

abstract: The computational cost of searching for gravitational wave (GW) signals in low latency has always been a matter of concern. We present a self-supervised learning model applicable to the GW detection. Based on simulated massive black hole binary signals in synthetic Gaussian noise representative of space-based GW detectors Taiji and LISA sensitivity, and regarding their corresponding datasets as a GW twins in the contrastive learning method, we show that the self-supervised learning may be a highly computationally efficient method for GW signal identification.


title: Exponential ergodicity of L\'{e}vy driven Langevin dynamics with singular potentials

abstract: In this paper, we address exponential ergodicity for L\'{e}vy driven Langevin dynamics with singular potentials, which can be used to model the time evolution of a molecular system consisting of $N$ particles moving in $\R^d$ and subject to discontinuous stochastic forces. In particular, our results are applicable to the singular setups concerned with not only the Lennard-Jones-like interaction potentials but also the Coulomb potentials. In addition to Harris' theorem, the approach is based on novel constructions of proper Lyapunov functions (which are completely different from the setting for Langevin dynamics driven by Brownian motions), on invoking the H\"{o}rmander theorem for non-local operators and on solving the issue on an approximate controllability of the associated deterministic system as well as on exploiting the time-change idea.


title: Electronic Transport in a Topological Semimetal WTe2 Single Crystal

abstract: Electrical resistivity, magnetoresistivity, and the Hall effect have been studied in a topological semimetal WTe2 single crystal in the temperature range from 12 to 200 K under magnetic fields up to 9 T. It has been found that quadratic temperature dependences of the electrical resistivity in the absence of a magnetic field and the conductivity in a magnetic field are observed at low temperatures, which is apparently associated with contributions from various scattering mechanisms. Single-band and two-band models were used to analyze data on the Hall effect and magnetoresistivity. These results indicate electron-hole compensation with a slight predominance of electron charge carriers.


title: Light curve modeling of four short-period W UMa binaries

abstract: We use extensive model grids to estimate the global parameters of four partially-eclipsing W UMa contact binaries near the period cutoff. All four systems consist of K-type main sequence primaries and M-type secondaries that appear undersized and underluminous for their masses because of the energy transfer through the common envelope. Three of the four stars exhibit light curve asymmetry that is explained in terms of magnetic activity and modeled with dark spots. We discuss the reliability of the photometric mass ratios and derived absolute parameters in context of total or partial eclipses and compare them with a sample of totally-eclipsing short-period W UMa systems from the literature.


title: Learning from Stochastic Labels

abstract: Annotating multi-class instances is a crucial task in the field of machine learning. Unfortunately, identifying the correct class label from a long sequence of candidate labels is time-consuming and laborious. To alleviate this problem, we design a novel labeling mechanism called stochastic label. In this setting, stochastic label includes two cases: 1) identify a correct class label from a small number of randomly given labels; 2) annotate the instance with None label when given labels do not contain correct class label. In this paper, we propose a novel suitable approach to learn from these stochastic labels. We obtain an unbiased estimator that utilizes less supervised information in stochastic labels to train a multi-class classifier. Additionally, it is theoretically justifiable by deriving the estimation error bound of the proposed method. Finally, we conduct extensive experiments on widely-used benchmark datasets to validate the superiority of our method by comparing it with existing state-of-the-art methods.


title: Discovery of a spatially and kinematically resolved 55~kpc-scale superbubble inflated by an intermediate redshift non-BAL quasar

abstract: We report on the discovery of a rare case of spatially and kinematically resolved galactic scale outflow at intermediate redshift, based on VLT/MUSE optical integral field spectroscopic observation of the quasar HE 0238$-$1904. This classical non-broad absorption line (non-BAL) quasar at $z=0.631$ remains underexplored in its optical emission lines, though its UV absorption lines are well-studied. We identify a superbubble driven by HE 0238$-$1904 from the emission line morphology, line ratio diagnostics and kinematics, showing a one-sided outflow reaching a projected distance of $R \sim 55$ kpc from the nucleus. The bulk of the ionized gas, with a characteristic mass $M \sim 10^{8}~\rm M_{\odot}$, is blueshifted by $v \approx 700$ km s$^{-1}$ with respect to the quasar systemic velocity. The outflows detected using absorption line and the emission line are likely stratified components of different spatial scale and velocity in the ionized phase outflow. Although feedback in HE 0238$-$1904 is taking place on kpc scale, the kinetic power of the outflow at 55 kpc ($\ll 0.1\% L_{bol}$) implies that it is inadequate to regulate effectively the evolution of the host galaxy at this large scale.


title: Covert Communication in Hybrid Microwave/mmWave A2G Systems with Transmission Mode Selection

abstract: This paper investigates the covert communication in an air-to-ground (A2G) system, where a UAV (Alice) can adopt the omnidirectional microwave (OM) or directional mmWave (DM) transmission mode to transmit covert data to a ground user (Bob) while suffering from the detection of an adversary (Willie). For both the OM and DM modes, we first conduct theoretical analysis to reveal the inherent relationship between the transmit rate/transmit power and basic covert performance metrics in terms of detection error probability (DEP), effective covert rate (ECR), and covert Shannon capacity (CSC). To facilitate the transmission mode selection at Alice, we then explore the optimization of transmit rate and transmit power for ECR/CSC maximization under the OM and DM modes, and further propose a hybrid OM/DM transmission mode which allows the UAV to adaptively select between the OM and DM modes to achieve the maximum ECR and CSC at a given location of UAV. Finally, extensive numerical results are provided to illustrate the covert performances of the concerned A2G system under different transmission modes, and demonstrate that the hybrid OM/DM transmission mode outperforms the pure OM or DM mode in terms of covert performance.


title: A Deep Behavior Path Matching Network for Click-Through Rate Prediction

abstract: User behaviors on an e-commerce app not only contain different kinds of feedback on items but also sometimes imply the cognitive clue of the user's decision-making. For understanding the psychological procedure behind user decisions, we present the behavior path and propose to match the user's current behavior path with historical behavior paths to predict user behaviors on the app. Further, we design a deep neural network for behavior path matching and solve three difficulties in modeling behavior paths: sparsity, noise interference, and accurate matching of behavior paths. In particular, we leverage contrastive learning to augment user behavior paths, provide behavior path self-activation to alleviate the effect of noise, and adopt a two-level matching mechanism to identify the most appropriate candidate. Our model shows excellent performance on two real-world datasets, outperforming the state-of-the-art CTR model. Moreover, our model has been deployed on the Meituan food delivery platform and has accumulated 1.6% improvement in CTR and 1.8% improvement in advertising revenue.


title: Specular electron focusing between gate-defined quantum point contacts in bilayer graphene

abstract: We report on multiterminal measurements in a ballistic bilayer graphene (BLG) channel where multiple spin and valley-degenerate quantum point contacts (QPCs) are defined by electrostatic gating. By patterning QPCs of different shapes and along different crystallographic directions, we study the effect of size quantization and trigonal warping on the transverse electron focusing (TEF) spectra. Our TEF spectra show eight clear peaks with comparable amplitude and weak signatures of quantum interference at the lowest temperature, indicating that reflections at the gate-defined edges are specular and transport is phase coherent. The temperature dependence of the scattering rate indicates that electron-electron interactions play a dominant role in the charge relaxation process for electron doping and temperatures below 100 K. The achievement of specular reflection, which is expected to preserve the pseudospin information of the electron jets, is promising for the realization of ballistic interconnects for new valleytronic devices.


title: Generalized juggling patterns, quiver Grassmannians and affine flag varieties

abstract: The goal of this paper is to clarify the connection between certain structures from the theory of totally nonnegative Grassmannians, quiver Grassmannians for cyclic quivers and the theory of local models of Shimura varieties. More precisely, we generalize the construction from our previous paper relating the combinatorics and geometry of quiver Grassmanians to that of the totally nonnegative Grassmannians. The varieties we are interested in serve as realizations of local models of Shimura varieties. We exploit quiver representation techniques to study the quiver Grassmannians of interest and, in particular, to describe explicitly embeddings into affine flag varieties which allow us to realize our quiver Grassmannians as a union of Schubert varieties therein.


title: Constructions of Urysohn universal ultrametric spaces

abstract: In this paper, we give new constructions of Urysohn universal ultrametric spaces. We first characterize a Urysohn universal ultrametric subspace of the space of all continuous functions whose images contain the zero, from a zero-dimensional compact Hausdorff space without isolated points into the space of non-negative real numbers equipped with the nearly discrete topology. As a consequence, the whole function space is Urysohn universal, which can be considered as a non-Archimedean analog of Banach--Mazur theorem. As a more application, we prove that the space of all continuous pseudo-ultrametrics on a zero-dimensional compact Hausdorff space with an accumulation point is a Urysohn universal ultrametric space. This result can be considered as a variant of Wan's construction of Urysohn universal ultrametric space via the Gromov--Hausdorff ultrametric space.


title: Uniqueness and homogeneity of non-separable Urysohn universal ultrametric spaces

abstract: Urysohn constructed a separable complete universal metric space homogeneous for all finite subspaces, which is today called the Urysohn universal metric space. Some authors have recently investigated an ultrametric analogue of this space. The isometry problem of such ultrametric spaces is our main subject in this paper. We first introduce the new notion of petaloid ultrametric spaces, which is intended to be a standard class of non-separable Urysohn universal ultrametric spaces. Next we prove that all petaloid spaces are isometric to each other and homogeneous for all finite subspaces (and compact subspaces). Moreover, we show that the following spaces are petaloid, and hence they are isometric to each other and homogeneous: (1) The space of all continuous functions, whose images contain the zero, from the Cantor set into the space of non-negative real numbers equipped with the nearly discrete topology, (2) the space of all continuous ultrametrics on a zero-dimensional infinite compact metrizable space, (3) the non-Archimedean Gromov--Hausdorff space, and (4) the space of all maps from the set of non-negative real numbers into the set of natural numbers whose supports are finite or decreasing sequences convergent to the zero.


title: Topological invariant of multilayer Haldane models with irregular stackings

abstract: We study multilayer Haldane models with irregular type of stacking, considering the nearest interlayer hopping. We prove that the value of the topological invariant is equal to the number of layers times the value of the topological invariant of monolayer Haldane model, regardless of stacking type, and interlayer hoppings do not induce gap closing and phase transitions.


title: Aspect-ratio-dependent void formation in active rhomboidal and elliptical particle systems

abstract: We execute a numerical simulation on active nematics with particles interacting by an excluded volume effect. The systems with rhomboidal particles and that with elliptical particles are considered in order to investigate the effect of the direct contact of particles. In our simulation, the void regions, where the local number density is almost zero, appear in both systems when the aspect ratio of the particles is high. We focused on the relationship between the void regions and the particle orientation of the bulk. The particle number density, particle orientation, topological defects, and void regions are analyzed for different aspect ratios in both systems. The systems with rhomboidal particles have characteristic void sizes, which increase with an increase in the aspect ratio. In contrast, the distribution of the void-region size in the systems with elliptical particles is broad. The present results suggest that the void size in the systems with rhomboidal particles is determined by the correlation length of the particle orientational field around the void regions, while that might be determined by the system size in the systems with elliptical particles.


title: Structure theorem for mod $p^m$ singular Siegel modular forms

abstract: We prove that all mod $p^m$ singular forms of level $N$, degree $n+r$, and $p$-rank $r$ with $n\ge r$ are congruent mod $p^m$ to linear combinations of theta series of degree $r$ attached to quadratic forms of some level. Moreover, we prove that, the levels of theta series are of the form ``$p\mbox{-power}\times N$''. Additionally, in some cases of mod $p$ singular forms with smallest possible weight, we prove that the levels of theta series should be $p$.


title: Particles on Demand method: theoretical analysis, simplification techniques and model extensions

abstract: The Particles on Demand method [B. Dorschner, F. B\"{o}sch and I. V. Karlin, {\it Phys. Rev. Lett.} {\bf 121}, 130602 (2018)] was recently formulated with a conservative finite volume discretization and validated against challenging benchmarks. In this work, we rigorously analyze the properties of the reference frame transformation and its implications on the accuracy of the model. Based on these considerations, we propose strategies to boost the efficiency of the scheme and to reduce the computational cost. Additionally, we generalize the model such that it includes a tunable Prandlt number via quasi-equilibrium relaxation. Finally, we adapt concepts from the multi-scale semi-Lagrangian lattice Boltzmann formulation to the proposed framework, further improving the potential and the operating range of the kinetic model. Numerical simulations of high Mach compressible flows demonstrate excellent accuracy and stability of the model over a wide range of conditions.


title: Pinning in the extended Lugiato-Lefever equation

abstract: We consider a variant of the Lugiato-Lefever equation (LLE), which is a nonlinear Schr\"odinger equation on a one-dimensional torus with forcing and damping, to which we add a first-order derivative term with a potential $\epsilon V(x)$. The potential breaks the translation invariance of LLE. Depending on the existence of zeroes of the effective potential $V_\text{eff}$, which is a suitably weighted and integrated version of $V$, we show that stationary solutions from $\epsilon=0$ can be continued locally into the range $\epsilon\not =0$. Moreover, the extremal points of the $\epsilon$-continued solutions are located near zeros of $V_\text{eff}$. We therefore call this phenomenon \emph{pinning} of stationary solutions. If we assume additionally that the starting stationary solution at $\epsilon=0$ is spectrally stable with the simple zero eigenvalue due to translation invariance being the only eigenvalue on the imaginary axis, we can prove asymptotic stability or instability of its $\epsilon$-continuation depending on the sign of $V_\text{eff}'$ at the zero of $V_\text{eff}$ and the sign of $\epsilon$. The variant of the LLE arises in the description of optical frequency combs in a Kerr nonlinear ring-shaped microresonator which is pumped by two different continuous monochromatic light sources of different frequencies and different powers. Our analytical findings are illustrated by numerical simulations.


title: Boundedness of Fourier integral operators on classical function spaces

abstract: We investigate the global boundedness of Fourier integral operators with amplitudes in the general H\"ormander classes $S^{m}_{\rho, \delta}(\mathbb{R}^n)$, $\rho, \delta\in [0,1]$ and non-degenerate phase functions of arbitrary rank $\kappa\in \{0,1,\dots, n-1\}$ on Besov-Lipschitz $B^{s}_{p,q}(\mathbb{R}^n)$ and Triebel-Lizorkin $F^{s}_{p,q}(\mathbb{R}^n)$ of order $s$ and $0<p\leq\infty$, $0<q\leq\infty$. The results that are obtained are all up to the end-point and sharp and are also applied to the regularity of Klein-Gordon-type oscillatory integrals in the aforementioned function spaces.


title: Low-Frequency Stabilization of Dielectric Simulation Problems with Conductors and Insulators

abstract: When simulating resistive-capacitive circuits or electroquasistatic problems where conductors and insulators coexist, one observes that large time steps or low frequencies lead to numerical instabilities, which are related to the condition number of the system matrix. Here, we propose several stable formulations by scaling the equation systems. This enables a reliable calculation of solutions for very low frequencies (even for the static case), or large time steps. Numerical experiments underline the findings.


title: Suppression of the antiferromagnetic order by Zn doping in a possible Kitaev material Na$_2$Co$_2$TeO$_6$

abstract: Very recently, a 3$d$ based honeycomb cobaltate Na$_2$Co$_2$TeO$_6$ has garnered tremendous attention due to the proposed proximity to the Kitaev spin-liquid state as its 4$d$/5$d$ counterparts. Here, we use Zn to substitute Co in a broad range and perform systematic studies on Na$_2$Co$_{2-x}$Zn$_x$TeO$_6$ by structural, magnetic, and thermodynamic measurements, and track the doping evolution of its magnetic ground states. Due to the extremely close radii of Zn$^{2+}$ and high-spin Co$^{2+}$ ions, the substitution can be easily achieved. X-ray diffractions reveal no structural transition but only minor changes on the lattice parameter $c$ over a wide substitution range $0 \leq x \leq 1.5$. Magnetic susceptibility and specific heat measurements both suggest an antiferromagnetic ground state which is gradually suppressed with doping. It can survive with $x$ up to $\sim1.0$. Then it evolves into a spin-glass phase with short-range order that is rapidly supplanted by a magnetically disordered state when $x \geq 1.3$. By summarizing all these data, we construct a magnetic phase diagram of Na$_2$Co$_{2-x}$Zn$_x$TeO$_6$. Our results demonstrate that the Zn doping can effectively suppress the magnetic order and induce a possibe quantum paramagnetic state. These may serve as a platform to investigate the Kitaev physics in this system.


title: Multi-wavelength study of NGC 1365: The obscured active nucleus and off-nuclear compact X-ray sources

abstract: We present a multi-wavelength study of the active nucleus and the off-nuclear X-ray sources in the nearby spiral galaxy, NGC 1365 using three simultaneous UV/X-ray observations by AstroSat over a two months period and archival IR observations performed with Spitzer and Herschel. Utilising the data from the Soft X-ray Telescope (SXT) on-board AstroSat, we find spectral variability mainly caused by the variation in the X-ray column density, (N$_H$ $\sim$ 10$^{22}$ - 10$^{23}$ cm$^{-2}$). With the accurate spatial resolution of the UVIT onboard AstroSat, we separate the intrinsic AGN flux from the host galaxy emission and then correct for the Galactic and the internal reddening. We detect no significant variation in the NUV emission over the observation period. The AGN in FUV band is undetectable due to heavy intrinsic extinction. Further, the multi-wavelength IR/UV/X-ray AGN SED reveals that the AGN is in a low luminosity phase with accretion rate $\sim$ 0.01 L$_{Edd}$. The steady UV emission and strong X-ray absorption variability suggest that the obscuring clouds are likely compact and affect the compact X-ray source only and do not possibly cover the extended UV emitting region. In addition, the UVIT is able to resolve two bright spots at a radius of 7" ($\sim$ 6.3 Kpc) from the central nucleus in the South-West (SW) direction. In the UVIT image of the entire galaxy, we identify UV counterparts to four Chandra identified bright X-ray sources. One well-known ultra-luminous X-ray source (ULX) NGC 1365 X2 is identified with its UV counterpart at 86" from the nucleus in the north-east (NE) direction from the active nucleus.


title: Accelerated First-Order Optimization under Nonlinear Constraints

abstract: We exploit analogies between first-order algorithms for constrained optimization and non-smooth dynamical systems to design a new class of accelerated first-order algorithms for constrained optimization. Unlike Frank-Wolfe or projected gradients, these algorithms avoid optimization over the entire feasible set at each iteration. We prove convergence to stationary points even in a nonconvex setting and we derive accelerated rates for the convex setting both in continuous time, as well as in discrete time. An important property of these algorithms is that constraints are expressed in terms of velocities instead of positions, which naturally leads to sparse, local and convex approximations of the feasible set (even if the feasible set is nonconvex). Thus, the complexity tends to grow mildly in the number of decision variables and in the number of constraints, which makes the algorithms suitable for machine learning applications. We apply our algorithms to a compressed sensing and a sparse regression problem, showing that we can treat nonconvex $\ell^p$ constraints ($p<1$) efficiently, while recovering state-of-the-art performance for $p=1$.


title: Remarks on higher Schwarzians

abstract: The Schwarzian derivative has recently received renewed attention in connection with the study of the Sachdev-Ye-Kitaev model. In mathematics literature, various higher order generalizations of the Schwarzian derivative are known due to Aharonov, Bertilsson, and Schippers. Physical applications of the higher Schwarzian derivatives have not yet been discussed in any detail. In this work, we link Bertilsson's variant to the l-conformal Galilei group, as well as discuss some of its interesting peculiarities. These include a recurrence relation, which allows one to construct the higher Schwarzians iteratively, a composition law, and symmetry transformations.


title: Quantum defects from single surface exhibit strong mutual interactions

abstract: Two-level system (TLS) defects constitute a major decoherence source of quantum information science, but they are generally less understood at material interfaces than in deposited films. Here we study surface TLSs at the metal-air interface, by probing them using a quasi-uniform field within vacuum-gap (VG) capacitors of resonators. The VG capacitor has a nano-gap which creates an order-of-magnitude larger contribution from the metal-air interface than typical resonators used in circuit QED. We measure three phenomena and find qualitative agreement with an interacting TLS model, where near-resonant TLSs experience substantial frequency jitter from the state switching of far-detuned low-frequency TLSs. First, we find that the loss in all of our VG resonators is weakly or logarithmically power dependent, in contrast to data from deposited dielectric films. Second, we add a saturation tone with power $P_{in}$ to a transmission measurement and obtain the TLS Rabi frequency $\Omega_{0}$. These data show a substantially weaker $P_{in}$ dependence of $\Omega_{0}$ than the prediction from the standard non-interacting TLS model. Lastly, we increase the temperature and find an increased TLS jitter rate and dephasing rate from power-dependent loss and phase noise measurements, respectively. We also anneal samples, which lowers the low-frequency TLS density and jitter rate, but the single-photon loss is found to be unchanged. The results are qualitatively consistent with a fast-switching interacting-TLS model and they contrast the standard model of TLSs which describes TLSs independently.


title: Development of deep biological ages aware of morbidity and mortality based on unsupervised and semi-supervised deep learning approaches

abstract: Background: While deep learning technology, which has the capability of obtaining latent representations based on large-scale data, can be a potential solution for the discovery of a novel aging biomarker, existing deep learning methods for biological age estimation usually depend on chronological ages and lack of consideration of mortality and morbidity that are the most significant outcomes of aging. Methods: This paper proposes a novel deep learning model to learn latent representations of biological aging in regard to subjects' morbidity and mortality. The model utilizes health check-up data in addition to morbidity and mortality information to learn the complex relationships between aging and measured clinical attributes. Findings: The proposed model is evaluated on a large dataset of general populations compared with KDM and other learning-based models. Results demonstrate that biological ages obtained by the proposed model have superior discriminability of subjects' morbidity and mortality.


title: Six Newly Discovered Eclipsing Binary Systems in the TESS field

abstract: We present the first detailed investigation of six eclipsing binary systems in the TESS field. The TESS light curves of the targets are analysed by determining the initial effective temperatures via SED fits. The absolute parameters are derived and the systems are compared to well-known binaries of the same type. Results show that CD-58~791, CD-62~1257 and TYC~9356-355-1 are detached binary systems. CD-54~942 and UCAC4~136-007295 are contact binaries while TYC~8508-1413-1 is a semidetached system.


title: An Evaluation of Persian-English Machine Translation Datasets with Transformers

abstract: Nowadays, many researchers are focusing their attention on the subject of machine translation (MT). However, Persian machine translation has remained unexplored despite a vast amount of research being conducted in languages with high resources, such as English. Moreover, while a substantial amount of research has been undertaken in statistical machine translation for some datasets in Persian, there is currently no standard baseline for transformer-based text2text models on each corpus. This study collected and analysed the most popular and valuable parallel corpora, which were used for Persian-English translation. Furthermore, we fine-tuned and evaluated two state-of-the-art attention-based seq2seq models on each dataset separately (48 results). We hope this paper will assist researchers in comparing their Persian to English and vice versa machine translation results to a standard baseline.


title: First measurements of periodicities and anisotropies of cosmic ray flux observed with a water-Cherenkov detector at the Marambio Antarctic base

abstract: A new water-Cherenkov radiation detector, located at the Argentine Marambio Antarctic Base (64.24S-56.62W), has been monitoring the variability of galactic cosmic ray (GCR) flux since 2019. One of the main aims is to provide experimental data necessary to study interplanetary transport of GCRs during transient events at different space/time scales. In this paper we present the detector and analyze observations made during one full year. After the analysis and correction of the GCR flux variability due to the atmospheric conditions (pressure and temperature), a study of the periodicities is performed in order to analyze modulations due to heliospheric phenomena. We can observe two periods: (a) 1 day, associated with the Earth's rotation combined with the spatial anisotropy of the GCR flux; and (b) $\sim$ 30 days due to solar impact of stable solar structures combined with the rotation of the Sun. From a superposed epoch analysis, and considering the geomagnetic effects, the mean diurnal amplitude is $\sim$ 0.08% and the maximum flux is observed in $\sim$ 15 hr local time (LT) direction in the interplanetary space. In such a way, we determine the capability of Neurus to observe anisotropies and other interplanetary modulations on the GCR flux arriving at the Earth.