title: Saturation for the $3$-uniform loose $3$-cycle

abstract: Let $F$ and $H$ be $k$-uniform hypergraphs. We say $H$ is $F$-saturated if $H$ does not contain a subgraph isomorphic to $F$, but $H+e$ does for any hyperedge $e\not\in E(H)$. The saturation number of $F$, denoted $\mathrm{sat}_k(n,F)$, is the minimum number of edges in a $F$-saturated $k$-uniform hypergraph $H$ on $n$ vertices. Let $C_3^{(3)}$ denote the $3$-uniform loose cycle on $3$ edges. In this work, we prove that \[ \left(\frac{4}3+o(1)\right)n\leq \mathrm{sat}_3(n,C_3^{(3)})\leq \frac{3}2n+O(1). \] This is the first non-trivial result on the saturation number for a fixed short hypergraph cycle.


title: Asymptotics of Cointegration Tests for High-Dimensional VAR($k$)

abstract: The paper studies nonstationary high-dimensional vector autoregressions of order $k$, VAR($k$). Additional deterministic terms such as trend or seasonality are allowed. The number of time periods, $T$, and the number of coordinates, $N$, are assumed to be large and of the same order. Under this regime the first-order asymptotics of the Johansen likelihood ratio (LR), Pillai-Bartlett, and Hotelling-Lawley tests for cointegration are derived: the test statistics converge to nonrandom integrals. For more refined analysis, the paper proposes and analyzes a modification of the Johansen test. The new test for the absence of cointegration converges to the partial sum of the Airy$_1$ point process. Supporting Monte Carlo simulations indicate that the same behavior persists universally in many situations beyond those considered in our theorems. The paper presents empirical implementations of the approach for the analysis of S$\&$P$100$ stocks and of cryptocurrencies. The latter example has a strong presence of multiple cointegrating relationships, while the results for the former are consistent with the null of no cointegration.


title: A compactness theorem for hyperkaehler 4-manifolds with boundary

abstract: In this paper, we study the compactness of a boundary value problem for hyperkaehler 4-manifolds. We show that under certain topological conditions and the positive mean curvature condition on the boundary, a sequence of hyperkaehler triples converges smoothly up to diffeomorphisms if and only if their restrictions to the boundary converge smoothly up to diffeomorphisms. We also generalize this result to torsion-free hypersymplectic triples.


title: L2C2: Locally Lipschitz Continuous Constraint towards Stable and Smooth Reinforcement Learning

abstract: This paper proposes a new regularization technique for reinforcement learning (RL) towards making policy and value functions smooth and stable. RL is known for the instability of the learning process and the sensitivity of the acquired policy to noise. Several methods have been proposed to resolve these problems, and in summary, the smoothness of policy and value functions learned mainly in RL contributes to these problems. However, if these functions are extremely smooth, their expressiveness would be lost, resulting in not obtaining the global optimal solution. This paper therefore considers RL under local Lipschitz continuity constraint, so-called L2C2. By designing the spatio-temporal locally compact space for L2C2 from the state transition at each time step, the moderate smoothness can be achieved without loss of expressiveness. Numerical noisy simulations verified that the proposed L2C2 outperforms the task performance while smoothing out the robot action generated from the learned policy.


title: NICER observations of the evidence of Poynting-Robertson drag and disk reflection during type I X-ray bursts from 4U 1636$-$536

abstract: Type I X-ray bursts are the result of an unstable thermonuclear burning of accreting matter on the neutron star (NS) surface. The quick release of energetic X-ray photons during such bursts interacts with the surrounding accretion disk, which raises the accretion rate due to Poynting-Robertson drag and, thus, a fraction of the burst emission is reflected. We analyzed two photospheric radius expansion bursts in the NS low-mass X-ray binary 4U 1636--536 that took place in 2017, using data from Neutron star Interior Composition Explorer. The time-resolved burst spectra showed clear deviations from a blackbody model. The spectral fitting can be significantly improved by introducing either the enhanced persistent emission (the $f_a$ model) or the reflection from the accretion disk (the \texttt{relxillNS} model). The $f_a$ model provides a higher blackbody temperature and higher burst flux compared with the \texttt{relxillNS} model. The peak fluxes of two bursts from the $f_a$ model, $4.36\times10^{-8}~\mathrm{erg~cm^{-2}~s^{-1}}$ and $9.10\times10^{-8}~\mathrm{erg~cm^{-2}~s^{-1}}$, are slightly higher than the Eddington limits of mixed hydrogen-helium and pure helium bursts from previous observations, respectively. When the disk reflections have been taken into account simultaneously, the peak fluxes are lower to match the preferred values. We find evidence to support the finding that both the Poynting-Robertson drag and disk reflection have been appeared during these two X-ray bursts. Moreover, the disk reflection may contribute $\sim20-30\%$ of the total burst emissions.


title: Optimal range of Haar martingale transforms and its applications

abstract: Let $(\mathcal{F}_n)_{n\ge 0}$ be the standard dyadic filtration on $[0,1]$. Let $\mathbb{E}_{\mathcal{F}_n}$ be the conditional expectation from $ L_1=L_1[0,1]$ onto $\mathcal{F} _n$, $n\ge 0$, and let $\mathbb{E}_{\mathcal{F} _{-1}} =0$. We present the sharp estimate for the distribution function of the martingale transform $T$ defined by \begin{align*} Tf=\sum_{m=0}^\infty \left( \mathbb{E}_{\mathcal{F}_{2m}} f-\mathbb{E}_{\mathcal{F}_{2m-1}}f \right), ~f\in L_1, \end{align*} in terms of the classical Calder\'{o}n operator. As an application, for a given symmetric function space $E$ on $[0,1]$, we identify the symmetric space $\mathcal{S}_E$, the optimal Banach symmetric range of martingale transforms/Haar basis projections acting on $E$.


title: New Penalized Stochastic Gradient Methods for Linearly Constrained Strongly Convex Optimization

abstract: For minimizing a strongly convex objective function subject to linear inequality constraints, we consider a penalty approach that allows one to utilize stochastic methods for problems with a large number of constraints and/or objective function terms. We provide upper bounds on the distance between the solutions to the original constrained problem and the penalty reformulations, guaranteeing the convergence of the proposed approach. We give a nested accelerated stochastic gradient method and propose a novel way for updating the smoothness parameter of the penalty function and the step-size. The proposed algorithm requires at most $\tilde O(1/\sqrt{\epsilon})$ expected stochastic gradient iterations to produce a solution within an expected distance of $\epsilon$ to the optimal solution of the original problem, which is the best complexity for this problem class to the best of our knowledge. We also show how to query an approximate dual solution after stochastically solving the penalty reformulations, leading to results on the convergence of the duality gap. Moreover, the nested structure of the algorithm and upper bounds on the distance to the optimal solutions allows one to safely eliminate constraints that are inactive at an optimal solution throughout the algorithm, which leads to improved complexity results. Finally, we present computational results that demonstrate the effectiveness and robustness of our algorithm.


title: On Tracking Dialogue State by Inheriting Slot Values in Mentioned Slot Pools

abstract: Dialogue state tracking (DST) is a component of the task-oriented dialogue system. It is responsible for extracting and managing slot values according to dialogue utterances, where each slot represents an essential part of the information to accomplish a task, and slot value is updated recurrently in each dialogue turn. However, many DST models cannot update slot values appropriately. These models may repeatedly inherit wrong slot values extracted in previous turns, resulting in the fail of the entire DST task. They cannot update indirectly mentioned slots well, either. This study designed a model with a mentioned slot pool (MSP) to tackle the update problem. The MSP is a slot-specific memory that records all mentioned slot values that may be inherited, and our model updates slot values according to the MSP and the dialogue context. Our model rejects inheriting the previous slot value when it predicates the value is wrong. Then, it re-extracts the slot value from the current dialogue context. As the contextual information accumulates with the dialogue progress, the new value is more likely to be correct. It also can track the indirectly mentioned slot by picking a value from the MSP. Experimental results showed our model reached state-of-the-art DST performance on MultiWOZ 2.1 and 2.2 datasets.


title: Phase-insensitive versus phase-sensitive ultrasound absorption tomography in the frequency domain

abstract: The sensitivity of phase-sensitive detectors, such as piezoelectric detectors, becomes increasingly directional as the detector element size increases. In contrast, pyroelectric sensors, which are phase-insensitive, retain their omni-directionality even for large element sizes, although they have significantly poorer temporal resolution. This study uses numerical models to examine whether phase-insensitive detectors can be used advantageously in ultrasound tomography, specifically absorption tomography, when the number of detectors is sparse. We present measurement models for phase-sensitive and phase-insensitive sensors and compare the quality of the absorption reconstructions between these sensor types based on image contrast metrics. We perform the inversion using synthetic data with a Jacobian-based linearised matrix inversion approach.


title: Detecting Gravitational-waves from Extreme Mass Ratio Inspirals using Convolutional Neural Networks

abstract: Extreme mass ratio inspirals (EMRIs) are among the most interesting gravitational wave (GW) sources for space-borne GW detectors. However, successful GW data analysis remains challenging due to many issues, ranging from the difficulty of modeling accurate waveforms, to the impractically large template bank required by the traditional matched filtering search method. In this work, we introduce a proof-of-principle approach for EMRI detection based on convolutional neural networks (CNNs). We demonstrate the performance with simulated EMRI signals buried in Gaussian noise. We show that over a wide range of physical parameters, the network is effective for EMRI systems with a signal-to-noise ratio larger than 50, and the performance is most strongly related to the signal-to-noise ratio. The method also shows good generalization ability towards different waveform models. Our study reveals the potential applicability of machine learning technology like CNNs towards more realistic EMRI data analysis.


title: Disentangling the parameter space: The role of planet multiplicity in triggering dynamical instabilities on planetary systems around white dwarfs

abstract: Planets orbiting intermediate and low-mass stars are in jeopardy as their stellar hosts evolve to white dwarfs (WDs) because the dynamics of the planetary system changes due to the increase of the planet:star mass ratio after stellar mass-loss. In order to understand how the planet multiplicity affects the dynamical stability of post-main sequence (MS) systems, we perform thousands of N-body simulations involving planetary multiplicity as the variable and with a controlled physical and orbital parameter space: equal-mass planets; the same orbital spacing between adjacent planet's pairs; and orbits with small eccentricities and inclinations. We evolve the host star from the MS to the WD phase following the system dynamics for 10 Gyr. We find that the fraction of dynamically active simulations on the WD phase for two-planet systems is $10.2^{+1.2}_{-1.0}$-$25.2^{+2.5}_{-2.2}$ $\%$ and increases to $33.6^{+2.3}_{-2.2}$-$74.1^{+3.7}_{-4.6}$ $\%$ for the six-planet systems, where the ranges cover different ranges of initial orbital separations. Our simulations show that the more planets the system has, the more systems become unstable when the star becomes a WD, regardless of the planet masses and range of separations. Additional results evince that simulations with low-mass planets (1, 10 $\mathrm{M_\oplus}$) lose at most two planets, have a large fraction of systems undergoing orbit crossing without planet losses, and are dynamically active for Gyr time-scales on the WD's cooling track. On the other hand, systems with high-mass planets (100, 1000 $\mathrm{M_\oplus}$) lose up to five planets, preferably by ejections, and become unstable in the first few hundred Myr after the formation of the WD.


title: Effective spin models of Kerr-nonlinear parametric oscillators for quantum annealing

abstract: A method of quantum annealing (QA) using Kerr-nonlinear parametric oscillators (KPOs) was proposed. This method is described by bosonic operators and has different characteristics from QA based on the transverse-field Ising model. As the first step to describe this method in the conventional framework of QA, we propose effective spin models of KPOs. The spin models are obtained via a variant of the Holstein-Primakoff transformation and are described by spin-$s$ operators. The terms for detuning, coherent driving, parametric driving, and the Kerr effect are mapped to the transverse field, longitudinal field, nonlinear terms for the z- and x-components of spins, respectively. By analyzing the spin models corresponding to KPOs in several settings, we demonstrate that the present spin models for a rather large $s$ and tuned parameters qualitatively reproduce behavior of KPOs.


title: Convergence analysis of the harmonic $B_z$ algorithm with single injection current in MREIT

abstract: Magnetic resonance electrical impedance tomography (MREIT) aims to recover the electrical conductivity distribution of an object using partial information of magnetic flux densities inside the tissue which can be measured using an MRI scanner, with the advantage that a higher spatial resolution of conductivity image can be provided than existing EIT techniques involving surface measurements. Traditional MREIT reconstruction algorithms use two data sets obtained with two linearly independent injected currents. However, injection of two currents is often not possible in applications such as transcranial electrical stimulation. Recently, we proposed an iterative conductivity reconstruction algorithm called the single current harmonic $B_z$ algorithm that demonstrated satisfactory performance in numerical and phantom tests. In this paper, we provide a rigorous mathematical analysis of the convergence of the iterative sequence for realizing this algorithm. We prove that, applying some mild conditions on the exact conductivity, the iterative sequence converges to the true solution within an explicit error bound. Such theoretical results substantiate the reasonability and efficiency of the proposed algorithm. We also provide more numerical evidence to validate these theoretical results.


title: On the robustness of the velocity anisotropy parameter in probing the stellar kinematics in Milky Way like galaxies: Take away from TNG50 simulation

abstract: We analyze the velocity anisotropy of stars in real and energy space for a sample of Milky Way-like galaxies in the TNG50 simulation. We employ different selection criteria, including spatial, kinematic and metallicity cuts, and make three halo classes ($\mathcal{A}$-$\mathcal{C}$) which show mild-to-strong sensitivity to different selections. The above classes cover 48%, 16% and 36% of halos, respectively. We analyze the $\beta$ radial profiles and divide them into either monotonically increasing radial profiles or ones with peaks and troughs. We demonstrate that halos with monotonically increasing $\beta$ profiles are mostly from class $\mathcal{A}$, whilst those with peaks/troughs are part of classes $\mathcal{B}$-$\mathcal{C}$. This means that care must be taken as the observationally reported peaks/troughs might be a consequence of different selection criteria. We infer the anisotropy parameter $\beta$ energy space and compare that against the $\beta$ radial profile. It is seen that 65% of halos with very mild sensitivity to different selections in real space, are those for which the $\beta$ radial and energy profiles are closely related. Consequently, we propose that comparing the $\beta$ radial and energy profiles might be a novel way to examine the sensitivity to different selection criteria and thus examining the robustness of the anisotropy parameter in tracing stellar kinematics. We compare simulated $\beta$ radial profiles against various observations and demonstrate that, in most cases, the model diversity is comparable with the error bars from different observations, meaning that the TNG50 models are in good overall agreement with observations.

categories: astro-ph.GA astro-ph.CO astro-ph.HE astro-ph.SR


title: Snowmass White Paper: Bootstrapping String Theory

abstract: We discuss progress and prospects in the application of bootstrap methods to string theory.


title: Equatorial magnetoplasma waves

abstract: Due to its rotation, Earth traps a few equatorial ocean and atmospheric waves, including Kelvin, Yanai, Rossby, and Poincare modes. It has been recently demonstrated that the mathematical origin of equatorial waves is intricately related to the nontrivial topology of hydrodynamic equations describing oceans or the atmosphere. In the present work, we consider plasma oscillations supported by a two-dimensional electron gas confined at the surface of a sphere or a cylinder. We argue that in the presence of a uniform magnetic field, these systems host a set of equatorial magnetoplasma waves that are counterparts to the equatorial waves trapped by Earth. For a spherical geometry, the equatorial modes are well developed only if their penetration length is smaller than the radius of the sphere. For a cylindrical geometry, the spectrum of equatorial modes is weakly dependent on the cylinder radius and overcomes finite-size effects. We argue that this exceptional robustness can be explained by destructive interference effects. We discuss possible experimental setups, including grains and rods composed of topological insulators (e.g., Bi2Se3) or metal-coated dielectrics (e.g., Au2S).


title: OLIVE: Oblivious Federated Learning on Trusted Execution Environment against the risk of sparsification

abstract: Combining Federated Learning (FL) with a Trusted Execution Environment (TEE) is a promising approach for realizing privacy-preserving FL, which has garnered significant academic attention in recent years. Implementing the TEE on the server side enables each round of FL to proceed without exposing the client's gradient information to untrusted servers. This addresses usability gaps in existing secure aggregation schemes as well as utility gaps in differentially private FL. However, to address the issue using a TEE, the vulnerabilities of server-side TEEs need to be considered -- this has not been sufficiently investigated in the context of FL. The main technical contribution of this study is the analysis of the vulnerabilities of TEE in FL and the defense. First, we theoretically analyze the leakage of memory access patterns, revealing the risk of sparsified gradients, which are commonly used in FL to enhance communication efficiency and model accuracy. Second, we devise an inference attack to link memory access patterns to sensitive information in the training dataset. Finally, we propose an oblivious yet efficient aggregation algorithm to prevent memory access pattern leakage. Our experiments on real-world data demonstrate that the proposed method functions efficiently in practical scales.


title: SSNbayes: An R package for Bayesian spatio-temporal modelling on stream networks

abstract: Spatio-temporal models are widely used in many research areas from ecology to epidemiology. However, most covariance functions describe spatial relationships based on Euclidean distance only. In this paper, we introduce the R package SSNbayes for fitting Bayesian spatio-temporal models and making predictions on branching stream networks. SSNbayes provides a linear regression framework with multiple options for incorporating spatial and temporal autocorrelation. Spatial dependence is captured using stream distance and flow connectivity while temporal autocorrelation is modelled using vector autoregression approaches. SSNbayes provides the functionality to make predictions across the whole network, compute exceedance probabilities and other probabilistic estimates such as the proportion of suitable habitat. We illustrate the functionality of the package using a stream temperature dataset collected in Idaho, USA.


title: Efficient Distributed Computations in Anonymous Dynamic Congested Systems with Opportunistic Connectivity

abstract: In this work we address the question of efficiency of distributed computing in anonymous, congested and highly dynamic and not-always-connected networks/systems. More precisely, the system consists of an unknown number of anonymous nodes with congestion on links and local computation. Links can change arbitrarily from round to round, with only limitation that the union of any T consecutive networks must form a temporarily connected (multi-)graph on all nodes (knowledge of T is the only information the nodes require, otherwise the communication would not be feasible). Nodes do not have any IDs, only some number l of them have a bit distinguishing them from nodes without such a bit. In each round a node can send and receive messages from its current neighbors. Links and nodes are congested, in the sense that the length of messages and local cache memory for local computation is (asymptotically) logarithmic. All-to-all communication is a fundamental principle in distributed computing - it assumes that each node has an input message to be delivered to all other nodes. Without loss of generality, the size of each input message is logarithmic to fit in the link and node congestion assumption; otherwise, they could be split in logarithmic batches and considered one-by-one. Because of anonymity, each node needs to receive only a set of all input messages, each accompanied by a number of initiating nodes (message multiplicity). We prove that this task can be done in time polynomial in the (initially unknown) number of nodes n and in the lower bound on the isoperimetric numbers of dynamically evolving graphs. This allows to efficiently emulate a popular Congested Clique model on top of Anonymous Dynamic Congested Systems (ADCS) with Opportunistic Connectivity, even if the number of nodes may arbitrarily change in the beginning of emulation.


title: Validation and Improvement of the Pan-STARRS Photometric Calibration with the Stellar Color Regression Method

abstract: As one of the best ground-based photometric dataset, Pan-STARRS1 (PS1) has been widely used as the reference to calibrate other surveys. In this work, we present an independent validation and re-calibration of the PS1 photometry using spectroscopic data from the LAMOST DR7 and photometric data from the corrected Gaia EDR3 with the Stellar Color Regression (SCR) method. Using per band typically a total of 1.5 million LAMOST-PS1-Gaia stars as standards, we show that the PS1 photometric calibration precisions in the $grizy$ filters are around $4\sim 5$ mmag when averaged over $20'$ regions. However, significant large- and small-scale spatial variation of magnitude offset, up to over 1 per cent, probably caused by the calibration errors in the PS1, are found for all the $grizy$ filters. The calibration errors in different filters are un-correlated, and are slightly larger for the $g$ and $y$ filters. We also detect moderate magnitude-dependent errors (0.005, 0.005, 0.005, 0.004, 0.003 mag per magnitude in the 14 -- 17 magnitude range for the $grizy$ filters, respectively) in the PS1 photometry by comparing with the Gaia EDR3 and other catalogs. The errors are likely caused by the systematic uncertainties in the PSF magnitudes. We provide two-dimensional maps to correct for such magnitude offsets in the LAMOST footprint at different spatial resolutions from $20'$ to $160'$. The results demonstrate the power of the SCR method in improving the calibration precision of wide-field surveys when combined with the LAMOST spectroscopy and Gaia photometry.


title: Documentation based Semantic-Aware Log Parsing

abstract: With the recent advances of deep learning techniques, there are rapidly growing interests in applying machine learning to log data. As a fundamental part of log analytics, accurate log parsing that transforms raw logs to structured events is critical for subsequent machine learning and data mining tasks. Previous approaches either analyze the source code for parsing or are data-driven such as text clustering. They largely neglect to exploit another widely available and valuable resource, software documentation that provides detailed explanations for the messages, to improve accuracy. In this paper, we propose an approach and system framework to use documentation knowledge for log parsing. With parameter value identification, it not only can improve the parsing accuracy for documented messages but also for undocumented messages. In addition, it can discover the linkages between event templates that are established by sharing parameters and indicate the correlation of the event context.


title: Fairness Amidst Non-IID Graph Data: Current Achievements and Future Directions

abstract: The importance of understanding and correcting algorithmic bias in machine learning (ML) has led to an increase in research on fairness in ML, which typically assumes that the underlying data is independent and identically distributed (IID). However, in reality, data is often represented using non-IID graph structures that capture connections among individual units. To address bias in ML systems, it is crucial to bridge the gap between the traditional fairness literature designed for IID data and the ubiquity of non-IID graph data. In this survey, we review such recent advance in fairness amidst non-IID graph data and identify datasets and evaluation metrics available for future research. We also point out the limitations of existing work as well as promising future directions.


title: Investigating the genomic background of CRISPR-Cas genomes for CRISPR-based antimicrobials

abstract: CRISPR-Cas systems are an adaptive immunity that protects prokaryotes against foreign genetic elements. Genetic templates acquired during past infection events enable DNA-interacting enzymes to recognize foreign DNA for destruction. Due to the programmability and specificity of these genetic templates, CRISPR-Cas systems are potential alternative antibiotics that can be engineered to self-target antimicrobial resistance genes on the chromosome or plasmid. However, several fundamental questions remain to repurpose these tools against drug-resistant bacteria. For endogenous CRISPR-Cas self-targeting, antimicrobial resistance genes and functional CRISPR-Cas systems have to co-occur in the target cell. Furthermore, these tools have to outplay DNA repair pathways that respond to the nuclease activities of Cas proteins, even for exogenous CRISPR-Cas delivery. Here, we conduct a comprehensive survey of CRISPR-Cas genomes. First, we address the co-occurrence of CRISPR-Cas systems and antimicrobial resistance genes in the CRISPR-Cas genomes. We show that the average number of these genes varies greatly by the CRISPR-Cas type, and some CRISPR-Cas types (IE and IIIA) have over 20 genes per genome. Next, we investigate the DNA repair pathways of these CRISPR-Cas genomes, revealing that the diversity and frequency of these pathways differ by the CRISPR-Cas type. The interplay between CRISPR-Cas systems and DNA repair pathways is essential for the acquisition of new spacers in CRISPR arrays. We conduct simulation studies to demonstrate that the efficiency of these DNA repair pathways may be inferred from the time-series patterns in the RNA structure of CRISPR repeats. This bioinformatic survey of CRISPR-Cas genomes elucidates the necessity to consider multifaceted interactions between different genes and systems to design effective CRISPR-based antimicrobials.


title: TURF: A Two-factor, Universal, Robust, Fast Distribution Learning Algorithm

abstract: Approximating distributions from their samples is a canonical statistical-learning problem. One of its most powerful and successful modalities approximates every distribution to an $\ell_1$ distance essentially at most a constant times larger than its closest $t$-piece degree-$d$ polynomial, where $t\ge1$ and $d\ge0$. Letting $c_{t,d}$ denote the smallest such factor, clearly $c_{1,0}=1$, and it can be shown that $c_{t,d}\ge 2$ for all other $t$ and $d$. Yet current computationally efficient algorithms show only $c_{t,1}\le 2.25$ and the bound rises quickly to $c_{t,d}\le 3$ for $d\ge 9$. We derive a near-linear-time and essentially sample-optimal estimator that establishes $c_{t,d}=2$ for all $(t,d)\ne(1,0)$. Additionally, for many practical distributions, the lowest approximation distance is achieved by polynomials with vastly varying number of pieces. We provide a method that estimates this number near-optimally, hence helps approach the best possible approximation. Experiments combining the two techniques confirm improved performance over existing methodologies.


title: To what extent can Plug-and-Play methods outperform neural networks alone in low-dose CT reconstruction

abstract: The Plug-and-Play (PnP) framework was recently introduced for low-dose CT reconstruction to leverage the interpretability and the flexibility of model-based methods to incorporate various plugins, such as trained deep learning (DL) neural networks. However, the benefits of PnP vs. state-of-the-art DL methods have not been clearly demonstrated. In this work, we proposed an improved PnP framework to address the previous limitations and develop clinical-relevant segmentation metrics for quantitative result assessment. Compared with the DL alone methods, our proposed PnP framework was slightly inferior in MSE and PSNR. However, the power spectrum of the resulting images better matched that of full-dose images than that of DL denoised images. The resulting images supported higher accuracy in airway segmentation than DL denoised images for all the ten patients in the test set, more substantially on the airways with a cross-section smaller than 0.61cm$^2$, and outperformed the DL denoised images for 45 out of 50 lung lobes in lobar segmentation. Our PnP method proved to be significantly better at preserving the image texture, which translated to task-specific benefits in automated structure segmentation and detection.


title: Forecasting Stock Options Prices via the Solution of an Ill-Posed Problem for the Black-Scholes Equation

abstract: In the previous paper (Inverse Problems, 32, 015010, 2016), a new heuristic mathematical model was proposed for accurate forecasting of prices of stock options for 1-2 trading days ahead of the present one. This new technique uses the Black-Scholes equation supplied by new intervals for the underlying stock and new initial and boundary conditions for option prices. The Black-Scholes equation was solved in the positive direction of the time variable, This ill-posed initial boundary value problem was solved by the so-called Quasi-Reversibility Method (QRM). This approach with an added trading strategy was tested on the market data for 368 stock options and good forecasting results were demonstrated. In the current paper, we use the geometric Brownian motion to provide an explanation of that effectivity using computationally simulated data for European call options. We also provide a convergence analysis for QRM. The key tool of that analysis is a Carleman estimate.


title: State transfers in vertex complemented coronas

abstract: In this paper, we study the existence of perfect state transfer and pretty good state transfer in vertex complemented coronas. We prove that perfect state transfer in vertex complemented coronas is extremely rare. In contrast, we give sufficient conditions for vertex complemented coronas to have pretty good state transfer.


title: DeepONet-Grid-UQ: A Trustworthy Deep Operator Framework for Predicting the Power Grid's Post-Fault Trajectories

abstract: This paper proposes a new data-driven method for the reliable prediction of power system post-fault trajectories. The proposed method is based on the fundamentally new concept of Deep Operator Networks (DeepONets). Compared to traditional neural networks that learn to approximate functions, DeepONets are designed to approximate nonlinear operators. Under this operator framework, we design a DeepONet to (1) take as inputs the fault-on trajectories collected, for example, via simulation or phasor measurement units, and (2) provide as outputs the predicted post-fault trajectories. In addition, we endow our method with a much-needed ability to balance efficiency with reliable/trustworthy predictions via uncertainty quantification. To this end, we propose and compare two methods that enable quantifying the predictive uncertainty. First, we propose a \textit{Bayesian DeepONet} (B-DeepONet) that uses stochastic gradient Hamiltonian Monte-Carlo to sample from the posterior distribution of the DeepONet parameters. Then, we propose a \textit{Probabilistic DeepONet} (Prob-DeepONet) that uses a probabilistic training strategy to equip DeepONets with a form of automated uncertainty quantification, at virtually no extra computational cost. Finally, we validate the predictive power and uncertainty quantification capability of the proposed B-DeepONet and Prob-DeepONet using the IEEE 16-machine 68-bus system.


title: Tombo Propeller: Bio-Inspired Deformable Structure toward Collision-Accommodated Control for Drones

abstract: There is a growing need for vertical take-off and landing vehicles, including drones, which are safe to use and can adapt to collisions. The risks of damage by collision, to humans, obstacles in the environment, and drones themselves, are significant. This has prompted a search into nature for a highly resilient structure that can inform a design of propellers to reduce those risks and enhance safety. Inspired by the flexibility and resilience of dragonfly wings, we propose a novel design for a biomimetic drone propeller called Tombo propeller. Here, we report on the design and fabrication process of this biomimetic propeller that can accommodate collisions and recover quickly, while maintaining sufficient thrust force to hover and fly. We describe the development of an aerodynamic model and experiments conducted to investigate performance characteristics for various configurations of the propeller morphology, and related properties, such as generated thrust force, thrust force deviation, collision force, recovery time, lift-to-drag ratio, and noise. Finally, we design and showcase a control strategy for a drone equipped with Tombo propellers that collides in mid-air with an obstacle and recovers from collision continuing flying. The results show that the maximum collision force generated by the proposed Tombo propeller is less than two-thirds that of a traditional rigid propeller, which suggests the concrete possibility to employ deformable propellers for drones flying in a cluttered environment. This research can contribute to morphological design of flying vehicles for agile and resilient performance.


title: Federated Learning with Sparsified Model Perturbation: Improving Accuracy under Client-Level Differential Privacy

abstract: Federated learning (FL) that enables edge devices to collaboratively learn a shared model while keeping their training data locally has received great attention recently and can protect privacy in comparison with the traditional centralized learning paradigm. However, sensitive information about the training data can still be inferred from model parameters shared in FL. Differential privacy (DP) is the state-of-the-art technique to defend against those attacks. The key challenge to achieving DP in FL lies in the adverse impact of DP noise on model accuracy, particularly for deep learning models with large numbers of parameters. This paper develops a novel differentially-private FL scheme named Fed-SMP that provides a client-level DP guarantee while maintaining high model accuracy. To mitigate the impact of privacy protection on model accuracy, Fed-SMP leverages a new technique called Sparsified Model Perturbation (SMP) where local models are sparsified first before being perturbed by Gaussian noise. We provide a tight end-to-end privacy analysis for Fed-SMP using Renyi DP and prove the convergence of Fed-SMP with both unbiased and biased sparsifications. Extensive experiments on real-world datasets are conducted to demonstrate the effectiveness of Fed-SMP in improving model accuracy with the same DP guarantee and saving communication cost simultaneously.


title: G-Mixup: Graph Data Augmentation for Graph Classification

abstract: This work develops \emph{mixup for graph data}. Mixup has shown superiority in improving the generalization and robustness of neural networks by interpolating features and labels between two random samples. Traditionally, Mixup can work on regular, grid-like, and Euclidean data such as image or tabular data. However, it is challenging to directly adopt Mixup to augment graph data because different graphs typically: 1) have different numbers of nodes; 2) are not readily aligned; and 3) have unique typologies in non-Euclidean space. To this end, we propose $\mathcal{G}$-Mixup to augment graphs for graph classification by interpolating the generator (i.e., graphon) of different classes of graphs. Specifically, we first use graphs within the same class to estimate a graphon. Then, instead of directly manipulating graphs, we interpolate graphons of different classes in the Euclidean space to get mixed graphons, where the synthetic graphs are generated through sampling based on the mixed graphons. Extensive experiments show that $\mathcal{G}$-Mixup substantially improves the generalization and robustness of GNNs.


title: Simulation of the RIBRAS Facility with GEANT4

abstract: A Geant4 simulation code was developed to perform realistic simulations of the RIBRAS facility. A second order expansion of a finite solenoid field was included to describe the beam optics with a good precision. A systematic study of coil currents for several magnetic rigidities and focal points was performed. Parameterizations of the coil currents for single and dual mode operations were obtained. Dedicated routines were developed to simulate the mechanism of direct reactions involving two and three particles in the final state. The present simulations were employed to investigate the feasibility of a Solenoidal Spectrometer with the RIBRAS facility. Our first results indicate that the concept can be applied in the RIBRAS system under certain conditions. Forthcoming studies both from simulations and experiment are already under development.

categories: physics.acc-ph nucl-ex physics.comp-ph physics.ins-det


title: Structural and phase evolution in U$_3$Si$_2$ during steam corrosion

abstract: U$_3$Si$_2$ nuclear fuel is corroded in deuterated steam with in situ neutron diffraction. Density functional theory is coupled with rigorous thermodynamic description of the hydride including gas/solid entropy contributions. H absorbs in the 2$b$ interstitial site of U$_3$Si$_2$H$_x$ and moves to 8$j$ for $x\ge 0.5$. Hydriding forces lattice expansion and change in $a/c$ ratio linked to site preference. Rietveld refinement tracks the corrosion reactions at 350-500 \deg C and preference for the 8j site. Above 375 \deg C, formation of UO$_2$, U$_3$Si$_5$ and USi$_3$ take place in the grain boundaries and bulk. Hydriding occurs in bulk and precedes other reactions.


title: Unconventional dual 1D-2D quantum spin liquid revealed by $ab$ $initio$ studies on organic solids family

abstract: Organic solids host various electronic phases. Especially, a milestone compound of organic solid, $\beta'$-$X$[Pd(dmit)$_2$]$_2$ with $X$=EtMe$_3$Sb shows quantum spin-liquid (QSL) properties suggesting a novel state of matter. However, nature of the QSL has been largely unknown. Here, we computationally study five compounds comprehensively with different $X$ using 2D $ab$ $initio$ Hamiltonians and correctly reproduce experimental phase diagram with antiferromagnetic order for $X$=Me$_4$P, Me$_4$As, Me$_4$Sb, Et$_2$Me$_2$As and a QSL for $X$=EtMe$_3$Sb without adjustable parameters. We find that the QSL for $X$=EtMe$_3$Sb exhibits 1D nature characterized by algebraic decay of spin correlation along one direction, while exponential decay in the other direction, indicating dimensional reduction from 2D to 1D. The 1D nature indeed accounts for the experimental specific heat, thermal conductivity and magnetic susceptibility. The identified QSL, however, preserves 2D nature as well consistently with spin fractionalization into spinon with Dirac-like gapless excitations and reveals duality bridging the 1D and 2D QSLs.


title: A Survey of Neural Trojan Attacks and Defenses in Deep Learning

abstract: Artificial Intelligence (AI) relies heavily on deep learning - a technology that is becoming increasingly popular in real-life applications of AI, even in the safety-critical and high-risk domains. However, it is recently discovered that deep learning can be manipulated by embedding Trojans inside it. Unfortunately, pragmatic solutions to circumvent the computational requirements of deep learning, e.g. outsourcing model training or data annotation to third parties, further add to model susceptibility to the Trojan attacks. Due to the key importance of the topic in deep learning, recent literature has seen many contributions in this direction. We conduct a comprehensive review of the techniques that devise Trojan attacks for deep learning and explore their defenses. Our informative survey systematically organizes the recent literature and discusses the key concepts of the methods while assuming minimal knowledge of the domain on the readers part. It provides a comprehensible gateway to the broader community to understand the recent developments in Neural Trojans.


title: On the Origins of the Block Structure Phenomenon in Neural Network Representations

abstract: Recent work has uncovered a striking phenomenon in large-capacity neural networks: they contain blocks of contiguous hidden layers with highly similar representations. This block structure has two seemingly contradictory properties: on the one hand, its constituent layers exhibit highly similar dominant first principal components (PCs), but on the other hand, their representations, and their common first PC, are highly dissimilar across different random seeds. Our work seeks to reconcile these discrepant properties by investigating the origin of the block structure in relation to the data and training methods. By analyzing properties of the dominant PCs, we find that the block structure arises from dominant datapoints - a small group of examples that share similar image statistics (e.g. background color). However, the set of dominant datapoints, and the precise shared image statistic, can vary across random seeds. Thus, the block structure reflects meaningful dataset statistics, but is simultaneously unique to each model. Through studying hidden layer activations and creating synthetic datapoints, we demonstrate that these simple image statistics dominate the representational geometry of the layers inside the block structure. We explore how the phenomenon evolves through training, finding that the block structure takes shape early in training, but the underlying representations and the corresponding dominant datapoints continue to change substantially. Finally, we study the interplay between the block structure and different training mechanisms, introducing a targeted intervention to eliminate the block structure, as well as examining the effects of pretraining and Shake-Shake regularization.


title: Arpu Kuilpu: An H5 from the Outer Main Belt

abstract: On 1 June 2019, just before 7:30 PM local time, the Desert Fireball Network detected a -9.3 magnitude fireball over South Australia near the Western Australia border. The event was observed by six fireball observatories, and lasted for five seconds. One station was nearly directly underneath the trajectory, greatly constraining the trajectory solution. This trajectory's backward numerical integrations indicate that the object originated from the outer main belt with a semi-major axis of 2.75 au. A light curve was also extracted and showed that the body experienced very little fragmentation during its atmospheric passage. A search campaign was conducted with several Desert Fireball Network team members and other volunteers. One 42 g fragment was recovered within the predicted fall area based on the dark flight model. Based on measurements of short-lived radionuclides, the fragment was confirmed to be a fresh fall. The meteorite, Arpu Kuilpu, has been classified as an H5 ordinary chondrite. This marks the fifth fall recovered in Australia by the Desert Fireball Network, and the smallest meteoroid ($\simeq 2$ kg) to ever survive entry and be recovered as a meteorite.


title: Interpolants and Explicit Definitions in Extensions of the Description Logic EL

abstract: We show that the vast majority of extensions of the description logic $\mathcal{EL}$ do not enjoy the Craig interpolation nor the projective Beth definability property. This is the case, for example, for $\mathcal{EL}$ with nominals, $\mathcal{EL}$ with the universal role, $\mathcal{EL}$ with a role inclusion of the form $r\circ s\sqsubseteq s$, and for $\mathcal{ELI}$. It follows in particular that the existence of an explicit definition of a concept or individual name cannot be reduced to subsumption checking via implicit definability. We show that nevertheless the existence of interpolants and explicit definitions can be decided in polynomial time for standard tractable extensions of $\mathcal{EL}$ (such as $\mathcal{EL}^{++}$) and in ExpTime for $\mathcal{ELI}$ and various extensions. It follows that these existence problems are not harder than subsumption which is in sharp contrast to the situation for expressive DLs. We also obtain tight bounds for the size of interpolants and explicit definitions and the complexity of computing them: single exponential for tractable standard extensions of $\mathcal{EL}$ and double exponential for $\mathcal{ELI}$ and extensions. We close with a discussion of Horn-DLs such as Horn-$\mathcal{ALCI}$.


title: On the Sample Complexity of Stabilizing LTI Systems on a Single Trajectory

abstract: Stabilizing an unknown dynamical system is one of the central problems in control theory. In this paper, we study the sample complexity of the learn-to-stabilize problem in Linear Time-Invariant (LTI) systems on a single trajectory. Current state-of-the-art approaches require a sample complexity linear in $n$, the state dimension, which incurs a state norm that blows up exponentially in $n$. We propose a novel algorithm based on spectral decomposition that only needs to learn "a small part" of the dynamical matrix acting on its unstable subspace. We show that, under proper assumptions, our algorithm stabilizes an LTI system on a single trajectory with $\tilde{O}(k)$ samples, where $k$ is the instability index of the system. This represents the first sub-linear sample complexity result for the stabilization of LTI systems under the regime when $k = o(n)$.


title: Survivable Free Space Optical Mesh Network using High-Altitude Platforms

abstract: Free space optical (FSO) communication refers to the information transmission technology based on the propagation of optical signals in space. FSO communication requires that the transmitter and receiver directly see each other. High-altitude platforms (HAPs) have been proposed for carrying FSO transceivers in the stratosphere. A multihop HAP network with FSO links can relay traffic between ground FSO nodes. In this study, we propose an end-to-end switching model for forwarding traffic between massive pairs of ground FSO nodes over a HAP network. A protection mechanism is employed for improving the communication survivability in the presence of clouds, which may break the line of sight (LoS) between HAPs and ground nodes. We propose an algorithm for designing the topology of the survivable HAP network, given a set of ground FSO nodes. The results demonstrate that, even though networks with survivable capacity use more resources, they are not necessary much more expensive than those without survivability in terms of equipment, i.e., HAPs and FSO devices, and in terms of wavelength resource utilization.


title: Longest (Sub-)Periodic Subsequence

abstract: We present an algorithm computing the longest periodic subsequence of a string of length $n$ in $O(n^7)$ time with $O(n^4)$ words of space. We obtain improvements when restricting the exponents or extending the search allowing the reported subsequence to be subperiodic down to $O(n^3)$ time and $O(n^2)$ words of space.


title: Pruning Networks with Cross-Layer Ranking & k-Reciprocal Nearest Filters

abstract: This paper focuses on filter-level network pruning. A novel pruning method, termed CLR-RNF, is proposed. We first reveal a "long-tail" long-tail pruning problem in magnitude-based weight pruning methods, and then propose a computation-aware measurement for individual weight importance, followed by a Cross-Layer Ranking (CLR) of weights to identify and remove the bottom-ranked weights. Consequently, the per-layer sparsity makes up of the pruned network structure in our filter pruning. Then, we introduce a recommendation-based filter selection scheme where each filter recommends a group of its closest filters. To pick the preserved filters from these recommended groups, we further devise a k-Reciprocal Nearest Filter (RNF) selection scheme where the selected filters fall into the intersection of these recommended groups. Both our pruned network structure and the filter selection are non-learning processes, which thus significantly reduce the pruning complexity, and differentiate our method from existing works. We conduct image classification on CIFAR-10 and ImageNet to demonstrate the superiority of our CLR-RNF over the state-of-the-arts. For example, on CIFAR-10, CLR-RNF removes 74.1% FLOPs and 95.0% parameters from VGGNet-16 with even 0.3\% accuracy improvements. On ImageNet, it removes 70.2% FLOPs and 64.8% parameters from ResNet-50 with only 1.7% top-5 accuracy drops. Our project is at https://github.com/lmbxmu/CLR-RNF.


title: Improving Human Sperm Head Morphology Classification with Unsupervised Anatomical Feature Distillation

abstract: With rising male infertility, sperm head morphology classification becomes critical for accurate and timely clinical diagnosis. Recent deep learning (DL) morphology analysis methods achieve promising benchmark results, but leave performance and robustness on the table by relying on limited and possibly noisy class labels. To address this, we introduce a new DL training framework that leverages anatomical and image priors from human sperm microscopy crops to extract useful features without additional labeling cost. Our core idea is to distill sperm head information with reliably-generated pseudo-masks and unsupervised spatial prediction tasks. The predicted foreground masks from this distillation step are then leveraged to regularize and reduce image and label noise in the tuning stage. We evaluate our new approach on two public sperm datasets and achieve state-of-the-art performances (e.g. 65.9% SCIAN accuracy and 96.5% HuSHeM accuracy).


title: Catalytic leverage of correlations and mitigation of dissipation in Information erasure

abstract: Correlations are a valuable resource for quantum information processing and quantum thermodynamics. However, the preparation of some correlated states can carry a substantial cost that should be compared against its value. We show that classical correlations can be catalytically exploited, which enables to mitigate heat and entropy dissipation in information erasure. These correlations are naturally generated by the erasure process, and thus can be considered free. Although we also show that maximum erasure with minimum dissipation and no correlations is theoretically possible, catalysts are always useful in practical erasure settings, where correlations are expected to take place.


title: Lattice QCD Calculations of Parton Physics

abstract: In this document, we summarize the status and challenges of calculating parton physics in lattice QCD for the US Particle Physics Community Planning Exercise (a.k.a. "Snowmass"). While PDF-moments calculations have been very successful and been continuously improved, new methods have been developed to calculate distributions directly in $x$-space. Many recent lattice studies have been focused on calculating isovector PDFs of the pion and nucleon, learning to control systematics associated with excited-state contamination, renormalization and continuum extrapolations, pion-mass and finite-volume effects, etc. Although in some cases, the lattice results are already competitive with experimental data, to reach the level of precision in a wide range of $x$ for unpolarized nucleon PDFs impactful for future collider physics remains a challenge, and may require exascale supercomputing power. The new theoretical methods open the door for calculating other partonic observables which will be the focus of the experimental program in nuclear physics, including generalized parton distributions and transverse-momentum dependent PDFs. A fruitful interplay between experimental data and lattice-QCD calculations will usher in a new era for parton physics and hadron structure.


title: One-bit Submission for Locally Private Quasi-MLE: Its Asymptotic Normality and Limitation

abstract: Local differential privacy~(LDP) is an information-theoretic privacy definition suitable for statistical surveys that involve an untrusted data curator. An LDP version of quasi-maximum likelihood estimator~(QMLE) has been developed, but the existing method to build LDP QMLE is difficult to implement for a large-scale survey system in the real world due to long waiting time, expensive communication cost, and the boundedness assumption of derivative of a log-likelihood function. We provided an alternative LDP protocol without those issues, which is potentially much easily deployable to a large-scale survey. We also provided sufficient conditions for the consistency and asymptotic normality and limitations of our protocol. Our protocol is less burdensome for the users, and the theoretical guarantees cover more realistic cases than those for the existing method.


title: Exact Hopfion Vortices in a 3D Heisenberg Ferromagnet

abstract: We find exact static soliton solutions for the unit spin vector field of an inhomogeneous, anisotropic three-dimensional Heisenberg ferromagnet. Each soliton is labeled by two integers $n$ and $m$. It is a (modified) skyrmion in the $z=0$ plane with winding number $n$, which twists out of the plane $m$ times in the $z$-direction to become a 3D soliton. Here $m$ arises due to the periodic boundary condition at the $z$-boundaries. We use Whitehead's integral expression to find that the Hopf invariant of the soliton is an integer $H =nm$. It represents a hopfion vortex. Plots of the preimages of this topological soliton show that they are either unknots or nontrivial knots, depending on $n$ and $m$. Any pair of preimage curves links $H$ times, corroborating the interpretation of $H$ as a linking number. We also calculate the exact energy of the hopfion vortex, and show that its topological lower bound has a sublinear dependence on $H$. Using Derrick's scaling analysis, we demonstrate that the presence of a spatial inhomogeneity in the anisotropic interaction, which in turn introduces a characteristic length scale in the system, leads to the stability of the hopfion vortex.


title: Polar Coded Modulation via Hybrid Bit Labeling

abstract: Bit-interleaved coded modulation (BICM) and multilevel coded modulation (MLC) are commonly used to combine polar codes with high order modulation. While BICM benefits from simple design and the separation of coding and modulation, MLC shows better performance under successive-cancellation decoding. In this paper we propose a hybrid polar coded modulation scheme that lies between BICM and MLC, wherein a fraction of bits are assigned to set-partition (SP) labeling and the remaining bits are assigned for Gray labeling. The SP labeled bits undergo sequential demodulation, using iterative demodulation and polar decoding similar to MLC, whereas the Gray labeled bits are first demodulated in parallel and then sent for decoding similar to BICM. Either polar codes or other channel codes (such as LDPC codes) can be used for the Gray labeled bits. For length 2048 rate 1/2 polar code on 256-QAM, the performance gap between BICM (Gray labeling only) and MLC (SP labeling only) can be almost fully closed by the hybrid scheme. Notably, the hybrid scheme has a significant latency advantage over MLC. These performance gains make the proposed scheme attractive for future communication systems such as 6G.


title: Landau quantization and spin polarization of cold magnetized quark matter

abstract: The magnetic field and density behaviors of various thermodynamic quantities of strange quark matter under compact star conditions are investigated in the framework of the thermodynamically self-consistent quasiparticle model. For individual species, a larger number density $n_i$ leads to a larger magnetic field strength threshold that align all particles parallel or antiparallel to the magnetic field. Accordingly, in contrast to the finite baryon density effect which reduces the spin polarization of magnetized strange quark matter, the magnetic field effect leads to an enhancement of it. We also compute the sound velocity as a function of the baryon density and find the sound velocity shows an obvious oscillation with increasing density. Except for the oscillation, similar to the zero-magnetic field case that the sound velocity grows with increasing density and approaches the conformal limit $V_s^2=1/3$ at high densities from below.


title: A short note on an inequality between KL and TV

abstract: The goal of this short note is to discuss the relation between Kullback--Leibler divergence and total variation distance, starting with the celebrated Pinsker's inequality relating the two, before switching to a simple, yet (arguably) more useful inequality, apparently not as well known, due to Bretagnolle and Huber. We also discuss applications of this bound for minimax testing lower bounds.


title: The radio dichotomy of active galactic nuclei

abstract: The question of radio dichotomy in the active galactic nuclei (AGNs) is still in debate even it has been proposed for more than forty years. In order to solve the old riddle, we collect a sample of AGNs with optical $B$ band and radio 6cm wavelength data to analyze the radio loudness ${\rm log}R$. Our results indicate a separation of ${\rm log}R = \langle 1.37 \pm 0.02 \rangle$ between radio-loud (RL) AGNs and radio-quiet (RQ) AGNs, suggest the existence of an RL/RQ dichotomy. For the first time, we suggest combining radio luminosity and radio loudness as a double-criterion to divide AGNs into RLs and RQs to avoid misclassification problems that may happen in the single-criterion scenario, we propose the double-criterion dividing line ${\rm log}L_{\rm 6cm} = -2.7{\rm log}R +44.3$ by using a machine learning method. In addition, the key point of the RL/RQ dichotomy is the origin of radio emission for the two classes, we suggest the radio emission from RLs and RQs share the same origin, e.g. jets and mini-jets (aborted-jet or outflow), through a correlation study between radio 6cm luminosity and optical $B$ band luminosity.


title: Unsupervised word-level prosody tagging for controllable speech synthesis

abstract: Although word-level prosody modeling in neural text-to-speech (TTS) has been investigated in recent research for diverse speech synthesis, it is still challenging to control speech synthesis manually without a specific reference. This is largely due to lack of word-level prosody tags. In this work, we propose a novel approach for unsupervised word-level prosody tagging with two stages, where we first group the words into different types with a decision tree according to their phonetic content and then cluster the prosodies using GMM within each type of words separately. This design is based on the assumption that the prosodies of different type of words, such as long or short words, should be tagged with different label sets. Furthermore, a TTS system with the derived word-level prosody tags is trained for controllable speech synthesis. Experiments on LJSpeech show that the TTS model trained with word-level prosody tags not only achieves better naturalness than a typical FastSpeech2 model, but also gains the ability to manipulate word-level prosody.


title: Holistic Adversarial Robustness of Deep Learning Models

abstract: Adversarial robustness studies the worst-case performance of a machine learning model to ensure safety and reliability. With the proliferation of deep-learning-based technology, the potential risks associated with model development and deployment can be amplified and become dreadful vulnerabilities. This paper provides a comprehensive overview of research topics and foundational principles of research methods for adversarial robustness of deep learning models, including attacks, defenses, verification, and novel applications.


title: Laplacian state transfer in vertex complemented coronas

abstract: In this paper, we investigate the existence of Laplacian perfect state transfer and Laplacian pretty good state transfer in vertex complemented coronas. We prove that there is no Laplacian perfect state transfer in vertex complemented coronas. In contrast, we give a sufficient condition for vertex complemented coronas to have Laplacian pretty good state transfer.


title: Collision-free Path Planning in the Latent Space through cGANs

abstract: We show a new method for collision-free path planning by cGANs by mapping its latent space to only the collision-free areas of the robot joint space. Our method simply provides this collision-free latent space after which any planner, using any optimization conditions, can be used to generate the most suitable paths on the fly. We successfully verified this method with a simulated two-link robot arm.


title: Electron Transfer and Spin-Orbit Coupling: How Strong are Berry Force Effects In and Out of Equilibrium in the Presence of Nuclear Friction?

abstract: We investigate a spin-boson inspired model of electron transfer, where the diabatic coupling is given by a position-dependent phase, exp(iWx). We consider both equilibrium and nonequilibrium initial conditions. We show that, for this model, all equilibrium results are completely invariant to the sign of W(to infinite order). However, the nonequilibrium results do depend on the sign of W, suggesting that photo-induced electron transfer dynamics are meaningfully affected by Berry forces even in the presence of nuclear friction; furthermore, whenever there is spin-orbit coupling, electronic spin polarization can emerge (at least for some time).


title: Probabilistic Modeling Using Tree Linear Cascades

abstract: We introduce tree linear cascades, a class of linear structural equation models for which the error variables are uncorrelated but need not be Gaussian nor independent. We show that, in spite of this weak assumption, the tree structure of this class of models is identifiable. In a similar vein, we introduce a constrained regression problem for fitting a tree-structured linear structural equation model and solve the problem analytically. We connect these results to the classical Chow-Liu approach for Gaussian graphical models. We conclude by giving an empirical-risk form of the regression and illustrating the computationally attractive implications of our theoretical results on a basic example involving stock prices.


title: Impact of Pretraining Term Frequencies on Few-Shot Reasoning

abstract: Pretrained Language Models (LMs) have demonstrated ability to perform numerical reasoning by extrapolating from a few examples in few-shot settings. However, the extent to which this extrapolation relies on robust reasoning is unclear. In this paper, we investigate how well these models reason with terms that are less frequent in the pretraining data. In particular, we examine the correlations between the model performance on test instances and the frequency of terms from those instances in the pretraining data. We measure the strength of this correlation for a number of GPT-based language models (pretrained on the Pile dataset) on various numerical deduction tasks (e.g., arithmetic and unit conversion). Our results consistently demonstrate that models are more accurate on instances whose terms are more prevalent, in some cases above $70\%$ (absolute) more accurate on the top 10\% frequent terms in comparison to the bottom 10\%. Overall, although LMs exhibit strong performance at few-shot numerical reasoning tasks, our results raise the question of how much models actually generalize beyond pretraining data, and we encourage researchers to take the pretraining data into account when interpreting evaluation results.


title: Purity of thermal mixed quantum states

abstract: We develop a formula to evaluate the purity of a series of thermal equilibrium states that can be calculated in numerical experiments without knowing the exact form of the quantum state \textit{a priori}. Canonical typicality guarantees that there are numerous microscopically different expressions of such states, which we call thermal mixed quantum (TMQ) states. Suppose that we construct a TMQ state by a mixture of $N_\mathrm{samp}$ independent pure states. The weight of each pure state is given by its norm, and the partition function is given by the average of the norms. To qualify how efficiently the mixture is done, we introduce a quantum statistical quantity called "normalized fluctuation of partition function (NFPF)". For smaller NFPF, the TMQ state is closer to the equally weighted mixture of pure states, which means higher efficiency, requiring a smaller $N_\mathrm{samp}$. The largest NFPF is realized in the Gibbs state with purity-0 and exponentially large $N_\mathrm{samp}$, while the smallest NFPF is given for thermal pure quantum state with purity-1 and $N_\mathrm{samp}=1$. The purity is formulated using solely the NFPF and roughly gives $N_\mathrm{samp}^{-1}$. Our analytical results are numerically tested and confirmed by the two random sampling methods built on matrix-product-state-based wave functions.


title: Time Domain Simulation of DFIG-Based Wind Power System using Differential Transform Method

abstract: This paper proposes a new non-iterative time-domain simulation approach using Differential Transform Method (DTM) to solve the set of non-linear Differential-Algebraic Equations (DAEs) involved in a DFIG-based wind power system. The DTM is an analytical as well as numerical approach applied to solve high dimensional non-linear dynamical systems and the solution can be expressed in the form of a series. In this approach, there is no need to compute higher-order derivatives as DAEs are converted into a set of linear equations after applying transformation rules so that the power series coefficients can be computed directly. The transformation rules are used to transform power system models of various devices, such as induction generator, wind turbine, rotor and grid side converter, which includes trigonometric, square root, exponential functions etc. Further, to increase the interval of convergence for the series solutions, the multi-step DTM (MsDTM) approach is used. The numerical performance of the proposed approach is compared with the traditional numerical RK-4 method to demonstrate the potential of the proposed approach in solving power system non-linear DAEs


title: Case law retrieval: problems, methods, challenges and evaluations in the last 20 years

abstract: Case law retrieval is the retrieval of judicial decisions relevant to a legal question. Case law retrieval comprises a significant amount of a lawyer's time, and is important to ensure accurate advice and reduce workload. We survey methods for case law retrieval from the past 20 years and outline the problems and challenges facing evaluation of case law retrieval systems going forward. Limited published work has focused on improving ranking in ad-hoc case law retrieval. But there has been significant work in other areas of case law retrieval, and legal information retrieval generally. This is likely due to legal search providers being unwilling to give up the secrets of their success to competitors. Most evaluations of case law retrieval have been undertaken on small collections and focus on related tasks such as question-answer systems or recommender systems. Work has not focused on Cranfield style evaluations and baselines of methods for case law retrieval on publicly available test collections are not present. This presents a major challenge going forward. But there are reasons to question the extent of this problem, at least in a commercial setting. Without test collections to baseline approaches it cannot be known whether methods are promising. Works by commercial legal search providers show the effectiveness of natural language systems as well as query expansion for case law retrieval. Machine learning is being applied to more and more legal search tasks, and undoubtedly this represents the future of case law retrieval.


title: Generation of multipartite entanglement between spin-1 particles with bifurcation-based quantum annealing

abstract: Quantum annealing is a way to solve a combinational optimization problem where quantum fluctuation is induced by transverse fields. Recently, a bifurcation-based quantum annealing with spin-1 particles was suggested as another mechanism to implement the quantum annealing. In the bifurcation-based quantum annealing, each spin is initially prepared in $|0\rangle$, let this state evolve by a time-dependent Hamiltonian in an adiabatic way, and we find a state spanned by $|\pm 1\rangle$ at the end of the evolution. Here, we propose a scheme to generate multipartite entanglement, namely GHZ states, between spin-1 particles by using the bifurcation-based quantum annealing. We gradually decrease the detuning of the spin-1 particles while we adiabatically change the amplitude of the external driving fields. Due to the dipole-dipole interactions between the spin-1 particles, we can prepare the GHZ state after performing this protocol. We discuss possible implementations of our scheme by using nitrogen vacancy centers in diamond.


title: Effect of expanding learning scope on the evolution of cooperation in scale-free networks

abstract: We study how expanding the scope for selecting game and learning (adaptation) partners affects the evolution of cooperation in public goods games on scale-free networks. We show the following three results. (i) Expanding the scope for selecting game partners suppresses cooperation. (ii) Expanding the scope for selecting learning partners promotes cooperation when cooperation evolution is difficult. (iii) When cooperation is more likely to evolve, slightly expanding the scope for selecting learning partners causes a significant drop in the cooperation rate, but expanding the scope further causes the cooperation rate to recover. Although (i) is explained by the hub-centered mechanism, the well-known dynamic that promotes cooperation on scale-free networks, (ii) and (iii) are caused by a completely different mechanism that has heretofore been rarely mentioned.


title: Generic bond energy formalism within the modified quasichemical model for ternary solutions

abstract: The Modified Quasichemical Model in the Pair Approximation (MQMPA) can effectively capture the thermodynamic features of a binary solution with Short-Range Ordering (SRO). If the model is used to treat a ternary solution, a geometric interpolation method must be employed to extend the bond energy expression from binary to ternary formalism. The aim of the present work is to implement such extension by means of a generic geometric interpolation approach. The generic method is unbiased and can be transformed into the widely used Kohler, Toop and Muggianu approaches with special interpolation parameters. The interpolation parameters can be calculated by the integration method as well as be optimized by ternary experimental data. The generic bond energy formalism (GBEF) has thus been derived to provide the MQMPA great flexibility to describe ternary solutions with complex configurations. Moreover, the GBEF is more concise than the formula derived by a combinatorial Kohler-Toop method. The concise GBEF is in the respect more conveniently programmed. Eventually, the Cu-Li-Sn liquid where both SRO and clustering among atoms occur is employed to validate the effectiveness and reliability of the GBEF within the MQMPA.


title: On $q$-commuting co-extensions and $q$-commutant lifting

abstract: Consider a nonzero contraction $T$ and a bounded operator $X$ satisfying $TX=qXT$ for a complex number $q$. There are some interesting results in the literature on $q$-commuting dilation and $q$-commutant lifting of such pair $(T,X)$ when $|q|=1$. Here we improve a few of them to the class of scalars $q$ satisfying $|q|\leq \dfrac{1}{\|T\|}$.


title: Assessing the Influence of Input Magnetic Maps on Global Modeling of the Solar Wind and CME-driven Shock in the 2013 April 11 Event

abstract: In the past decade, significant efforts have been made in developing physics-based solar wind and coronal mass ejection (CME) models, which have been or are being transferred to national centers (e.g., SWPC, CCMC) to enable space weather predictive capability. However, the input data coverage for space weather forecasting is extremely limited. One major limitation is the solar magnetic field measurements, which are used to specify the inner boundary conditions of the global magnetohydrodynamic (MHD) models. In this study, using the Alfven wave solar model (AWSoM), we quantitatively assess the influence of the magnetic field map input (synoptic/diachronic vs. synchronic magnetic maps) on the global modeling of the solar wind and the CME-driven shock in the 2013 April 11 solar energetic particle (SEP) event. Our study shows that due to the inhomogeneous background solar wind and dynamical evolution of the CME, the CME-driven shock parameters change significantly both spatially and temporally as the CME propagates through the heliosphere. The input magnetic map has a great impact on the shock connectivity and shock properties in the global MHD simulation. Therefore this study illustrates the importance of taking into account the model uncertainty due to the imperfect magnetic field measurements when using the model to provide space weather predictions.


title: Balancing Domain Experts for Long-Tailed Camera-Trap Recognition

abstract: Label distributions in camera-trap images are highly imbalanced and long-tailed, resulting in neural networks tending to be biased towards head-classes that appear frequently. Although long-tail learning has been extremely explored to address data imbalances, few studies have been conducted to consider camera-trap characteristics, such as multi-domain and multi-frame setup. Here, we propose a unified framework and introduce two datasets for long-tailed camera-trap recognition. We first design domain experts, where each expert learns to balance imperfect decision boundaries caused by data imbalances and complement each other to generate domain-balanced decision boundaries. Also, we propose a flow consistency loss to focus on moving objects, expecting class activation maps of multi-frame matches the flow with optical flow maps for input images. Moreover, two long-tailed camera-trap datasets, WCS-LT and DMZ-LT, are introduced to validate our methods. Experimental results show the effectiveness of our framework, and proposed methods outperform previous methods on recessive domain samples.


title: Multiparameter Bernoulli Factories

abstract: We consider the problem of computing with many coins of unknown bias. We are given samples access to $n$ coins with \emph{unknown} biases $p_1,\dots, p_n$ and are asked to sample from a coin with bias $f(p_1, \dots, p_n)$ for a given function $f:[0,1]^n \rightarrow [0,1]$. We give a complete characterization of the functions $f$ for which this is possible. As a consequence, we show how to extend various combinatorial sampling procedures (most notably, the classic Sampford Sampling for $k$-subsets) to the boundary of the hypercube.


title: High-frequency traveling-wave phononic cavity with sub-micron wavelength

abstract: Thin-film gallium nitride (GaN) as a proven piezoelectric material is a promising platform for the phononic integrated circuits, which hold great potential for scalable information processing processors. Here, an unsuspended traveling phononic resonator based on high-acoustic-index-contrast mechanism is realized in GaN-on-Sapphire with a frequency up to 5 GHz, which matches the typical superconducting qubit frequency. A sixfold increment in quality factor was found when temperature decreases from room temperature ($Q=5000$) to $7\,\mathrm{K}$ ($Q=30000$) and thus a frequency-quality factor product of $1.5\times10^{14}$ is obtained. Higher quality factors are available when the fabrication process is further optimized. Our system shows great potential in hybrid quantum devices via circuit quantum acoustodynamics.


title: Situation-based memory in spiking neuron-astrocyte network

abstract: Mammalian brains operate in a very special surrounding: to survive they have to react quickly and effectively to the pool of stimuli patterns previously recognized as danger. Many learning tasks often encountered by living organisms involve a specific set-up centered around a relatively small set of patterns presented in a particular environment. For example, at a party, people recognize friends immediately, without deep analysis, just by seeing a fragment of their clothes. This set-up with reduced "ontology" is referred to as a "situation". Situations are usually local in space and time. In this work, we propose that neuron-astrocyte networks provide a network topology that is effectively adapted to accommodate situation-based memory. In order to illustrate this, we numerically simulate and analyze a well-established model of a neuron-astrocyte network, which is subjected to stimuli conforming to the situation-driven environment. Three pools of stimuli patterns are considered: external patterns, patterns from the situation associative pool regularly presented to the network and learned by the network, and patterns already learned and remembered by astrocytes. Patterns from the external world are added to and removed from the associative pool. Then we show that astrocytes are structurally necessary for an effective function in such a learning and testing set-up. To demonstrate this we present a novel neuromorphic model for short-term memory implemented by a two-net spiking neural-astrocytic network. Our results show that such a system tested on synthesized data with selective astrocyte-induced modulation of neuronal activity provides an enhancement of retrieval quality in comparison to standard spiking neural networks trained via Hebbian plasticity only. We argue that the proposed set-up may offer a new way to analyze, model, and understand neuromorphic artificial intelligence systems.


title: Multi-style Training for South African Call Centre Audio

abstract: Mismatched data is a challenging problem for automatic speech recognition (ASR) systems. One of the most common techniques used to address mismatched data is multi-style training (MTR), a form of data augmentation that attempts to transform the training data to be more representative of the testing data; and to learn robust representations applicable to different conditions. This task can be very challenging if the test conditions are unknown. We explore the impact of different MTR styles on system performance when testing conditions are different from training conditions in the context of deep neural network hidden Markov model (DNN-HMM) ASR systems. A controlled environment is created using the LibriSpeech corpus, where we isolate the effect of different MTR styles on final system performance. We evaluate our findings on a South African call centre dataset that contains noisy, WAV49-encoded audio.


title: Universal relation for operator complexity

abstract: We study Krylov complexity $C_K$ and operator entropy $S_K$ in operator growth. We find that for a variety of systems, including chaotic ones and integrable theories, the two quantities always enjoy a logarithmic relation $S_K\sim \log{C_K}$ at long times, where dissipative behavior emerges in unitary evolution. Otherwise, the relation does not hold any longer. Universality of the relation is deeply connected to irreversibility of operator growth.


title: Navigating Local Minima in Quantized Spiking Neural Networks

abstract: Spiking and Quantized Neural Networks (NNs) are becoming exceedingly important for hyper-efficient implementations of Deep Learning (DL) algorithms. However, these networks face challenges when trained using error backpropagation, due to the absence of gradient signals when applying hard thresholds. The broadly accepted trick to overcoming this is through the use of biased gradient estimators: surrogate gradients which approximate thresholding in Spiking Neural Networks (SNNs), and Straight-Through Estimators (STEs), which completely bypass thresholding in Quantized Neural Networks (QNNs). While noisy gradient feedback has enabled reasonable performance on simple supervised learning tasks, it is thought that such noise increases the difficulty of finding optima in loss landscapes, especially during the later stages of optimization. By periodically boosting the Learning Rate (LR) during training, we expect the network can navigate unexplored solution spaces that would otherwise be difficult to reach due to local minima, barriers, or flat surfaces. This paper presents a systematic evaluation of a cosine-annealed LR schedule coupled with weight-independent adaptive moment estimation as applied to Quantized SNNs (QSNNs). We provide a rigorous empirical evaluation of this technique on high precision and 4-bit quantized SNNs across three datasets, demonstrating (close to) state-of-the-art performance on the more complex datasets. Our source code is available at this link: https://github.com/jeshraghian/QSNNs.


title: Quasi-monochromatic bright gamma-ray generation from synchronized Compton scattering via azimuthal spatial-temporal coupling

abstract: High energy photons can be generated via inverse Compton scattering (ICS) in the collision between energetic electrons and intense laser pulse. The development of laser plasma accelerators promises compact and all-optical gamma-ray sources by colliding the electrons from laser wakefield accelerators to its high-power driving pulse reflected by a plasma mirror. However, the law of optical focusing hinders realization of both high photon yield and monochromatic spectrum in this scenario. We propose an azimuthal spatial-temporal convertor that decouples the focal field strength from laser spot size using helical parabolic geometry. It decomposes the driving laser beam into a pulse train of almost identical divergence angle and focal depth, creating synchronized ICS in the optimized linear regime. The scheme resolves the dilemma between high efficiency and narrow energy spread, facilitating the generation of monochromatic gamma-ray using high power lasers beyond relativistic field strengths.


title: Selective measurement of the longitudinal electron spin relaxation time $T_1$ of Ce$^{3+}$ ions in a YAG lattice: Resonant spin inertia

abstract: Electron spin oriented along an external magnetic field is subject to longitudinal spin relaxation with characteristic time $T_1$. The corresponding decay is nonoscillating, so one cannot readily ascribe $T_1$ to a certain $g$ factor. This becomes a problem when several electronic states with different $g$ factors are present in the system, e.g. electrons and holes. We solve this problem by optically pumping spin polarization and then selectively depolarizing it using a radio frequency (rf) field. By modulating the rf field one can observe the retarded modulation of spin polarization which depends on the relation between the modulation period and $T_1$. Using this selective spin inertia method, we unveil the strong anisotropy of $T_1$ for rare-earth Ce$^{3+}$ ions in a YAG crystal at low temperatures and low magnetic fields. We also show that the spread of Larmor frequencies within the electron ensemble in this system is not static, but results from the fluctuations of internal magnetic fields on a timescale much shorter than $T_1$.


title: Evidence for a spinon Kondo effect in cobalt atoms on single-layer 1T-TaSe$_2$

abstract: Quantum spin liquids (QSLs) are highly entangled, disordered magnetic states that arise in frustrated Mott insulators and host exotic fractional excitations such as spinons and chargons. Despite being charge insulators some QSLs are predicted to exhibit gapless itinerant spinons that yield metallic behavior in the spin channel. We have deposited isolated magnetic atoms onto single-layer (SL) 1T-TaSe$_2$, a gapless QSL candidate, to experimentally probe how itinerant spinons couple to impurity spin centers. Using scanning tunneling spectroscopy we observe the emergence of new, impurity-induced resonance peaks at the 1T-TaSe$_2$ Hubbard band edges when cobalt adatoms are positioned to have maximal spatial overlap with the Hubbard band charge distribution. These resonance peaks disappear when the spatial overlap is reduced or when the magnetic impurities are replaced with non-magnetic impurities. Theoretical simulations using a modified Anderson impurity model integrated with a gapless quantum spin liquid show that these resonance peaks are consistent with a Kondo resonance induced by spinons combined with spinon-chargon binding effects that arise due to QSL gauge-field fluctuations.


title: Improving the accuracy of hard photon emission by Sigmoid sampling of the QED-table in particle-in-cell-Monte-Carlo simulations

abstract: Research on laser-plasma interaction in the quantum-electrodynamic (QED) regime has been greatly advanced by particle-in-cell & Monte-Carlo simulations (PIC-MC). While these simulations are widely used, we find that noticeable numerical error arises due to inappropriate implementation of the quantum process accounting for hard photon emission and pair production in the PIC-MC codes. The error stems from the low resolution of the QED table used to sample photon energy, which is generated in the logarithmic scale and cannot resolve high energy photons. We propose a new sampling method via Sigmoid function that handles both the low energy and high energy end of the photon emission spectrum. It guarantees the accuracy of PIC-MC algorithms for hard photon radiation and other related processes in the strong-field QED regime.


title: Uses of Killing and Killing-Yano Tensors

abstract: In this contribution we have collected some facts about Killing and Killing-Yano tensors that we feel are of general interest for researchers working on problems that rely on differential geometry. We also include some of our recent studies pertaining to currents, charges and (super)invariants for particles and tensionless strings.


title: Coordinate rings of some $SL_2$-character varieties

abstract: We determine generators of the coordinate ring of $SL_2$-character varieties. In the case of the free group $F_3$ we obtain an explicit equation of the $SL_2$-character variety. For free groups $F_k$ we find transcendental generators. Finally, for the case of the 2-torus, we get an explicit equation of the $SL_2$-character variety and use the description to compute their E-polynomials.


title: Leveraging the Learnable Vertex-Vertex Relationship to Generalize Human Pose and Mesh Reconstruction for In-the-Wild Scenes

abstract: We present MeshLeTemp, a powerful method for 3D human pose and mesh reconstruction from a single image. In terms of human body priors encoding, we propose using a learnable template human mesh instead of a constant template as utilized by previous state-of-the-art methods. The proposed learnable template reflects not only vertex-vertex interactions but also the human pose and body shape, being able to adapt to diverse images. We conduct extensive experiments to show the generalizability of our method on unseen scenarios.


title: Saturable Purcell filter for circuit quantum electrodynamics

abstract: We consider a typical circuit QED setup where an artificial atom encodes a qubit and is dispersively coupled to a measurement resonator that in turn is coupled to a transmission line. We show theoretically that by placing another artificial atom in this transmission line to act as a filter, the Purcell decay of the qubit into the transmission line is suppressed. When strong control fields are applied in the transmission line, the filter is saturated and effectively switched off. Such a Purcell filtering capability permits both the control and measurement of the qubit using the single transmission line, while maintaining the long coherence time of the qubit in the absence of the control pulses. We show that high fidelity Pauli $\sigma_x$ gates on the qubit can be realized using simple pulse shapes. For devices that already use one transmission line both for control and measurement of the qubit, our work provides a way to completely filter out the qubit frequency without removing the possibility of controlling the system. Further, combining the proposed filter with frequency multiplexing potentially enables both control and measurement of several qubits using a single Purcell-filtered transmission line. This will enhance the scalability of superconducting quantum processors by decreasing the number of the required transmission lines.


title: Geometrically Equivariant Graph Neural Networks: A Survey

abstract: Many scientific problems require to process data in the form of geometric graphs. Unlike generic graph data, geometric graphs exhibit symmetries of translations, rotations, and/or reflections. Researchers have leveraged such inductive bias and developed geometrically equivariant Graph Neural Networks (GNNs) to better characterize the geometry and topology of geometric graphs. Despite fruitful achievements, it still lacks a survey to depict how equivariant GNNs are progressed, which in turn hinders the further development of equivariant GNNs. To this end, based on the necessary but concise mathematical preliminaries, we analyze and classify existing methods into three groups regarding how the message passing and aggregation in GNNs are represented. We also summarize the benchmarks as well as the related datasets to facilitate later researches for methodology development and experimental evaluation. The prospect for future potential directions is also provided.


title: Few-shot semantic segmentation via mask aggregation

abstract: Few-shot semantic segmentation aims to recognize novel classes with only very few labelled data. This challenging task requires mining of the relevant relationships between the query image and the support images. Previous works have typically regarded it as a pixel-wise classification problem. Therefore, various models have been designed to explore the correlation of pixels between the query image and the support images. However, they focus only on pixel-wise correspondence and ignore the overall correlation of objects. In this paper, we introduce a mask-based classification method for addressing this problem. The mask aggregation network (MANet), which is a simple mask classification model, is proposed to simultaneously generate a fixed number of masks and their probabilities of being targets. Then, the final segmentation result is obtained by aggregating all the masks according to their locations. Experiments on both the PASCAL-5^i and COCO-20^i datasets show that our method performs comparably to the state-of-the-art pixel-based methods. This competitive performance demonstrates the potential of mask classification as an alternative baseline method in few-shot semantic segmentation. Our source code will be made available at https://github.com/TinyAway/MANet.


title: Electronic Excitations of Hematite Heteroepitaxial Films Measured by Resonant Inelastic X-Ray Scattering at the Fe L-edge

abstract: Resonant Inelastic X-Ray Scattering (RIXS) spectra of hematite were measured at the Fe L3-edge for heteroepitaxial thin films which were undoped and doped with 1% Ti, Sn or Zn, in the energy loss range in excess of 1 eV to study electronic transitions. The spectra were measured for several momentum transfers (q), conducted at both low temperature (T=14K) and room temperature. While we can not rule out dispersive features possibly owing to propagating excitations, the coarse envelopes of the general spectra did not appreciably change shape with q, implying that the bulk of the observed L-edge RIXS intensity originates from (mostly) non-dispersive ligand field (LF) excitations. Summing the RIXS spectra over q and comparing the results at T=14 K to those at T=300 K, revealed pronounced temperature effects, including an intensity change and energy shift of the 1.4 eV peak, a broadband intensity increase of the 3-4 eV range, and higher energy features. The q-summed spectra and their temperature dependences are virtually identical for nearly all of the samples with different dopants, save for the temperature dependence of the Ti-doped sample's spectrum, which we attribute to being affected by a large number of free charge carriers. Comparing with magnetization measurements for different temperatures and dopings likewise did not show a clear correlation between the RIXS spectra and the magnetic ordering states. To clarify the excited states, we performed spin multiplet calculations which were in excellent agreement with the RIXS spectra over a wide energy range and provide detailed electronic descriptions of the excited states. The implications of these findings to the photoconversion efficiency of hematite photoanodes is discussed.


title: Eliciting Best Practices for Collaboration with Computational Notebooks

abstract: Despite the widespread adoption of computational notebooks, little is known about best practices for their usage in collaborative contexts. In this paper, we fill this gap by eliciting a catalog of best practices for collaborative data science with computational notebooks. With this aim, we first look for best practices through a multivocal literature review. Then, we conduct interviews with professional data scientists to assess their awareness of these best practices. Finally, we assess the adoption of best practices through the analysis of 1,380 Jupyter notebooks retrieved from the Kaggle platform. Findings reveal that experts are mostly aware of the best practices and tend to adopt them in their daily work. Nonetheless, they do not consistently follow all the recommendations as, depending on specific contexts, some are deemed unfeasible or counterproductive due to the lack of proper tool support. As such, we envision the design of notebook solutions that allow data scientists not to have to prioritize exploration and rapid prototyping over writing code of quality.


title: Long-term Causal Inference Under Persistent Confounding via Data Combination

abstract: We study the identification and estimation of long-term treatment effects when both experimental and observational data are available. Since the long-term outcome is observed only after a long delay, it is not measured in the experimental data, but only recorded in the observational data. However, both types of data include observations of some short-term outcomes. In this paper, we uniquely tackle the challenge of persistent unmeasured confounders, i.e., some unmeasured confounders that can simultaneously affect the treatment, short-term outcomes and the long-term outcome, noting that they invalidate identification strategies in previous literature. To address this challenge, we exploit the sequential structure of multiple short-term outcomes, and develop three novel identification strategies for the average long-term treatment effect. We further propose three corresponding estimators and prove their asymptotic consistency and asymptotic normality. We finally apply our methods to estimate the effect of a job training program on long-term employment using semi-synthetic data. We numerically show that our proposals outperform existing methods that fail to handle persistent confounders.