title: Same Pre-training Loss, Better Downstream: Implicit Bias Matters for Language Models

abstract: Language modeling on large-scale datasets leads to impressive performance gains on various downstream language tasks. The validation pre-training loss (or perplexity in autoregressive language modeling) is often used as the evaluation metric when developing language models since the pre-training loss tends to be well-correlated with downstream performance (which is itself difficult to evaluate comprehensively). Contrary to this conventional wisdom, this paper shows that 1) pre-training loss cannot fully explain downstream performance and 2) flatness of the model is well-correlated with downstream performance where pre-training loss is not. On simplified datasets, we identify three ways to produce models with the same (statistically optimal) pre-training loss but different downstream performance: continue pre-training after convergence, increasing the model size, and changing the training algorithm. These experiments demonstrate the existence of implicit bias of pre-training algorithms/optimizers -- among models with the same minimal pre-training loss, they implicitly prefer more transferable ones. Toward understanding this implicit bias, we prove that SGD with standard mini-batch noise implicitly prefers flatter minima in language models, and empirically observe a strong correlation between flatness and downstream performance among models with the same minimal pre-training loss. We also prove in a synthetic language setting that among the models with the minimal pre-training loss, the flattest model transfers to downstream tasks.


title: Efimovian three-body potential from broad to narrow Feshbach resonances

abstract: We analyse the change in the hyperradial Efimovian three-body potential as the two-body interaction is tuned from the broad to narrow Feshbach resonance regime. Here, it is known from both theory and experiment that the three-body dissociation scattering length $a_-$ shifts away from the universal value of $-9.7 \ r_{\mathrm{vdW}}$, with $r_{\mathrm{vdW}} = \frac{1}{2} \left(m C_6/\hbar^2 \right)^{1/4}$ the two-body van der Waals range. We model the three-body system using a separable two-body interaction that takes into account the full zero-energy behaviour of the multichannel wave function. We find that the short-range repulsive barrier in the three-body potential characteristic for single-channel models remains universal for narrow resonances, whilst the change in the three-body parameter originates from a strong decrease in the potential depth. From an analysis of the underlying spin structure we further attribute this behavior to the dominance of the two-body interaction in the resonant channel compared to other background interactions.


title: Bayesian mixture models (in)consistency for the number of clusters

abstract: Bayesian nonparametric mixture models are common for modeling complex data. While these models are well-suited for density estimation, recent results proved posterior inconsistency of the number of clusters when the true number of components is finite, for the Dirichlet process and Pitman--Yor process mixture models. We extend these results to additional Bayesian nonparametric priors such as Gibbs-type processes and finite-dimensional representations thereof. The latter include the Dirichlet multinomial process, the recently proposed Pitman-Yor, and normalized generalized gamma multinomial processes. We show that mixture models based on these processes are also inconsistent in the number of clusters and discuss possible solutions. Notably, we show that a post-processing algorithm introduced for the Dirichlet process can be extended to more general models and provides a consistent method to estimate the number of components.


title: Affine IETs with a singular conjugacy to an IET

abstract: We produce affine interval exchange transformations (AIETs) which are topologically conjugated to (standard) interval exchange maps (IETs) via a singular conjugacy, i.e. a diffeomorphism $h$ of $[0,1]$ which is $C^0$ but not $C^1$ and such that the pull-back of the Lebesgue measure is a singular invariant measure for the AIET. In particular, we show that for almost every IET $T_0$ of at least two intervals and any vector $w$ belonging to the central-stable space $E_{cs}(T_0)$ for the Rauzy-Veech renormalization, any AIET T with log-slopes given by $w$ and semi-conjugated to $T_0$ is topologically conjugated to $T$. If in addition, if $w$ does not belong to $E_s(T_0)$, the conjugacy between $T$ and $T_0$ is singular.


title: Kim-forking for hyperimaginaries in NSOP1 theories

abstract: We adapt the properties of Kim-independence in NSOP1 theories with existence proven in [5],[4] and [2] by Ramsey, Kaplan, Chernikov, Dobrowolski and Kim to hyperimaginaries by adding the assumption of existence for hyperimaginaries. We show that Kim-independence over hyperimaginaries satisfies a version of Kim's lemma, symmetry, the independence theorem, transitivity and witnessing. As applications we adapt Kim's results around colinearity and weak canonical bases from [8] to hyperimaginaries and give some new results about Lascar strong types and Kim-forking using boundedly closed hyperimaginaries.


title: pmuBAGE: The Benchmarking Assortment of Generated PMU Data for Power System Events

abstract: This paper introduces pmuGE (phasor measurement unit Generator of Events), one of the first data-driven generative model for power system event data. We have trained this model on thousands of actual events and created a dataset denoted pmuBAGE (the Benchmarking Assortment of Generated PMU Events). The dataset consists of almost 1000 instances of labeled event data to encourage benchmark evaluations on phasor measurement unit (PMU) data analytics. PMU data are challenging to obtain, especially those covering event periods. Nevertheless, power system problems have recently seen phenomenal advancements via data-driven machine learning solutions. A highly accessible standard benchmarking dataset would enable a drastic acceleration of the development of successful machine learning techniques in this field. We propose a novel learning method based on the Event Participation Decomposition of Power System Events, which makes it possible to learn a generative model of PMU data during system anomalies. The model can create highly realistic event data without compromising the differential privacy of the PMUs used to train it. The dataset is available online for any researcher or practitioner to use at the pmuBAGE Github Repository: https://github.com/NanpengYu/pmuBAGE.


title: Unit Averaging for Heterogeneous Panels

abstract: In this work we introduce a unit averaging procedure to efficiently recover unit-specific parameters in a heterogeneous panel model. The procedure consists in estimating the parameter of a given unit using a weighted average of all the unit-specific parameter estimators in the panel. The weights of the average are determined by minimizing an MSE criterion we derive. We analyze the properties of the resulting minimum MSE unit averaging estimator in a local heterogeneity framework inspired by the literature on frequentist model averaging, and we derive the local asymptotic distribution of the estimator and the corresponding weights. The benefits of the procedure are showcased with an application to forecasting unemployment rates for a panel of German regions.


title: On Flattened Parking Functions

abstract: A permutation of length $n$ is called a flattened partition if the leading terms of maximal chains of ascents (called runs) are in increasing order. We analogously define flattened parking functions: a subset of parking functions for which the leading terms of maximal chains of weak ascents (also called runs) are in weakly increasing order. For $n\leq 8$, where there are at most four runs, we give data for the number of flattened parking functions, and it remains an open problem to give formulas for their enumeration in general. We then specialize to a subset of flattened parking functions that we call $\mathcal{S}$-insertion flattened parking functions. These are obtained by inserting all numbers of a multiset $ \mathcal{S}$ whose elements are in $[n]=\{1,2,\ldots,n\}$, into a permutation of $[n]$ and checking that the result is flattened. We provide bijections between $\mathcal{S}$-insertion flattened parking functions and $\mathcal{S}'$-insertion flattened parking functions, where $\mathcal{S}$ and $\mathcal{S}'$ have certain relations. We then further specialize to the case $\mathcal{S}=\textbf{1}_r$, the multiset with $r$ ones, and we establish a bijection between $\textbf{1}_r$-insertion flattened parking functions and set partitions of $[n+r]$ with the first $r$ integers in different subsets.


title: Observation of the massive Lee-Fukuyama phason in a charge density wave insulator

abstract: The lowest-lying fundamental excitation of an incommensurate charge density wave (CDW) material is widely believed to be a massless phason -- a collective modulation of the phase of the CDW order parameter. However, as first pointed out by Lee and Fukuyama, long-range Coulomb interactions should push the phason energy up to the plasma energy of the CDW condensate, resulting in a massive phason and a fully gapped spectrum. Whether such behavior occurs in a CDW system has been unresolved for more than four decades. Using time-domain THz emission spectroscopy, we investigate this issue in the material (TaSe$_4$)$_2$I, a classical example of a quasi-one-dimensional CDW insulator. Upon transient photoexcitation at low temperatures, we find the material strikingly emits coherent, narrow-band THz radiation. The frequency, polarization and temperature-dependence of the emitted radiation imply the existence of a phason that acquires mass by coupling to long-range Coulomb interaction. Our observations constitute the first direct evidence of the massive "Lee-Fukuyama" phason and highlight the potential applicability of fundamental collective modes of correlated materials as compact and robust sources of THz radiation.


title: Don't Let Me Down! Offloading Robot VFs Up to the Cloud

abstract: Recent trends in robotic services propose offloading robot functionalities to the Edge to meet the strict latency requirements of networked robotics. However, the Edge is typically an expensive resource and sometimes the Cloud is also an option, thus, decreasing the cost. Following this idea, we propose Don't Let Me Down! (DLMD), an algorithm that promotes offloading robot functions to the Cloud when possible to minimize the consumption of Edge resources. Additionally, DLMD takes the appropriate migration, traffic steering, and radio handover decisions to meet robotic service requirements as strict latency constraints. In the paper, we formulate the optimization problem that DLMD aims to solve, compare DLMD performance against state of art, and perform stress tests to assess DLMD performance in small & large networks. Results show that DLMD (i) always finds solutions in less than 30ms; (ii) is optimal in a local warehousing use case, and (iii) consumes only 5% of the Edge resources upon network stress.


title: Kinetically limited valence of colloidal particles with surface mobile DNA linkers

abstract: We characterize the self-assembly of colloidal particles with surface mobile DNA linkers under kinetically limited valence conditions. For this, we put forward a computer simulation model that captures quantitatively the interplay between the main dynamic processes governing these systems and allows the simulation of the long time scales reached in experiments. The model is validated by direct comparison with available experimental results, showing an overall good agreement that includes measurements of the average effective valence and its probability distribution as a function of the density of DNA linkers on the particles surface. Finally, simulation results are used to evidence the opposite impact of particle density and characteristic DNA hybridization time on the effective valence.

categories: cond-mat.soft cond-mat.mes-hall cond-mat.mtrl-sci physics.chem-ph


title: MidasTouch: Monte-Carlo inference over distributions across sliding touch

abstract: We present MidasTouch, a tactile perception system for online global localization of a vision-based touch sensor sliding on an object surface. This framework takes in posed tactile images over time, and outputs an evolving distribution of sensor pose on the object's surface, without the need for visual priors. Our key insight is to estimate local surface geometry with tactile sensing, learn a compact representation for it, and disambiguate these signals over a long time horizon. The backbone of MidasTouch is a Monte-Carlo particle filter, with a measurement model based on a tactile code network learned from tactile simulation. This network, inspired by LIDAR place recognition, compactly summarizes local surface geometries. These generated codes are efficiently compared against a precomputed tactile codebook per-object, to update the pose distribution. We further release the YCB-Slide dataset of real-world and simulated forceful sliding interactions between a vision-based tactile sensor and standard YCB objects. While single-touch localization can be inherently ambiguous, we can quickly localize our sensor by traversing salient surface geometries. Project page: https://suddhu.github.io/midastouch-tactile/


title: Single-atom anchored novel two-dimensional MoSi2N4 monolayers for efficient electroreduction of CO2 to formic acid and methane

abstract: Efficient and selective CO2 electroreduction into value-added chemicals and fuels emerged as a significant approach for CO2 conversion, however, it relies on catalysts with controllable product selectivity and reaction paths. In this work, by means of first-principles calculations, we identify five catalysts (TM@MoSi2N4, TM = Sc, Ti, Fe, Co and Ni) comprising transition-metal atoms anchored on a MoSi2N4 monolayer, whose catalytic performance can be controlled by adjusting the d-band center and occupation of supported metal atoms. During CO2 reduction, the single metal atoms function as the active sites activates the MoSi2N4 inert basal-plane, and as-designed electrocatalysts exhibit excellent activity in CO2 reduction. Interestingly, HCOOH is the preferred product of CO2 reduction on the Co@MoSi2N4 catalyst with a rate-determining barrier of 0.89 eV, while the other four catalysts prefer to reduce CO2 to CH4 with a rate-determining barrier of 0.81-1.24 eV. Moreover, MoSi2N4 is an extremely-air-stable material, which will facilitate its application in various environments. Our findings provide a promising candidate with high activity, catalysts for renewable energy technologies, and selectivity for experimental work.


title: Anomalously large relaxation times in dissipative lattice models beyond the non-Hermitian skin effect

abstract: We show for generic quantum non-Hermitian tight-binding models that relaxation timescales of local observables are not controlled by the localization length $\xi_{\rm loc}$ associated with the non-Hermitian skin effect, contrary to popular belief. Instead, interference between eigenvectors effectively makes the extreme localization of modes largely irrelevant to relaxation; this is ultimately a consequence of causality and locality. Focusing on the paradigmatic Hatano-Nelson model, we demonstrate that there exists instead a much larger length scale $\xi_{\rm prop}$ which controls the rate of decay towards the steady state. Further, varying $\xi_{\rm prop}$ can lead to anomalously large relaxation times that scale with system size, or to the expected behavior where the dissipative gap correctly predicts the rate of decay. Our work highlights an important aspect of the non-Hermitian skin effect: the exceptional sensitivity to boundary conditions here necessarily takes a finite amount of time to manifest itself.


title: Deep orbital search for additional planets in the HR 8799 system

abstract: The HR 8799 system hosts four massive planets orbiting 15 and 80 AU. Studies of the system's orbital stability and its outer debris disk open the possibility of additional planets, both interior to and exterior to the known system. Reaching a sufficient sensitivity to search for interior planets is very challenging due to the combination of bright quasi static speckle noise close to the stellar diffraction core and relatively fast orbital motion. In this work, we present a deep L-band imaging campaign using NIRC2 at Keck comprising 14 observing sequences. We further re-reduce archival data for a total of 16.75 hours, one of the largest uniform datasets of a single direct imaging target. Using a Bayesian modeling technique for detecting planets in images while compensating for plausible orbital motion, we then present deep limits on the existence of additional planets in the HR 8799 system. The final combination shows a tentative candidate, consistent with 4-7 $M_{jup}$ at 4-5 AU, detected with an equivalent false alarm probability better than $3\sigma$. This analysis technique is widely applicable to archival data and to new observations from upcoming missions that revisit targets at multiple epochs.


title: Analytic continuation of harmonic sums with purely imaginary indices near the integer values

abstract: We present a simple algebraic method for the analytic continuation of harmonic sums with integer real or purely imaginary indices near negative and positive integers. We provide a MATHEMATICA code for exact expansion of harmonic sums in a small parameter near these integers. As an application, we consider the analytic continuation of the anomalous dimension of twist-1 operators in ABJM model, which contains the nested harmonic sums with purely imaginary indices. We found that in the BFKL-like limit the result has the same single-logarithmic behavior as in N=4 SYM and QCD, however, we did not find a general expression for the ``BFKL Pomeron'' eigenvalue in this model. For the slope function, we found full agreement with the expansion of the known general result and give predictions for the first three perturbative terms in the expansion of the next-to-slope function. The proposed method of analytic continuation can also be used for other generalization of the nested harmonic sums.


title: In-context Reinforcement Learning with Algorithm Distillation

abstract: We propose Algorithm Distillation (AD), a method for distilling reinforcement learning (RL) algorithms into neural networks by modeling their training histories with a causal sequence model. Algorithm Distillation treats learning to reinforcement learn as an across-episode sequential prediction problem. A dataset of learning histories is generated by a source RL algorithm, and then a causal transformer is trained by autoregressively predicting actions given their preceding learning histories as context. Unlike sequential policy prediction architectures that distill post-learning or expert sequences, AD is able to improve its policy entirely in-context without updating its network parameters. We demonstrate that AD can reinforcement learn in-context in a variety of environments with sparse rewards, combinatorial task structure, and pixel-based observations, and find that AD learns a more data-efficient RL algorithm than the one that generated the source data.


title: Estimating Boltzmann Averages for Protein Structural Quantities Using Sequential Monte Carlo

abstract: Sequential Monte Carlo (SMC) methods are widely used to draw samples from intractable target distributions. Particle degeneracy can hinder the use of SMC when the target distribution is highly constrained or multimodal. As a motivating application, we consider the problem of sampling protein structures from the Boltzmann distribution. This paper proposes a general SMC method that propagates multiple descendants for each particle, followed by resampling to maintain the desired number of particles. Simulation studies demonstrate the efficacy of the method for tackling the protein sampling problem. As a real data example, we use our method to estimate the number of atomic contacts for a key segment of the SARS-CoV-2 viral spike protein.


title: Cell dynamics in microfluidic devices under heterogeneous chemotaxis and growth conditions: a mathematical study

abstract: As motivated by studies of cellular motility driven by spatiotemporal chemotactic gradients in microdevices, we develop a framework for constructing approximate analytical solutions for the location, speed and cellular densities for cell chemotaxis waves in heterogeneous fields of chemoattractant from the underlying partial differential equation models. In particular, such chemotactic waves are not in general translationally invariant travelling waves, but possess a spatial variation that evolves in time, and may even may oscillate back and forth in time, according to the details of the chemotactic gradients. The analytical framework exploits the observation that unbiased cellular diffusive flux is typically small compared to chemotactic fluxes and is first developed and validated for a range of exemplar scenarios. The framework is subsequently applied to more complex models considering the full dynamics of the chemoattractant and how this may be driven and controlled within a microdevice by considering a range of boundary conditions. In particular, even though solutions cannot be constructed in all cases, a wide variety of scenarios can be considered analytically, firstly providing global insight into the important mechanisms and features of cell motility in complex spatiotemporal fields of chemoattractant. Such analytical solutions also provide a means of rapid evaluation of model predictions, with the prospect of application in computationally demanding investigations relating theoretical models and experimental observation, such as Bayesian parameter estimation.


title: Orbit-Superposition Dynamical Modeling of Barred Galaxies

abstract: Barred structures are important in understanding galaxy evolution, but they were not included explicitly in most dynamical models for nearby galaxies due to their complicated morphological and kinematic properties. We modify the triaxial orbit-superposition Schwarzschild implementation by Van den Bosch et al. (2008) to include barred structures explicitly. The gravitational potential is a combination of a spherical dark matter halo and stellar mass; with the 3D stellar density distribution de-projected from the observed 2D image using a two-component de-projection method, including an axisymmetric disk and a triaxial barred bulge. We consider figure rotation of the galaxy with the bar pattern speed as a free parameter. We validate the method by applying it to a mock galaxy with IFU data created from an N-body simulation with a boxy/peanut or X-shaped bar. Our model fits the observed 2D surface density and all kinematic features well. The bar pattern speed is recovered well with a relative uncertainty smaller than 10%. Based on the internal stellar orbit distribution of the model, we decompose the galaxy into an X-shaped bar, a boxy bulge, a vertically extended structure and a disk, and demonstrate that our model recovers these structures generally well, similar to the true structures in the N-body simulation. Our method provides a realistic way of modelling the bar structure explicitly for nearby barred galaxies with IFU observations.


title: Redistributor: Transforming Empirical Data Distributions

abstract: We present an algorithm and package, Redistributor, which forces a collection of scalar samples to follow a desired distribution. When given independent and identically distributed samples of some random variable $S$ and the continuous cumulative distribution function of some desired target $T$, it provably produces a consistent estimator of the transformation $R$ which satisfies $R(S)=T$ in distribution. As the distribution of $S$ or $T$ may be unknown, we also include algorithms for efficiently estimating these distributions from samples. This allows for various interesting use cases in image processing, where Redistributor serves as a remarkably simple and easy-to-use tool that is capable of producing visually appealing results. The package is implemented in Python and is optimized to efficiently handle large data sets, making it also suitable as a preprocessing step in machine learning. The source code is available at https://gitlab.com/paloha/redistributor.


title: Characterizing information loss in a chaotic double pendulum with the Information Bottleneck

abstract: A hallmark of chaotic dynamics is the loss of information with time. Although information loss is often expressed through a connection to Lyapunov exponents -- valid in the limit of high information about the system state -- this picture misses the rich spectrum of information decay across different levels of granularity. Here we show how machine learning presents new opportunities for the study of information loss in chaotic dynamics, with a double pendulum serving as a model system. We use the Information Bottleneck as a training objective for a neural network to extract information from the state of the system that is optimally predictive of the future state after a prescribed time horizon. We then decompose the optimally predictive information by distributing a bottleneck to each state variable, recovering the relative importance of the variables in determining future evolution. The framework we develop is broadly applicable to chaotic systems and pragmatic to apply, leveraging data and machine learning to monitor the limits of predictability and map out the loss of information.


title: Intrinsic Randomness in Epidemic Modelling Beyond Statistical Uncertainty

abstract: Uncertainty can be classified as either aleatoric (intrinsic randomness) or epistemic (imperfect knowledge of parameters). The majority of frameworks assessing infectious disease risk consider only epistemic uncertainty. We only ever observe a single epidemic, and therefore cannot empirically determine aleatoric uncertainty. Here, we characterise both epistemic and aleatoric uncertainty using a time-varying general branching process. Our framework explicitly decomposes aleatoric variance into mechanistic components, quantifying the contribution to uncertainty produced by each factor in the epidemic process, and how these contributions vary over time. The aleatoric variance of an outbreak is itself a renewal equation where past variance affects future variance. We find that, superspreading is not necessary for substantial uncertainty, and profound variation in outbreak size can occur even without overdispersion in the offspring distribution (i.e. the distribution of the number of secondary infections an infected person produces). Aleatoric forecasting uncertainty grows dynamically and rapidly, and so forecasting using only epistemic uncertainty is a significant underestimate. Therefore, failure to account for aleatoric uncertainty will ensure that policymakers are misled about the substantially higher true extent of potential risk. We demonstrate our method, and the extent to which potential risk is underestimated, using two historical examples.

categories: q-bio.PE math.PR math.ST stat.AP stat.TH


title: PlanT: Explainable Planning Transformers via Object-Level Representations

abstract: Planning an optimal route in a complex environment requires efficient reasoning about the surrounding scene. While human drivers prioritize important objects and ignore details not relevant to the decision, learning-based planners typically extract features from dense, high-dimensional grid representations containing all vehicle and road context information. In this paper, we propose PlanT, a novel approach for planning in the context of self-driving that uses a standard transformer architecture. PlanT is based on imitation learning with a compact object-level input representation. On the Longest6 benchmark for CARLA, PlanT outperforms all prior methods (matching the driving score of the expert) while being 5.3x faster than equivalent pixel-based planning baselines during inference. Combining PlanT with an off-the-shelf perception module provides a sensor-based driving system that is more than 10 points better in terms of driving score than the existing state of the art. Furthermore, we propose an evaluation protocol to quantify the ability of planners to identify relevant objects, providing insights regarding their decision-making. Our results indicate that PlanT can focus on the most relevant object in the scene, even when this object is geometrically distant.


title: Towards improved loading, cooling, and trapping of molecules in magneto-optical traps

abstract: Recent experiments have demonstrated direct cooling and trapping of diatomic and triatomic molecules in magneto-optical traps (MOTs). However, even the best molecular MOTs to date still have density $10^{-5}$ times smaller than in typical atomic MOTs. The main limiting factors are: (i) inefficiencies in slowing molecules to velocities low enough to be captured by the MOT, (ii) low MOT capture velocities, and (iii) limits on density within the MOT resulting from sub-Doppler heating~[J. A. Devlin and M. R. Tarbutt, Phys. Rev. A \textbf{90}, 063415 (2018)]. All of these are consequences of the need to drive `Type-II' optical cycling transitions, where dark states appear in Zeeman sublevels, in order to avoid rotational branching. We present simulations demonstrating ways to mitigate each of these limitations. This should pave the way towards loading molecules into conservative traps with sufficiently high density and number to evaporatively cool them to quantum degeneracy.


title: Crafting the dynamical structure of synchronization by harnessing bosonic multilevel cavity QED

abstract: Many-body cavity QED experiments are established platforms to tailor and control the collective responses of ensembles of atoms, interacting through one or more common photonic modes. The rich diversity of dynamical phases they can host, calls for a unified framework. Here we commence this program by showing that a cavity QED simulator assembled from $N$-levels bosonic atoms, can reproduce and extend the possible dynamical responses of collective observables occurring after a quench. Specifically, by initializing the atoms in classical or quantum states, or by leveraging intra-levels quantum correlations, we craft on demand the entire synchronization/desynchronization dynamical crossover of an exchange model for $SU(N)$ spins. We quantitatively predict the onset of different dynamical responses by combining the Liouville-Arnold theorem on classical integrability with an ansatz for reducing the collective evolution to an effective few-body dynamics. Among them, we discover a synchronized chaotic phase induced by quantum correlations and associated to a first order non-equilibrium transition in the Lyapunov exponent of collective atomic dynamics. Our outreach includes extensions to other spin-exchange quantum simulators and a universal conjecture for the dynamical reduction of non-integrable all-to-all interacting systems.


title: Flexible Android Malware Detection Model based on Generative Adversarial Networks with Code Tensor

abstract: The behavior of malware threats is gradually increasing, heightened the need for malware detection. However, existing malware detection methods only target at the existing malicious samples, the detection of fresh malicious code and variants of malicious code is limited. In this paper, we propose a novel scheme that detects malware and its variants efficiently. Based on the idea of the generative adversarial networks (GANs), we obtain the `true' sample distribution that satisfies the characteristics of the real malware, use them to deceive the discriminator, thus achieve the defense against malicious code attacks and improve malware detection. Firstly, a new Android malware APK to image texture feature extraction segmentation method is proposed, which is called segment self-growing texture segmentation algorithm. Secondly, tensor singular value decomposition (tSVD) based on the low-tubal rank transforms malicious features with different sizes into a fixed third-order tensor uniformly, which is entered into the neural network for training and learning. Finally, a flexible Android malware detection model based on GANs with code tensor (MTFD-GANs) is proposed. Experiments show that the proposed model can generally surpass the traditional malware detection model, with a maximum improvement efficiency of 41.6\%. At the same time, the newly generated samples of the GANs generator greatly enrich the sample diversity. And retraining malware detector can effectively improve the detection efficiency and robustness of traditional models.


title: FedClassAvg: Local Representation Learning for Personalized Federated Learning on Heterogeneous Neural Networks

abstract: Personalized federated learning is aimed at allowing numerous clients to train personalized models while participating in collaborative training in a communication-efficient manner without exchanging private data. However, many personalized federated learning algorithms assume that clients have the same neural network architecture, and those for heterogeneous models remain understudied. In this study, we propose a novel personalized federated learning method called federated classifier averaging (FedClassAvg). Deep neural networks for supervised learning tasks consist of feature extractor and classifier layers. FedClassAvg aggregates classifier weights as an agreement on decision boundaries on feature spaces so that clients with not independently and identically distributed (non-iid) data can learn about scarce labels. In addition, local feature representation learning is applied to stabilize the decision boundaries and improve the local feature extraction capabilities for clients. While the existing methods require the collection of auxiliary data or model weights to generate a counterpart, FedClassAvg only requires clients to communicate with a couple of fully connected layers, which is highly communication-efficient. Moreover, FedClassAvg does not require extra optimization problems such as knowledge transfer, which requires intensive computation overhead. We evaluated FedClassAvg through extensive experiments and demonstrated it outperforms the current state-of-the-art algorithms on heterogeneous personalized federated learning tasks.


title: The Interactive Modeling of a Binary Star System

abstract: An interactive binary star system simulation was developed to be showcased on an educational platform. The main purpose of the project is to provide insight into the orbital mechanics of such star systems with the help of a three-body simulation. The initial simulation script was written in the Python programming language with the help of the VPython addition. The custom-made models were created on Blender and exported. For the final implementation of the simulation on the Godot game engine, the Python code was converted into GDScript and the Blender models were re-textured.


title: 'A net for everyone': fully personalized and unsupervised neural networks trained with longitudinal data from a single patient

abstract: With the rise in importance of personalized medicine, we trained personalized neural networks to detect tumor progression in longitudinal datasets. The model was evaluated on two datasets with a total of 64 scans from 32 patients diagnosed with glioblastoma multiforme (GBM). Contrast-enhanced T1w sequences of brain magnetic resonance imaging (MRI) images were used in this study. For each patient, we trained their own neural network using just two images from different timepoints. Our approach uses a Wasserstein-GAN (generative adversarial network), an unsupervised network architecture, to map the differences between the two images. Using this map, the change in tumor volume can be evaluated. Due to the combination of data augmentation and the network architecture, co-registration of the two images is not needed. Furthermore, we do not rely on any additional training data, (manual) annotations or pre-training neural networks. The model received an AUC-score of 0.87 for tumor change. We also introduced a modified RANO criteria, for which an accuracy of 66% can be achieved. We show that using data from just one patient can be used to train deep neural networks to monitor tumor change.


title: Causal Information Bottleneck Boosts Adversarial Robustness of Deep Neural Network

abstract: The information bottleneck (IB) method is a feasible defense solution against adversarial attacks in deep learning. However, this method suffers from the spurious correlation, which leads to the limitation of its further improvement of adversarial robustness. In this paper, we incorporate the causal inference into the IB framework to alleviate such a problem. Specifically, we divide the features obtained by the IB method into robust features (content information) and non-robust features (style information) via the instrumental variables to estimate the causal effects. With the utilization of such a framework, the influence of non-robust features could be mitigated to strengthen the adversarial robustness. We make an analysis of the effectiveness of our proposed method. The extensive experiments in MNIST, FashionMNIST, and CIFAR-10 show that our method exhibits the considerable robustness against multiple adversarial attacks. Our code would be released.


title: A multiplicity result for critical elliptic problems involving differences of local and nonlocal operators

abstract: We study some critical elliptic problems involving the difference of two nonlocal operators, or the difference of a local operator and a nonlocal operator. The main result is the existence of two nontrivial weak solutions, one with negative energy and the other with positive energy, for all sufficiently small values of a parameter. The proof is based on an abstract result recently obtained in [20].


title: NAS-PRNet: Neural Architecture Search generated Phase Retrieval Net for Off-axis Quantitative Phase Imaging

abstract: Single neural networks have achieved simultaneous phase retrieval with aberration compensation and phase unwrapping in off-axis Quantitative Phase Imaging (QPI). However, when designing the phase retrieval neural network architecture, the trade-off between computation latency and accuracy has been largely neglected. Here, we propose Neural Architecture Search (NAS) generated Phase Retrieval Net (NAS-PRNet), which is an encoder-decoder style neural network, automatically found from a large neural network architecture search space. The NAS scheme in NAS-PRNet is modified from SparseMask, in which the learning of skip connections between the encoder and the decoder is formulated as a differentiable NAS problem, and the gradient decent is applied to efficiently search the optimal skip connections. Using MobileNet-v2 as the encoder and a synthesized loss that incorporates phase reconstruction and network sparsity losses, NAS-PRNet has realized fast and accurate phase retrieval of biological cells. When tested on a cell dataset, NAS-PRNet has achieved a Peak Signal-to-Noise Ratio (PSNR) of 36.1 dB, outperforming the widely used U-Net and original SparseMask-generated neural network. Notably, the computation latency of NAS-PRNet is only 31 ms which is 12 times less than U-Net. Moreover, the connectivity scheme in NAS-PRNet, identified from one off-axis QPI system, can be well fitted to another with different fringe patterns.


title: Constraining Cosmic-ray Transport with Observations of the Circumgalactic Medium

abstract: Recent theoretical studies predict that the circumgalactic medium (CGM) around low-redshift, $\sim L_*$ galaxies could have substantial nonthermal pressure support in the form of cosmic rays. However, these predictions are sensitive to the specific model of cosmic-ray transport employed, which is theoretically and observationally underconstrained. In this work, we propose a novel observational constraint for calculating the lower limit of the radially-averaged, effective cosmic-ray transport rate, $\kappa_{\rm min}^{\rm eff}$. Under a wide range of assumptions (so long as cosmic rays do not lose a significant fraction of their energy in the galactic disk, regardless of whether the cosmic-ray pressure is important or not in the CGM), we demonstrate a well-defined relationship between $\kappa_{\rm min}^{\rm eff}$ and three observable galaxy properties: the total hydrogen column density, the average star formation rate, and the gas circular velocity. We use a suite of FIRE-2 galaxy simulations with a variety of cosmic-ray transport physics to demonstrate that our analytic model of $\kappa_{\rm min}^{\rm eff}$ is a robust lower limit of the true cosmic-ray transport rate. We then apply our new model to calculate $\kappa_{\rm min}^{\rm eff}$ for galaxies in the COS-Halos sample, and confirm this already reveals strong evidence for an effective transport rate which rises rapidly away from the interstellar medium to values $\kappa_{\rm min}^{\rm eff}\gtrsim 10^{30-31}\,{\rm cm}^2\,{\rm s}^{-1}$ (corresponding to anisotropic streaming velocities of $v^{\rm stream}_{\rm eff} \gtrsim 1000\,{\rm km}\,{\rm s}^{-1}$) in the diffuse CGM, at impact parameters larger than $50-100$\,kpc. We discuss how future observations can provide qualitatively new constraints in our understanding of cosmic rays in the CGM and intergalactic medium.


title: ELVES IV: The Satellite Stellar-to-Halo Mass Relation Beyond the Milky-Way

abstract: Quantifying the connection between galaxies and their host dark matter halos has been key for testing cosmological models on various scales. Below $M_\star \sim 10^9\,M_\odot$, such studies have primarily relied on the satellite galaxy population orbiting the Milky Way. Here we present new constraints on the connection between satellite galaxies and their host dark matter subhalos using the largest sample of satellite galaxies in the Local Volume ($D \lesssim 12\,\mathrm{Mpc}$) to date. We use $250$ confirmed and $71$ candidate dwarf satellites around 27 Milky Way (MW)-like hosts from the Exploration of Local VolumE Satellites (ELVES) Survey and use the semi-analytical SatGen model for predicting the population of dark matter subhalos expected in the same volume. Through a Bayesian model comparison of the observed and the forward-modeled satellite stellar mass functions (SSMF), we infer the satellite stellar-to-halo mass relation. We find that the observed SSMF is best reproduced when subhalos at the low mass end are populated by a relation of the form $M_\star \propto M^\alpha_\mathrm{peak}$, with a moderate slope of $\alpha_\mathrm{const}=2.10 \pm 0.01$ and a low scatter, constant as a function of the peak halo mass, of $\sigma_\mathrm{const}=0.06^{+0.07}_{-0.05}$. A model with a steeper slope ($\alpha_\mathrm{grow}=2.39 \pm 0.06$) and a scatter that grows with decreasing $M_\mathrm{peak}$ is also consistent with the observed SSMF but is not required. Our new model for the satellite-subhalo connection, based on hundreds of Local Volume satellite galaxies, is in line with what was previously derived using only the Milky Way satellites.


title: A novel approach to correcting $T_e$-based mass-metallicity relations

abstract: Deriving oxygen abundances from the electron temperature (hereafter the $T_e$-method) is the gold-standard for extragalactic metallicity studies. However, unresolved temperature fluctuations within individual HII regions and across different HII regions throughout a galaxy can bias metallicity estimates low, with a magnitude that depends on the underlying and typically unknown temperature distribution. Using a toy model, we confirm that computing $T_e$-based metallicities using the temperature derived from the [O III] $\lambda$4363/$\lambda$5007 or [O II] $\lambda\lambda$7320,7330 / [O II] $\lambda\lambda$3727 ratio ('ratio temperature'; $T_{\rm ratio}$) results in an underprediction of metallicity when temperature fluctuations are present. In contrast, using the unobservable 'line temperatures' ($T_{\rm line}$) that provide the mean electron and ion density-weighted emissivity yield an accurate metallicity estimate. To correct this bias in low-mass galaxies, we demonstrate an example calibration of a relation between T_ratio and T_line based on a high-resolution (4.5 pc) RAMSES-RTZ simulation of a dwarf galaxy that self-consistently models the formation of multiple HII regions and ion temperature distribution in a galactic context. Applying this correction to the low-mass end of the mass-metallicity relation shifts its normalization up by 0.18 dex on average and flattens its slope from 0.87 to 0.58, highlighting the need for future studies to account for, and correct, this bias.


title: The Stellar Chemical Abundances of Simulated Massive Galaxies at $z = 2$

abstract: We analyze the stellar abundances of massive galaxies ($\log M_\ast/M_\odot>10.5$) at $z=2$ in the IllustrisTNG simulation with the goal of guiding the interpretation of current and future observations, particularly from the James Webb Space Telescope. We find that the effective size, $R_e$, of galaxies strongly affects the abundance measurements: both [Mg/H] and [Fe/H] are anti-correlated with $R_e$, while the relative abundance [Mg/Fe] slightly increases with $R_e$. The $\alpha$ enhancement as tracked by [Mg/Fe] traces the formation timescale of a galaxy weakly, and mostly depends on $R_e$. Aperture effects are important: measuring the stellar abundances within 1~kpc instead of within $R_e$ can make a large difference. These results are all due to a nearly universal, steeply declining stellar abundance profile that does not scale with galaxy size -- small galaxies appear metal-rich because their stars live in the inner part of the profile where abundances are high. The slope of this profile is mostly set by the gas-phase abundance profile and not substantially modified by stellar age gradients. The gas-phase abundance profile, in turn, is determined by the strong radial dependence of the gas fraction and star formation efficiency. We develop a simple model to describe the chemical enrichment, in which each radial bin of a galaxy is treated as an independent closed-box system. This model reproduces the gas-phase abundance profile of simulated galaxies, but not the detailed distribution of their stellar abundances, for which gas and/or metal transport are likely needed.


title: Bipolaronic superconductivity out of a Coulomb gas

abstract: Employing unbiased sign-problem-free quantum Monte Carlo, we investigate the effects of long-range Coulomb forces on BEC of bipolarons using a model of bond phonon-modulated electron hopping. In absence of long-range repulsion, this model was recently shown to give rise to small-size, light-mass bipolarons that undergo a superfluid transition at high values of the critical transition temperature $T_\mathrm{c}$. We find that $T_\mathrm{c}$ in our model even with the long-range Coulomb repulsion remains much larger than that of Holstein bipolarons, and can be on the order of or greater than the typical upper bounds on phonon-mediated $T_\mathrm{c}$ based on the Migdal-Eliashberg and McMillan approximations. Our work points to a physically simple mechanism for superconductivity in the low-density regime that may be relevant to current experiments on dilute superconductors.


title: ELVES III: Environmental Quenching by Milky Way-Mass Hosts

abstract: Isolated dwarf galaxies usually exhibit robust star formation but satellite dwarf galaxies are often devoid of young stars, even in Milky Way-mass groups. Dwarf galaxies thus offer an important laboratory of the environmental processes that cease star formation. We explore the balance of quiescent and star-forming galaxies (quenched fractions) for a sample of ~400 satellite galaxies around 30 Local Volume hosts from the Exploration of Local VolumE Satellites (ELVES) Survey. We present quenched fractions as a function of satellite stellar mass, projected radius, and host halo mass, to conclude that overall, the quenched fractions are similar to the Milky Way, dropping below 50% at satellite M* ~ 10^8 M_sun. We may see hints that quenching is less efficient at larger radius. Through comparison with the semi-analytic modeling code satgen, we are also able to infer average quenching times as a function of satellite mass in host halo-mass bins. There is a gradual increase in quenching time with satellite stellar mass rather than the abrupt change from rapid to slow quenching that has been inferred for the Milky Way. We also generally infer longer average quenching times than recent hydrodynamical simulations. Our results are consistent with models that suggest a wide range of quenching times are possible via ram-pressure stripping, depending on the clumpiness of the circumgalactic medium, the orbits of the satellites, and the degree of earlier preprocessing.


title: Light Strings and Strong Coupling in F-theory

abstract: We consider 4d N=1 theories arising from F-theory compactifications on elliptically-fibered Calabi-Yau four-folds and investigate the non-perturbative structure of their scalar field space beyond the large volume/large complex structure regime. We focus on regimes where the F-theory field space effectively reduces to the deformation space of the worldsheet theory of a critical string obtained from a wrapped D3-brane. In case that this critical string is a heterotic string with a simple GLSM description, we identify new strong coupling singularities in the interior of the F-theory field space. Whereas from the perturbative perspective these singularities manifest themselves through a breakdown of the perturbative $\alpha'$-expansion, the dual GLSM perspective reveals that at the non-perturbative level these singularities correspond to loci in field space along which the worldsheet theory of the critical D3-brane string breaks down and a 7-brane gauge theory becomes strongly coupled due to quantum effects. Therefore these singularities signal a transition to a strong coupling phase in the F-theory field space which can be shown to arise due to the failure of the F-theory field space to factorize between complex structure and Kahler sector at the quantum level. Such singularities are hence a feature of a genuine N=1 theory without a direct counterpart in N=2 theories in 4d. By relating our setup to recent studies of global string solutions associated to axionic strings we argue that the D3-brane string dual to the perturbative heterotic string leaves the spectrum of BPS strings when traversing into the strong coupling phase. The absence of the perturbative, critical heterotic string then provides a physical explanation for the breakdown of the perturbative expansion and the obstruction of certain classical infinite distance limits in accordance with the Emergent String Conjecture.


title: Precision Redshift-Space Galaxy Power Spectra using Zel'dovich Control Variates

abstract: Numerical simulations in cosmology require trade-offs between volume, resolution and run-time that limit the volume of the Universe that can be simulated, leading to sample variance in predictions of ensemble-average quantities such as the power spectrum or correlation function(s). Sample variance is particularly acute at large scales, which is also where analytic techniques can be highly reliable. This provides an opportunity to combine analytic and numerical techniques in a principled way to improve the dynamic range and reliability of predictions for clustering statistics. In this paper we extend the technique of Zel'dovich control variates, previously demonstrated for 2-point functions in real space, to reduce the sample variance in measurements of 2-point statistics of biased tracers in redshift space. We demonstrate that with this technique, we can reduce the sample variance of these statistics down to their shot-noise limit out to $k \sim 0.2\, h\rm Mpc^{-1}$. This allows a better matching with perturbative models and improved predictions for the clustering of e.g.~quasars, galaxies and neutral Hydrogen measured in spectroscopic redshift surveys at very modest computational expense. We discuss the implementation of ZCV, give some examples and provide forecasts for the efficacy of the method under various conditions.


title: A new quantization principle from a minimally non time-ordered product

abstract: We formulate a new quantization principle for perturbative quantum field theory, based on a minimally non time-ordered product, and show that it gives the theories of physical particles and purely virtual particles. Given a classical Lagrangian, the quantization proceeds as usual, guided by the time-ordered product, up to the common scattering matrix $S$, which satisfies a unitarity or a pseudounitarity equation. The physical scattering matrix $S_{\text{ph}}$ is built from $S$, by gluing $S$ diagrams together into new diagrams, through non time-ordered propagators. We classify the most general way to gain unitarity by means of such operations, and point out that a special solution "minimizes" the time-ordering violation. We show that the scattering matrix $S_{\text{ph}}$ given by this solution coincides with the one obtained by turning the would-be ghosts (and possibly some would-be physical particles) into purely virtual particles (fakeons). We study tricks to descend and ascend in a unique way among diagrams, and illustrate them in several examples: the ascending chain from the bubble to the hexagon, at one loop; the box with diagonal, at two loops; other diagrams, with more loops.


title: Tree-level amplitudes from the pure spinor superstring

abstract: We give a comprehensive review of recent developments on using the pure spinor formalism to compute massless superstring scattering amplitudes at tree level. The main results of the pure spinor computations are placed into the context of related topics including the color-kinematics duality in field theory and the mathematical structure of $\alpha'$-corrections.


title: Scrambling Transition in a Radiative Random Unitary Circuit

abstract: We study quantum information scrambling in a random unitary circuit that exchanges qubits with an environment at a rate $p$. As a result, initially localized quantum information not only spreads within the system, but also spills into the environment. Using the out-of-time-order correlator (OTOC) to characterize scrambling, we find a nonequilibrium phase transition in the directed percolation universality class at a critical swap rate $p_c$: for $p < p_c$ the ensemble-averaged OTOC exhibits ballistic growth with a tunable light cone velocity, while for $p > p_c$ the OTOC fails to percolate within the system and vanishes uniformly within a finite timescale, indicating that all local operators are rapidly swapped into the environment. To elucidate its information-theoretic consequences, we demonstrate that the transition in operator spreading coincides with a transition in an observer's ability to decode the system's initial quantum information from the swapped-out, or "radiated," qubits. We present a simple decoding scheme which recovers the system's initial information with perfect fidelity in the nonpercolating phase, and with continuously decreasing fidelity with decreasing swap rate in the percolating phase. Depending on the initial state of the swapped-in qubits, we further observe a corresponding entanglement transition in the coherent information from the system into the radiated qubits.

categories: quant-ph cond-mat.dis-nn cond-mat.stat-mech hep-th


title: Secondary GeV-TeV emission from ultra-high-energy cosmic rays accelerated by GRB 221009A

abstract: The origin of ultra-high-energy cosmic rays (UHECRs) remains elusive. Gamma-ray bursts (GRBs) are among the best candidates able to meet the stringent energy requirements needed for particle acceleration to such high energies. If UHECRs were accelerated by the central engine of GRB 221009A, it might be possible to detect secondary photons and neutrinos as the UHECRs travel from the source to the Earth. Here we attempt to interpret some of the early publicly available data connected to this burst. If the reported early GeV-TeV detection was produced by secondary emission from UHECRs it probably indicates that UHECRs reached energies $> 10^{21}$ eV and that GRB 221009A exploded inside a magnetic void with intergalactic magnetic field (IGMF) strength $B \leq 3 \times 10^{-16}$ G. In order to understand the entire energy deposition mechanism, we propose to search existing and future Fermi-LAT data for secondary emission arriving over larger spatial scales and longer time-scales. This strategy might help clarify the origin of UHECRs, constrain the intergalactic magnetic field (IGMF) strength along this line of sight and start to quantify the fraction of magnetic voids around GRBs.


title: Bars and boxy/peanut bulges in thin and thick discs. II. Can bars form in hot thick discs?

abstract: The Milky Way as well as a majority of external galaxies possess a thick disc. However, the dynamical role of the (geometrically) thick disc on the bar formation and evolution is not fully understood. Here, we investigate the effect of thick discs in bar formation and evolution by means of a suite of N-body models of (kinematically cold) thin-(kinematically hot) thick discs. We systematically vary the mass fraction of the thick disc, the thin-to-thick disc scale length ratio as well as thick disc's scale height to examine the bar formation under diverse dynamical scenarios. Bars form almost always in our models, even in presence of a massive thick disc. The part of the bar constituted by the thick disc closely follows the overall growth and temporal evolution of the part of the bar constituted by the thin disc, only the part of the bar in the thick disc is weaker than the part of the bar in the thin disc. The formation of stronger bars is associated with a simultaneous larger loss of angular momentum and a larger radial heating. In addition, we demonstrate a preferential loss of angular momentum and a preferential radial heating of disc stars, along the azimuthal direction within the extent of the bar, in both thin and thick disc stars. For purely thick disc models (without any thin disc), the bar formation critically depends on the disc scale length and scale height. A larger scale length and/or a larger vertical scale height delays the bar formation time and/or suppresses the bar formation almost completely in thick-disc-only models. We find that the Ostriker-Peeble criterion predicts the bar instability scenarios in our models better than the Efstathiou-Lake-Negroponte criterion.


title: CaloFlow for CaloChallenge Dataset 1

abstract: CaloFlow is a new and promising approach to fast calorimeter simulation based on normalizing flows. Applying CaloFlow to the photon and charged pion Geant4 showers of Dataset 1 of the Fast Calorimeter Simulation Challenge 2022, we show how it can produce high-fidelity samples with a sampling time that is several orders of magnitude faster than Geant4. We demonstrate the fidelity of the samples using calorimeter shower images, histograms of high-level features, and aggregate metrics such as a classifier trained to distinguish CaloFlow from Geant4 samples.

categories: physics.ins-det cs.LG hep-ex hep-ph physics.data-an


title: Friction on ALP domain walls and gravitational waves

abstract: We study the early Universe evolution of axion-like particle (ALP) domain walls taking into account the effect of friction from particles in the surrounding plasma, including the case of particles in thermal equilibrium and frozen out species. We characterize the friction force from interactions within the ALP effective theory, providing new results for the fermion contribution as well as identifying simple conditions for friction to be relevant during the domain wall life time. When friction dominates, the domain wall network departs from the standard scaling regime and the corresponding gravitational wave emission is affected. As a relevant example, we show how this can be the case for ALP domain walls emitting at the typical frequencies of Pulsar Timing Array experiments, when the ALP couples to the SM leptons. We then move to a general exploration of the gravitational wave prospects in the ALP parameter space. We finally illustrate how the gravitational wave signal from ALP domain walls is correlated with the quality of the underlying $U(1)$ symmetry.


title: Two-parameter sums signatures and corresponding quasisymmetric functions

abstract: Quasisymmetric functions have recently been used in time series analysis as polynomial features that are invariant under, so-called, dynamic time warping. We extend this notion to data indexed by two parameters and thus provide warping invariants for images. We show that two-parameter quasisymmetric functions are complete in a certain sense, and provide a two-parameter quasi-shuffle identity. A compatible coproduct is based on diagonal concatenation of the input data, leading to a (weak) form of Chen's identity.


title: CP-odd and CP-even Weak-Basis Invariants in the Presence of Vector-Like Quarks

abstract: We propose a minimal set of weak-basis invariants in an extension of the SM where one up-type isosinglet vector-like quark is introduced, which allows us to obtain all the physical content of the CKM matrix. We present CP-odd invariants of lower order in mass than the one in the SM, which may have important consequences for Baryogenesis. We study the extreme chiral limit, where the two lightest generations have vanishing mass, showing that in this extension, contrary to the SM, CP violation can be observed in collisions much above the electroweak scale.


title: How to Interpret Measurements of Diffuse Light in Stacked Observations of Groups and Clusters of Galaxies

abstract: The diffuse light within galaxy groups and clusters provides valuable insight into the growth of massive cosmic structures. Groups are particularly interesting in this context, because they represent the link between galactic haloes and massive clusters. However, low surface brightness makes their diffuse light extremely challenging to detect individually. Stacking many groups is a promising alternative, but its physical interpretation is complicated by possible systematic variations of diffuse light profiles with other group properties. Another issue is the often ambiguous choice of group centre. We explore these challenges using mock observations for 497 galaxy groups and clusters with halo masses from $~ 10^{12} \textrm{M}_{\odot}$ to $1.5 \times 10^{15}\textrm{M}_{\odot}$ at redshift $0.1$ from the Hydrangea cosmological hydrodynamic simulations. In 18 per cent of groups with at least five galaxies above $10^{9} \textrm{M}_{\odot}$ in stellar mass, the $r$-band brightest galaxy is not the one at the centre of the gravitational potential; line-of-sight projections account for half of these cases. Miscentring does not significantly affect the ensemble average mass density profile or the surface brightness profile for our sample: even within ambiguously centred haloes, different centring choices lead to only a 1 per cent change in the total fraction of diffuse intra-group light, $f_{\textrm{IGL}}$. We find strong correlations of $f_{\textrm{IGL}}$ with the luminosity of the central group galaxy and halo mass. Stacking groups in narrow bins of central galaxy luminosity will therefore make the physical interpretation of the signal more straightforward than combining systems across a wide range of mass.


title: Exploring Document-Level Literary Machine Translation with Parallel Paragraphs from World Literature

abstract: Literary translation is a culturally significant task, but it is bottlenecked by the small number of qualified literary translators relative to the many untranslated works published around the world. Machine translation (MT) holds potential to complement the work of human translators by improving both training procedures and their overall efficiency. Literary translation is less constrained than more traditional MT settings since translators must balance meaning equivalence, readability, and critical interpretability in the target language. This property, along with the complex discourse-level context present in literary texts, also makes literary MT more challenging to computationally model and evaluate. To explore this task, we collect a dataset (Par3) of non-English language novels in the public domain, each aligned at the paragraph level to both human and automatic English translations. Using Par3, we discover that expert literary translators prefer reference human translations over machine-translated paragraphs at a rate of 84%, while state-of-the-art automatic MT metrics do not correlate with those preferences. The experts note that MT outputs contain not only mistranslations, but also discourse-disrupting errors and stylistic inconsistencies. To address these problems, we train a post-editing model whose output is preferred over normal MT output at a rate of 69% by experts. We publicly release Par3 at https://github.com/katherinethai/par3/ to spur future research into literary MT.


title: Ingredients for Generalized Models of $\kappa$-Phase Organic Charge-Transfer Salts: A Review

abstract: The families of organic charge-transfer salts $\kappa$-(BEDT-TTF)$_2X$ and $\kappa$-(BETS)$_2X$ have proven to serve as a powerful playground for the investigation of the physics of frustrated Mott insulators. These materials have been ascribed model character, since dimerization of the organic molecules allows to map these materials onto a single band Hubbard model, in which the dimers reside on an anisotropic triangular lattice. By changing the inorganic unit $X$ or applying physical pressure, the correlation strength and anisotropy of the triangular lattice can be varied. This has lead to the discovery of a variety of exotic phenomena, including quantum spin liquid states, a plethora of long-range magnetic orders in proximity to a Mott metal-insulator transition, and unconventional superconductivity. While many of these phenomena can be described within this effective one-band Hubbard model on a triangular lattice, it became evident in recent years that this simplified description is insufficient to capture all observed magnetic and electronic properties. The ingredients for generalized models that are relevant include, but are not limited to, spin-orbit coupling, intra-dimer charge and spin degrees of freedom, electron-lattice coupling, as well as disorder effects. Here, we review selected theoretical and experimental discoveries that clearly demonstrate the relevance thereof. At the same time, we outline that these aspects are not only relevant to this class of organic charge-transfer salts, but are also receiving increasing attention in other classes of inorganic strongly correlated electron systems. This reinforces the model character that the $\kappa$-phase organic charge-transfer salts have for understanding and discovering novel phenomena in strongly correlated electron systems from a theoretical and experimental point of view.


title: Dynamic Speech Endpoint Detection with Regression Targets

abstract: Interactive voice assistants have been widely used as input interfaces in various scenarios, e.g. on smart homes devices, wearables and on AR devices. Detecting the end of a speech query, i.e. speech end-pointing, is an important task for voice assistants to interact with users. Traditionally, speech end-pointing is based on pure classification methods along with arbitrary binary targets. In this paper, we propose a novel regression-based speech end-pointing model, which enables an end-pointer to adjust its detection behavior based on context of user queries. Specifically, we present a pause modeling method and show its effectiveness for dynamic end-pointing. Based on our experiments with vendor-collected smartphone and wearables speech queries, our strategy shows a better trade-off between endpointing latency and accuracy, compared to the traditional classification-based method. We further discuss the benefits of this model and generalization of the framework in the paper.


title: Classification and Self-Supervised Regression of Arrhythmic ECG Signals Using Convolutional Neural Networks

abstract: Interpretation of electrocardiography (ECG) signals is required for diagnosing cardiac arrhythmia. Recently, machine learning techniques have been applied for automated computer-aided diagnosis. Machine learning tasks can be divided into regression and classification. Regression can be used for noise and artifacts removal as well as resolve issues of missing data from low sampling frequency. Classification task concerns the prediction of output diagnostic classes according to expert-labeled input classes. In this work, we propose a deep neural network model capable of solving regression and classification tasks. Moreover, we combined the two approaches, using unlabeled and labeled data, to train the model. We tested the model on the MIT-BIH Arrhythmia database. Our method showed high effectiveness in detecting cardiac arrhythmia based on modified Lead II ECG records, as well as achieved high quality of ECG signal approximation. For the former, our method attained overall accuracy of 87:33% and balanced accuracy of 80:54%, on par with reference approaches. For the latter, application of self-supervised learning allowed for training without the need for expert labels. The regression model yielded satisfactory performance with fairly accurate prediction of QRS complexes. Transferring knowledge from regression to the classification task, our method attained higher overall accuracy of 87:78%.


title: Leveraging Open Data and Task Augmentation to Automated Behavioral Coding of Psychotherapy Conversations in Low-Resource Scenarios

abstract: In psychotherapy interactions, the quality of a session is assessed by codifying the communicative behaviors of participants during the conversation through manual observation and annotation. Developing computational approaches for automated behavioral coding can reduce the burden on human coders and facilitate the objective evaluation of the intervention. In the real world, however, implementing such algorithms is associated with data sparsity challenges since privacy concerns lead to limited available in-domain data. In this paper, we leverage a publicly available conversation-based dataset and transfer knowledge to the low-resource behavioral coding task by performing an intermediate language model training via meta-learning. We introduce a task augmentation method to produce a large number of "analogy tasks" - tasks similar to the target one - and demonstrate that the proposed framework predicts target behaviors more accurately than all the other baseline models.


title: Time-reversal symmetries and equilibrium-like Langevin equations

abstract: Graham has shown in Z. Physik B 26, 397-405 (1977) that a fluctuation-dissipation relation can be imposed on a class of non-equilibrium Markovian Langevin equations that admit a stationary solution of the corresponding Fokker-Planck equation. The resulting equilibrium form of the Langevin equation is associated with a nonequilibrium Hamiltonian. Here we provide some explicit insight into how this Hamiltonian may loose its time reversal invariance and how the "reactive" and "dissipative" fluxes loose their distinct time reversal symmetries. The antisymmetric coupling matrix between forces and fluxes no longer originates from Poisson brackets and the "reactive" fluxes contribute to the ("housekeeping") entropy production, in the steady state. The time-reversal even and odd parts of the nonequilibrium Hamiltonian contribute in qualitatively different but physically instructive ways to the entropy. We find instances where fluctuations due to noise are solely responsible for the dissipation. Finally, this structure gives rise to a new, physically pertinent instance of frenesy.


title: Observation of Giant Orbital Magnetic Moments and Paramagnetic Shift in Artificial Relativistic Atoms and Molecules

abstract: Massless Dirac fermions have been observed in various materials such as graphene and topological insulators in recent years, thus offering a solid-state platform to study relativistic quantum phenomena. Single quantum dots (QDs) and coupled QDs formed with massless Dirac fermions can be viewed as artificial relativistic atoms and molecules, respectively. Such structures offer a unique platform to study atomic and molecular physics in the ultra-relativistic regime. Here, we use a scanning tunneling microscope to create and probe single and coupled electrostatically defined graphene QDs to unravel the unique magnetic field responses of artificial relativistic nanostructures. Giant orbital Zeeman splitting and orbital magnetic moment are observed in single graphene QDs. While for coupled graphene QDs, Aharonov Bohm oscillations and strong Van Vleck paramagnetic shift are observed. Such properties of artificial relativistic atoms and molecules can be leveraged for novel magnetic field sensing modalities.


title: Revision for Concision: A Constrained Paraphrase Generation Task

abstract: Academic writing should be concise as concise sentences better keep the readers' attention and convey meaning clearly. Writing concisely is challenging, for writers often struggle to revise their drafts. We introduce and formulate revising for concision as a natural language processing task at the sentence level. Revising for concision requires algorithms to use only necessary words to rewrite a sentence while preserving its meaning. The revised sentence should be evaluated according to its word choice, sentence structure, and organization. The revised sentence also needs to fulfil semantic retention and syntactic soundness. To aide these efforts, we curate and make available a benchmark parallel dataset that can depict revising for concision. The dataset contains 536 pairs of sentences before and after revising, and all pairs are collected from college writing centres. We also present and evaluate the approaches to this problem, which may assist researchers in this area.


title: Search for gravitational-wave transients associated with magnetar bursts during the third Advanced LIGO and Advanced Virgo observing run

abstract: Magnetars are neutron stars with exceptionally strong dipole magnetic fields which are observed to display a range of x-ray flaring behavior, but the flaring mechanism is not well understood. The third observing run of Advanced LIGO and Virgo extended from April 1, 2019 to March 27, 2020, and contained x-ray flares from known magnetar SGR 1935+2154, as well as the newly-discovered magnetar, Swift J1818-1607. We search for gravitational waves coincident with these magnetar flares with minimally modeled, coherent searches which specifically target both short-duration gravitational waves produced by excited f-modes in the magnetar's core, as well as long-duration gravitational waves motivated by the Quasi-Periodic Oscillations observed in the tails of giant flares. In this paper, we report on the methods and sensitivity estimates of these searches, and the astrophysical implications.


title: Net Separation-Oriented Printed Circuit Board Placement via Margin Maximization

abstract: Packaging has become a crucial process due to the paradigm shift of More than Moore. Addressing manufacturing and yield issues is a significant challenge for modern layout algorithms. We propose to use printed circuit board (PCB) placement as a benchmark for the packaging problem. A maximum-margin formulation is devised to improve the separation between nets. Our framework includes seed layout proposals, a coordinate descent-based procedure to optimize routability, and a mixed-integer linear programming method to legalize the layout. We perform an extensive study with 14 PCB designs and an open-source router. We show that the placements produced by NS-place improve routed wirelength by up to 25\%, reduce the number of vias by up to 50\%, and reduce the number of DRVs by 79\% compared to manual and wirelength-minimal placements.


title: Universal Evasion Attacks on Summarization Scoring

abstract: The automatic scoring of summaries is important as it guides the development of summarizers. Scoring is also complex, as it involves multiple aspects such as fluency, grammar, and even textual entailment with the source text. However, summary scoring has not been considered a machine learning task to study its accuracy and robustness. In this study, we place automatic scoring in the context of regression machine learning tasks and perform evasion attacks to explore its robustness. Attack systems predict a non-summary string from each input, and these non-summary strings achieve competitive scores with good summarizers on the most popular metrics: ROUGE, METEOR, and BERTScore. Attack systems also "outperform" state-of-the-art summarization methods on ROUGE-1 and ROUGE-L, and score the second-highest on METEOR. Furthermore, a BERTScore backdoor is observed: a simple trigger can score higher than any automatic summarization method. The evasion attacks in this work indicate the low robustness of current scoring systems at the system level. We hope that our highlighting of these proposed attacks will facilitate the development of summary scores.


title: DAS for 2D MASW Imaging: A Case Study on the Benefits of Flexible Sub-Array Processing

abstract: Distributed acoustic sensing (DAS) is a relatively new technology for recording stress wave propagation, with promising applications in both engineering and geophysics. DAS's ability to simultaneously collect high spatial resolution data over long arrays suggests that it is especially well suited for near-surface imaging applications such as 2D MASW (multi-channel analysis of surface waves). 2D MASW aims to produce a pseudo-2D cross-section of shear-wave velocity (Vs) for the purpose of identifying and characterizing subsurface layering and anomalies. These cross-sections are produced by interpolating numerous 1D Vs profiles extracted from overlapping sub-arrays along the testing alignment. When using traditional seismic equipment, these sub-arrays are typically collected in a roll-along configuration, where the equipment is moved along the alignment at some predetermined sub-array interval. DAS does not have the same limitations, as data from all shot locations are simultaneously recorded along the entire length of the DAS array. This alleviates the requirements to pre-determine sub-array length and interval during the acquisition stage and allows for multiple geometries to be investigated during the processing stage. The present study utilizes DAS data to evaluate the effects of sub-array length on 2D MASW results at a well-characterized field test site. We organize the DAS waveforms into multiple sets of overlapping MASW sub-arrays of differing lengths, allowing for direct comparison of the derived results at the same site. We show that the length of the individual MASW sub-arrays has a significant effect on the resolution of the resulting cross-sections as well as the resolved location of large impedance contrasts at our study site and evaluate those locations compared to invasive testing.


title: What sets the splashback radius of dark matter haloes: accretion history or other properties?

abstract: The density profiles of dark matter haloes contain rich information about their growth history and physical properties. One particularly interesting region is the splashback radius, $R_{\rm sp}$, which marks the transition between particles orbiting in the halo and particles undergoing first infall. While the dependence of $R_{\rm sp}$ on the recent accretion rate is well established and theoretically expected, it is not clear exactly what parts of the accretion history $R_{\rm sp}$ responds to, and what other halo properties might additionally influence its position. We comprehensively investigate these questions by correlating the dynamically measured splashback radii of a large set of simulated haloes with their individual growth histories as well as their structural, dynamical, and environmental properties. We find that $R_{\rm sp}$ is sensitive to the accretion over one crossing time but largely insensitive to the prior history (in contrast to concentration, which probes earlier epochs). All secondary correlations are much weaker, but we discern a relatively higher $R_{\rm sp}$ in less massive, older, more elliptical, and more tidally deformed haloes. Despite these minor influences, we conclude that the splashback radius is a clean indicator of a halo's growth over the past dynamical time. We predict that the magnitude gap should be a promising observable indicator of a halo's accretion rate and splashback radius.


title: Efficient Directed Graph Sampling via Gershgorin Disc Alignment

abstract: Graph sampling is the problem of choosing a node subset via sampling matrix $\mathbf{H} \in \{0,1\}^{K \times N}$ to collect samples $\mathbf{y} = \mathbf{H} \mathbf{x} \in \mathbb{R}^K$, $K < N$, so that the target signal $\mathbf{x} \in \mathbb{R}^N$ can be reconstructed in high fidelity. While sampling on undirected graphs is well studied, we propose the first sampling scheme tailored specifically for directed graphs, leveraging a previous undirected graph sampling method based on Gershgorin disc alignment (GDAS). Concretely, given a directed positive graph $\mathcal{G}^d$ specified by random-walk graph Laplacian matrix $\mathbf{L}_{rw}$, we first define reconstruction of a smooth signal $\mathbf{x}^*$ from samples $\mathbf{y}$ using graph shift variation (GSV) $\|\mathbf{L}_{rw} \mathbf{x}\|^2_2$ as a signal prior. To minimize worst-case reconstruction error of the linear system solution $\mathbf{x}^* = \mathbf{C}^{-1} \mathbf{H}^\top \mathbf{y}$ with symmetric coefficient matrix $\mathbf{C} = \mathbf{H}^\top \mathbf{H} + \mu \mathbf{L}_{rw}^\top \mathbf{L}_{rw}$, the sampling objective is to choose $\mathbf{H}$ to maximize the smallest eigenvalue $\lambda_{\min}(\mathbf{C})$ of $\mathbf{C}$. To circumvent eigen-decomposition entirely, we maximize instead a lower bound $\lambda^-_{\min}(\mathbf{S}\mathbf{C}\mathbf{S}^{-1})$ of $\lambda_{\min}(\mathbf{C})$ -- smallest Gershgorin disc left-end of a similarity transform of $\mathbf{C}$ -- via a variant of GDAS based on Gershgorin circle theorem (GCT). Experimental results show that our sampling method yields smaller signal reconstruction errors at a faster speed compared to competing schemes.


title: A statistical Analysis of Magnetic Field Changes in the Photosphere During Solar Flares Using High-cadence Vector Magnetograms and Their Association with Flare Ribbons

abstract: We analyze high-cadence vector magnetograms (135~s) and flare-ribbon observations of 37 flares from the Solar Dynamics Observatory to understand the spatial and temporal properties of changes in the photospheric vector magnetic field and their relationship to footpoints of reconnected fields. Confirming previous studies, we find that the largest permanent changes in the horizontal field component lie near the polarity inversion line, whereas changes in the vertical field are less pronounced and are distributed throughout the active region. We find that pixels swept up by ribbons do not always exhibit permanent changes in the field. However, when they do, ribbon emission typically occurs several minutes before the start of field changes. The changes in the properties of the field show no relation to the size of active regions, but are strongly related to the flare-ribbon properties such as ribbon magnetic flux and ribbon area. For the first time, we find that the duration of permanent changes in the field is strongly coupled with the duration of the flare, lasting on average 29\% of the duration of the GOES flare. Our results suggest that changes in photospheric magnetic fields are caused by a combination of two scenarios: contraction of flare loops driven by magnetic reconnection and coronal implosion.


title: Uncloneable Cryptography

abstract: The no-cloning theorem asserts that, unlike classical information, quantum information cannot be copied. This seemingly undesirable phenomenon is harnessed in quantum cryptography. Uncloneable cryptography studies settings in which the impossibility of copying is a desired property, and achieves forms of security that are classically unattainable. The first example discovered and analyzed was in the context of cash. On the one hand, we want users to hold the cash; on the other hand, the cash should be hard to counterfeit. Quantum money uses variants of the no-cloning theorem to make counterfeiting impossible. In the past decade, this field developed in various directions: several flavors of quantum money, such as classically verifiable, locally verifiable, semi-quantum, quantum coins, and quantum lightning were constructed. New uncloneable primitives were introduced, such as uncloneable signatures, quantum copy protection for classical software, pseudorandom states, and several uncloneable forms of encryption. This work is a gentle introduction to these topics.


title: Hedonic Models of Real Estate Prices: GAM and Environmental Factors

abstract: We consider the use of P-spline generalized additive hedonic models for real estate prices in large U.S. cities, contrasting their predictive efficiency against linear and polynomial based generalized linear models. Using intrinsic and extrinsic factors available from Redfin, we show that GAM models are capable of describing 84% to 92% of the variance in the expected ln(sales price), based upon 2021 data. As climate change is becoming increasingly important, we utilized the GAM model to examine the significance of environmental factors in two urban centers on the northwest coast. The results indicate city dependent differences in the significance of environmental factors. We find that inclusion of the environmental factors increases the adjusted R-squared of the GAM model by less than one percent.


title: A Survey on Deep Generative 3D-aware Image Synthesis

abstract: Recent years have seen remarkable progress in deep learning powered visual content creation. This includes deep generative 3D-aware image synthesis, which produces high-idelity images in a 3D-consistent manner while simultaneously capturing compact surfaces of objects from pure image collections without the need for any 3D supervision, thus bridging the gap between 2D imagery and 3D reality. The ield of computer vision has been recently captivated by the task of deep generative 3D-aware image synthesis, with hundreds of papers appearing in top-tier journals and conferences over the past few years (mainly the past two years), but there lacks a comprehensive survey of this remarkable and swift progress. Our survey aims to introduce new researchers to this topic, provide a useful reference for related works, and stimulate future research directions through our discussion section. Apart from the presented papers, we aim to constantly update the latest relevant papers along with corresponding implementations at https://weihaox.github.io/3D-aware-Gen.


title: FRB emission mechanisms vs. observations

abstract: Presently, it is broadly assumed that fast radio bursts (FRBs) are sources of coherent emission powered by the magnetic energy release in magnetars. However, the exact emission mechanism is not known, yet. Two main frameworks exist: magnetospheric emission and radiation from external relativistic shocks. In this brief review, I describe basics of both approaches and discuss how they are probed by modern observations.


title: Solving a multilevel linear programming problems through a new constructive approach

abstract: In this paper, an algorithm is developed to solve a multilevel mono-objective linear programming problem (ML(MO)LPP), where the constructive adaptive method of linear programming is nested. This procedure is the modified version of the SB. Sinha and S. Sinha's linear programming approach. First, we build a map that reduces the ranges of decision variables that are over control of the previous level's decision maker, depending on the chosen approach, called the range reduction map. Then, we use it to define a new sub-optimality estimate of the adaptive method for the problem under consideration. All the construction stages are carefully checked and illustrated with a numerical example.


title: Guiding Users to Where to Give Color Hints for Efficient Interactive Sketch Colorization via Unsupervised Region Prioritization

abstract: Existing deep interactive colorization models have focused on ways to utilize various types of interactions, such as point-wise color hints, scribbles, or natural-language texts, as methods to reflect a user's intent at runtime. However, another approach, which actively informs the user of the most effective regions to give hints for sketch image colorization, has been under-explored. This paper proposes a novel model-guided deep interactive colorization framework that reduces the required amount of user interactions, by prioritizing the regions in a colorization model. Our method, called GuidingPainter, prioritizes these regions where the model most needs a color hint, rather than just relying on the user's manual decision on where to give a color hint. In our extensive experiments, we show that our approach outperforms existing interactive colorization methods in terms of the conventional metrics, such as PSNR and FID, and reduces required amount of interactions.


title: Learning to Augment via Implicit Differentiation for Domain Generalization

abstract: Machine learning models are intrinsically vulnerable to domain shift between training and testing data, resulting in poor performance in novel domains. Domain generalization (DG) aims to overcome the problem by leveraging multiple source domains to learn a domain-generalizable model. In this paper, we propose a novel augmentation-based DG approach, dubbed AugLearn. Different from existing data augmentation methods, our AugLearn views a data augmentation module as hyper-parameters of a classification model and optimizes the module together with the model via meta-learning. Specifically, at each training step, AugLearn (i) divides source domains into a pseudo source and a pseudo target set, and (ii) trains the augmentation module in such a way that the augmented (synthetic) images can make the model generalize well on the pseudo target set. Moreover, to overcome the expensive second-order gradient computation during meta-learning, we formulate an efficient joint training algorithm, for both the augmentation module and the classification model, based on the implicit function theorem. With the flexibility of augmenting data in both time and frequency spaces, AugLearn shows effectiveness on three standard DG benchmarks, PACS, Office-Home and Digits-DG.


title: Dynamic and static properties of Quantum Hall and Harmonic Oscillator systems on the non-commutative plane

abstract: We study two quantum mechanical systems on the noncommutative plane using a representation independent approach. First, in the context of the Landau problem, we obtain an explicit expression for the gauge transformation that connects the Landau and the symmetric gauge in noncommutative space. This lead us to conclude that the usual form of the symmetric gauge $\vec{A}=\left(-\frac{\beta}{2}\hat{Y},\frac{\beta}{2}\hat{X}\right)$, in which the constant $\beta$ is interpreted as the magnetic field, is not true in noncommutative space. We also be able to establish a precise definition of $\beta$ as function of the magnetic field, for which the equivalence between the symmetric and Landau gauges is hold in noncommutative plane. Using the symmetric gauge we obtain results for the spectrum of the Quantum Hall system, its transverse conductivity in the presence of an electric field and other static observables. These results amend the literature on Quantum Hall Effect in noncommutative plane in which the incorrect form of the symmetric gauge, in noncommutative space, is assumed. We also study the non-equilibrium dynamics of simple observables for this system. On the other hand, we study the dynamics of the harmonic oscillator in non-commutative space and show that, in general, it exhibit quasi-periodic behavior, in striking contrast with its commutative version. The study of the dynamics reveals itself as a most powerful tool to characterize and understand the effects of non-commutativity.


title: Towards a non-Gaussian Generative Model of large-scale Reionization Maps

abstract: High-dimensional data sets are expected from the next generation of large-scale surveys. These data sets will carry a wealth of information about the early stages of galaxy formation and cosmic reionization. Extracting the maximum amount of information from the these data sets remains a key challenge. Current simulations of cosmic reionization are computationally too expensive to provide enough realizations to enable testing different statistical methods, such as parameter inference. We present a non-Gaussian generative model of reionization maps that is based solely on their summary statistics. We reconstruct large-scale ionization fields (bubble spatial distributions) directly from their power spectra (PS) and Wavelet Phase Harmonics (WPH) coefficients. Using WPH, we show that our model is efficient in generating diverse new examples of large-scale ionization maps from a single realization of a summary statistic. We compare our model with the target ionization maps using the bubble size statistics, and largely find a good agreement. As compared to PS, our results show that WPH provide optimal summary statistics that capture most of information out of a highly non-linear ionization fields.


title: Regularity of Hele-Shaw Flow with source and drift

abstract: In this paper we study the regularity property of Hele-Shaw flow, where source and drift are present in the evolution. More specifically we consider H\"{o}lder continuous source and Lipschitz continuous drift. We show that if the free boundary of the solution is locally close to a Lipschitz graph, then it is indeed Lipschitz, given that the Lipschitz constant is small. When there is no drift, our result establishes $C^{1,\gamma}$ regularity of the free boundary by combining our result with the obstacle problem theory. In general, when the source and drift are both smooth, we prove that the solution is non-degenerate, indicating higher regularity of the free boudary.


title: Similarity between Units of Natural Language: The Transition from Coarse to Fine Estimation

abstract: Capturing the similarities between human language units is crucial for explaining how humans associate different objects, and therefore its computation has received extensive attention, research, and applications. With the ever-increasing amount of information around us, calculating similarity becomes increasingly complex, especially in many cases, such as legal or medical affairs, measuring similarity requires extra care and precision, as small acts within a language unit can have significant real-world effects. My research goal in this thesis is to develop regression models that account for similarities between language units in a more refined way. Computation of similarity has come a long way, but approaches to debugging the measures are often based on continually fitting human judgment values. To this end, my goal is to develop an algorithm that precisely catches loopholes in a similarity calculation. Furthermore, most methods have vague definitions of the similarities they compute and are often difficult to interpret. The proposed framework addresses both shortcomings. It constantly improves the model through catching different loopholes. In addition, every refinement of the model provides a reasonable explanation. The regression model introduced in this thesis is called progressively refined similarity computation, which combines attack testing with adversarial training. The similarity regression model of this thesis achieves state-of-the-art performance in handling edge cases.


title: A comment about the cosmology on a bubble wall

abstract: The interface between a big bubble of true AdS$_D$ vacuum expanding inside a false AdS$_D$ vacuum is a model of an inflating $D-1$ dimensional universe. It looks like an interesting setup to study fundamentals of inflation. A recent computation shows that the prediction of this model for the wavefunction of the universe disagrees with that of Hartle and Hawking. We show that this discrepancy is because the effective $D-1$ dimensional description of the model is spin-$0$ (Nordstr\"om) gravity rather than spin-2 (Einstein) gravity.


title: A distributed blossom algorithm for minimum-weight perfect matching

abstract: We describe a distributed, asynchronous variant of Edmonds's exact algorithm for producing perfect matchings of minimum weight. The development of this algorithm is driven by an application to online error correction in quantum computing, first envisioned by Fowler; we analyze the performance of our algorithm as applied to this domain in a sequel.


title: Quantum speed limits in arbitrary phase spaces

abstract: Quantum speed limits (QSLs) provide an upper bound for the speed of evolution of quantum states in any physical process. Based on the Stratonovich-Weyl correspondence, we derive a universal QSL bound in arbitrary phase spaces that is applicable for both continuous variable systems and finite-dimensional discrete quantum systems. This QSL bound allows the determination of speed limit bounds in specific phase spaces that are tighter than those in Wigner phase space or Hilbert space under the same metric, as illustrated by several typical examples, e.g., a single-mode free field and $N$-level quantum systems in phase spaces. This QSL bound also provides an experimentally realizable way to examine the speed limit in phase spaces relevant to applications in quantum information and quantum optics.


title: Syntomic cycle classes and prismatic Poincar\'e duality

abstract: We introduce $F$-gauges over a prism, construct syntomic cycle classes, and prove the prismatic Poincar\'e duality for proper smooth schemes.