title: Formation of star clusters and enrichment by massive stars in simulations of low-metallicity galaxies with a fully sampled initial stellar mass function

abstract: We present new GRIFFIN project hydrodynamical simulations that model the formation of galactic star cluster populations in low-metallicity ($Z=0.00021$) dwarf galaxies, including radiation, supernova and stellar wind feedback of individual massive stars. In the simulations, stars are sampled from the stellar initial mass function (IMF) down to the hydrogen burning limit of $0.08$ M$_\odot$. Mass conservation is enforced within a radius of $1$ pc for the formation of massive stars. We find that massive stars are preferentially found in star clusters and follow a correlation set at birth between the highest initial stellar mass and the star cluster mass that differs from pure stochastic IMF sampling. With a fully sampled IMF, star clusters lose mass in the galactic tidal field according to mass-loss rates observed in nearby galaxies. Of the released stellar feedback, $60\%$ of the supernova material and up to $35\%$ of the wind material reside either in the hot interstellar medium (ISM) or in gaseous, metal enriched outflows. While stellar winds (instantaneously) and supernovae (delayed) start enriching the ISM right after the first massive stars form, the formation of supernova-enriched stars and star clusters is significantly delayed (by $>50$ Myr) compared to the formation of stars and star clusters enriched by stellar winds. Overall, supernova ejecta dominate the enrichment by mass, while the number of enriched stars is determined by continuous stellar winds. These results present a concept for the formation of chemically distinct populations of stars in bound star clusters, reminiscent of multiple populations in globular clusters.


title: Multi-epoch variability of AT 2000ch (SN 2000ch) in NGC 3432 -- A radio continuum and optical study

abstract: AT 2000ch is a highly variable massive star and supernova imposter in NGC 3432 first detected in 2000. It is similar and often compared to SN 2009ip, and it is therefore expected to undergo a core-collapse supernova -- a SN imposter of similar brightness -- in the near future. We characterize the long-term variability of AT 2000ch in the radio and optical regimes with archival data reaching back to the year 1984. We use these newly reduced observations in addition to observations in the literature to restrict the mass-loss rates of AT 2000ch at multiple epochs based on different approaches, and to infer the general properties of its circumstellar nebula with respect to the detected radio brightness. We extend the known optical light curve of AT 2000ch up to the beginning of 2022 by performing point spread function photometry on archival data from the Palomar Transient Factory and the Zwicky Transient Facility. We reduced archival radio continuum observations obtained with the Very Large Array using standard calibration and imaging methods and complemented these with pre-reduced \changes observations as well as observations obtained with the Westerbork Synthesis Radio Telescope and LOw Frequency ARray. For the analysis of AT 2000ch, we consider the optical light curve and color evolution, its radio continuum brightness at different frequencies and times, and the corresponding spectral indices. We estimated mass-loss rates and optical depths based on radio continuum brightnesses and Ha fluxes. We report two newly detected outbursts of AT 2000ch similar to those found in the 2000s and 13 re-brightening events, of which at least four are not conclusively detected because of insufficient sampling of the light curve. The dates of all outbursts and significant, well-sampled re-brightening events are consistent with a period of $\sim 201 \pm 12\,$days over a total time-span of two decades. Such a behavior has never been found for any SN imposter, especially not for candidate SN~2009ip analogs. During 2010 to 2012 and 2014 to 2018, we only have a few detections, which is insufficient to come to any conclusion as to a possible less eruptive phase of the transient. We find steady dimming after the most recent re-brightening events and possible evidence of porosity in the circumstellar envelope, suggesting AT~2000ch may currently be in transition to a state of relative calm. We identified a second, unrelated source at a projected distance of $\sim 23\,$pc ($\sim0.5^{\prime\prime}$) that has contaminated the optical measurements of AT~2000ch at its minimum luminosity over the last two decades probably on a $5\%-10\,\%$ level, but this does not affect our overall findings and is negligible during re-brightening. We are able to restrict the mass-loss rate of AT~2000ch to range between several $10^{-6}\,\textrm{M}_{\odot}/\textrm{yr}$ and several $10^{-5}\,\textrm{M}_{\odot}/\textrm{yr}$. The fresh ejecta appear to be optically thick to radio continuum emission at least within the first $\sim 25\,$days after significant re-brightening.


title: The mid-infrared molecular inventory towards Orion IRc2

abstract: We present the first high spectral resolution mid-infrared survey in the Orion BN/KL region, covering 7.2 to 28.3 micron. With SOFIA/EXES we target the enigmatic source Orion IRc2. While this is in the most prolifically studied massive star-forming region, longer wavelengths and molecular emission lines dominated previous spectral surveys. The mid-infrared observations in this work access different components and molecular species in unprecedented detail. We unambiguously identify two new kinematic components, both chemically rich with multiple molecular absorption lines. The "blue clump" has vLSR = -7.1 \pm 0.7 km/s and the "red clump" 1.4 \pm 0.5 km/s. While the blue and red clumps have similar temperatures and line widths, molecular species in the blue clump have higher column densities. They are both likely linked to pure rotational H2 emission also covered by this survey. This work provides evidence for the scenario that the blue and red clumps are distinct components unrelated to the classic components in the Orion BN/KL region. Comparison to spectroscopic surveys towards other infrared targets in the region show that the blue clump is clearly extended. We analyze, compare, and present in depth findings on the physical conditions of C2H2, 13CCH2, CH4, CS, H2O, HCN, H13CN, HNC, NH3, and SO2 absorption lines and an H2 emission line associated with the blue and red clumps. We also provide limited analysis of H2O and SiO molecular emission lines towards Orion IRc2 and the atomic forbidden transitions [FeII], [SI], [SIII], and [NeII].


title: Few-body analogue quantum simulation with Rydberg-dressed atoms in optical lattices

abstract: Most experiments with ultracold atoms in optical lattices have contact interactions, and therefore operate at high densities of around one atom per site to observe the effect of strong interactions. Strong ranged interactions can be generated via Rydberg dressing, which opens the path to explore the physics of few interacting particles. Rather than the unit cells of a crystal, the sites of the optical lattice can now be interpreted as discretized space. This allows studying completely new types of problems in a familiar architecture. We investigate the possibility of realizing problems akin to those found in quantum chemistry, although with a different scaling law in the interactions. Through numerical simulation, we show that simple pseudo-atoms and -molecules could be prepared with high fidelity in state-of-the-art experiments.


title: Observing Signals of Spectral Features in the Cosmic-Ray Positrons and Electrons from Milky Way Pulsars

abstract: The Alpha Magnetic Spectrometer (AMS-02) has provided unprecedented precision measurements of the electron and positron cosmic-ray fluxes and the positron fraction spectrum. At the higher energies, sources as energetic local pulsars, may contribute to both cosmic-ray species. The discreteness of the source population, can result in features both on the positron fraction measurement and in the respective electron and positron spectra. For the latter, those would coincide in energy and would contrast predictions of smooth spectra as from particle dark matter. In this work, using a library of pulsar population models for the local part of the Milky Way, we perform a power-spectrum analysis on the cosmic-ray positron fraction. We also develop a technique to cross-correlate the electron and positron fluxes. We show that both such analyses, can be used to search statistically for the presence of spectral wiggles in the cosmic-ray data. For a significant fraction of our pulsar simulations, those techniques are already sensitive enough to give a signal for the presence of those features above the regular noise, with forthcoming observations making them even more sensitive. Finally, by cross-correlating the AMS-02 electron and positron spectra, we find an intriguing first hint for a positive correlation between them, of the kind expected by a population of local pulsars.


title: Chemical abundances in the dwarf galaxy NGC 4163 based on the nebular and auroral emission lines

abstract: We constructed an oxygen abundance map and N/O ratio map of the unusually low excitation dwarf irregular galaxy NGC 4163 based on publicly available spectroscopy obtained by the MaNGA survey. We detected auroral emission line [OII]$\lambda\lambda$7320,7330 which allows us to measure chemical abundance by direct T$_e$ method. We found that the scatter of the oxygen abundance derived by the strong line method is large. The oxygen abundances 12 + log(O/H) derived by strong line method vary from ~7.3 to ~7.8 with a mean value of ~7.55. The oxygen abundances derived in two apertures of 2 arcseconds by the direct T$_e$ method using our measurements of the O$^+$ auroral line is about 7.8 dex. The nitrogen-to-oxygen ratio log(N/O) of about -1.5 is typical value for a low metallicity galaxy, maybe slightly shifted towards higher N/O ratios with respect to the N/O values in the HII regions in nearby galaxies. An unusual negative trend between log(N/O) and oxygen abundance is detected. NGC 4163 is a gas-poor galaxy with a neutral atomic gas mass fraction of around 0.25. The oxygen abundance in the galaxy is only around 0.1 of the oxygen abundance potentially attainable in a galaxy with such a gas mass fraction. The low metallicity coupled with the low gas mass fraction implies that either the metallicity of the interstellar medium of the galaxy was reduced by pristine gas infall in the recent epoch or the evolution of this galaxy was accompanied by strong galactic winds.


title: Hall map and breakdown of Fermi liquid theory in the vicinity of a Mott insulator

abstract: The Hall coefficient exhibits anomalous behavior in lightly doped Mott insulators. For strongly interacting electrons its computation has been challenged by analytical and numerical obstacles. We calculate the leading contributions in the recently derived thermodynamic formula for the Hall coefficient. We obtain its doping and temperature dependence for the square lattice tJ-model at high temperatures. The second order corrections are evaluated to be negligible. Quantum Monte Carlo sampling extends our results to lower temperatures. We find a divergence of the Hall coefficient toward the Mott limit and a sign reversal relative to Boltzmann equation's weak scattering prediction. The Hall current near the Mott phase is carried by a low density of spin-entangled vacancies, which should constitute the Cooper pairs in any superconducting phase at lower temperatures.


title: QED as a many-body theory of worldlines: II. All-order S-matrix formalism

abstract: In arXiv:2206.04188, we developed a first-quantized worldline formalism for all-order computations of amplitudes in QED. In particular, we demonstrated in this framework an all-order proof of the infrared safety of the Faddeev-Kulish (FK) S-matrix for virtual exchanges in the scattering of charged fermions. In this work, we extend the worldline formalism for both the Dyson and FK S-matrix to consider further the emission and absorption of arbitrary numbers of photons. We show how Low's theorem follows in this framework and derive Weinberg's theorem for the exponentiation of IR divergences. In particular, we extend our all-order proof of the IR safety of the FK S-matrix to both virtual exchanges and real photon emissions. We argue that the worldline approach leads to a modern Wilsonian interpretation of the IR safety of the FK S-matrix and provides a novel template for the treatment of IR divergences in real-time problems. Using Grassmannian integration methods, we derive a simple and powerful result for N-th rank vacuum polarization tensors. Applications of these methods will be discussed in follow-up work.


title: Partial desingularization

abstract: We address the following question of partial desingularization preserving normal crossings. Given an algebraic (or analytic) variety X in characteristic zero, can we find a finite sequence of blowings-up preserving the normal-crossings locus of X, after which the transform X' of X has only singularities from an explicit finite list of minimal singularities, which we define using the determinants of circulant matrices. In the case of surfaces, for example, the pinch point or Whitney umbrella is the only singularity needed in addition to normal crossings. We develop techniques for factorization (splitting) of a monic polynomial with regular (or analytic) coefficients, satisfying a generic normal crossings hypothesis, which we use together with resolution of singularities techniques to find local circulant normal forms of singularities. These techniques in their current state are enough for a positive answer to the question above, for dim X up to 4, or in arbitrary dimension if we preserve normal crossings only of order at most three. In these cases, minimal singularities have smooth normalization.


title: Single active particle in a harmonic potential: non-existence of the Jarzynski relation

abstract: The interest in active matter stimulates the need to generalize thermodynamic description and relations to active matter systems, which are intrinsically out of equilibrium. One important example is the Jarzynski relation, which links the exponential average of work done in an arbitrary process connecting two equilibrium states with the difference of the free energies of these states. Using a simple model system, a single thermal active Ornstein-Uhlenbeck particle in a harmonic potential, we show that if the standard stochastic thermodynamics definition of work is used, the Jarzynski relation is not generally valid for processes between stationary states of active matter systems.


title: Upper bounds for Heilbronn's triangle problem in higher dimensions

abstract: We develop a new simple approach to prove upper bounds for generalizations of the Heilbronn's triangle problem in higher dimensions. Among other things, we show the following: for fixed $d \ge 1$, any subset of $[0, 1]^d$ of size $n$ contains - $d+1$ points which span a simplex of volume at most $C_d n^{-\log d+ 6}$, - $1.1 d$ points whose convex hull has volume at most $C_d n^{-1.1}$, - $k\ge 4\sqrt{d}$ points which span a $(k-1)$-dimensional simplex of volume at most $C_d n^{-\frac{k-1}{d} - \frac{k^2}{8d^2}}$.


title: Distributed Parallelization of xPU Stencil Computations in Julia

abstract: We present a straightforward approach for distributed parallelization of stencil-based xPU applications on a regular staggered grid, which is instantiated in the package ImplicitGlobalGrid.jl. The approach allows to leverage remote direct memory access and enables close to ideal weak scaling of real-world applications on thousands of GPUs. The communication costs can be easily hidden behind computation.


title: Learning deep abdominal CT registration through adaptive loss weighting and synthetic data generation

abstract: Purpose: This study aims to explore training strategies to improve convolutional neural network-based image-to-image deformable registration for abdominal imaging. Methods: Different training strategies, loss functions, and transfer learning schemes were considered. Furthermore, an augmentation layer which generates artificial training image pairs on-the-fly was proposed, in addition to a loss layer that enables dynamic loss weighting. Results: Guiding registration using segmentations in the training step proved beneficial for deep-learning-based image registration. Finetuning the pretrained model from the brain MRI dataset to the abdominal CT dataset further improved performance on the latter application, removing the need for a large dataset to yield satisfactory performance. Dynamic loss weighting also marginally improved performance, all without impacting inference runtime. Conclusion: Using simple concepts, we improved the performance of a commonly used deep image registration architecture, VoxelMorph. In future work, our framework, DDMR, should be validated on different datasets to further assess its value.


title: Contrastive Novelty-Augmented Learning: Anticipating Outliers with Large Language Models

abstract: In many task settings, text classification models are likely to encounter examples from novel classes on which they cannot predict correctly. Selective prediction, in which models abstain on low-confidence examples, provides a possible solution, but existing models are often overly confident on unseen classes. To remedy this overconfidence, we introduce Contrastive Novelty-Augmented Learning (CoNAL), a two-step method that generates OOD examples representative of novel classes, then trains to decrease confidence on them. First, we generate OOD examples by prompting a large language model twice: we prompt it to enumerate relevant novel classes, then generate examples from each novel class matching the task format. Second, we train a classifier with a novel contrastive objective that encourages lower confidence on generated OOD examples than training examples. When trained with CoNAL, classifiers improve in their ability to detect and abstain on novel class examples over prior methods by an average of 2.3% in terms of accuracy under the accuracy-coverage curve (AUAC) and 5.5% AUROC across 4 NLP datasets, with no cost to in-distribution accuracy.


title: Universality for tropical and logarithmic maps

abstract: We prove that every toric monoid appears in a space of maps from tropical curves to an orthant. It follows that spaces of logarithmic maps to Artin fans exhibit arbitrary toric singularities: a virtual universality theorem for logarithmic maps to pairs. The target rank depends on the chosen singularity: we show that the cone over the 7-gon never appears in a space of maps to a rank-1 target. We obtain similar results for tropical maps to affine space.


title: Predicting pathways for old and new metabolites through clustering

abstract: The diverse metabolic pathways are fundamental to all living organisms, as they harvest energy, synthesize biomass components, produce molecules to interact with the microenvironment, and neutralize toxins. While discovery of new metabolites and pathways continues, the prediction of pathways for new metabolites can be challenging. It can take vast amounts of time to elucidate pathways for new metabolites; thus, according to HMDB only 60% of metabolites get assigned to pathways. Here, we present an approach to identify pathways based on metabolite structure. We extracted 201 features from SMILES annotations, and identified new metabolites from PubMed abstracts and HMDB. After applying clustering algorithms to both groups of features, we quantified correlations between metabolites, and found the clusters accurately linked 92% of known metabolites to their respective pathways. Thus, this approach could be valuable for predicting metabolic pathways for new metabolites.


title: Fundamental physics with neutron stars

abstract: Neutron stars are rich laboratories of multiple branches of modern physics. These include gravitational physics, nuclear and particle physics, (quantum) electrodynamics, and plasma astrophysics. In this chapter, we present the pioneering theoretical studies and the pivotal historical observations on which our understanding of neutron stars is based on. Then, we discuss the usage of neutron stars as probes of fundamental theories of physics.


title: Analytical evaluation of the coefficients of the Hu-Paz-Zhang master equation: Ohmic spectral density, zero temperature, and consistency check

abstract: We investigate the exact master equation of Hu, Paz, and Zhang for a quantum harmonic oscillator at zero temperature with a Lorentz-Drude type Ohmic spectral density. This master equation plays an important role in the study of quantum Brownian motion and in various applications. In this paper, we give an analytical evaluation of the coefficients of this non-Markovian master equation without Lindblad form, which allows us to investigate consistencies of the solutions, the positivity of the stationary density operator, and the boundaries of the model's parameters.


title: Spin superfluidity

abstract: The phenomenon of superfluidity (superconductivity) is a possibility of transport of mass (charge) on macroscopical distances without essential dissipation. In magnetically ordered media with easy-plane topology of the order parameter space the superfluid transport of spin is also possible despite the absence of the strict conservation law for spin. The article addresses three key issues in the theory of spin superfluidity: topology of the order parameter space, Landau criterion for superfluidity, and decay of superfluid currents via phase slip events, in which magnetic vortices cross current streamlines. Experiments on detection of spin superfluidity are also surveyed.


title: Malign Overfitting: Interpolation Can Provably Preclude Invariance

abstract: Learned classifiers should often possess certain invariance properties meant to encourage fairness, robustness, or out-of-distribution generalization. However, multiple recent works empirically demonstrate that common invariance-inducing regularizers are ineffective in the over-parameterized regime, in which classifiers perfectly fit (i.e. interpolate) the training data. This suggests that the phenomenon of ``benign overfitting," in which models generalize well despite interpolating, might not favorably extend to settings in which robustness or fairness are desirable. In this work we provide a theoretical justification for these observations. We prove that -- even in the simplest of settings -- any interpolating learning rule (with arbitrarily small margin) will not satisfy these invariance properties. We then propose and analyze an algorithm that -- in the same setting -- successfully learns a non-interpolating classifier that is provably invariant. We validate our theoretical observations on simulated data and the Waterbirds dataset.


title: Totally real points in the Mandelbrot Set

abstract: Recently, Noytaptim and Petsche proved that the only totally real parameters $c\in \overline{\mathbb Q}$ for which $f_c(z):=z^2+c$ is postcritically finite are $0$, $-1$ and $-2$. In this note, we show that the only totally real parameters $c\in \overline{\mathbb Q}$ for which $f_c$ has a parabolic cycle are $\frac14$, $-\frac34$, $-\frac54$ and $-\frac74$.


title: PBH-infused seesaw origin of matter and unique gravitational waves

abstract: The Standard Model, extended with three right-handed (RH) neutrinos, is the simplest model that can explain light neutrino masses, the baryon asymmetry of the Universe, and dark matter (DM). Models in which RH neutrinos are light are generally easier to test in experiments. In this work, we show that, even if the RH neutrinos are super-heavy ($M_{i=1,2,3}>10^9$ GeV) -- close to the Grand Unification scale -- the model can be tested thanks to its distinct features on the stochastic Gravitational Wave (GW) background. We consider an early Universe filled with ultralight primordial black holes (PBH) that produce a super-heavy RH neutrino DM via Hawking radiation. The other pair of RH neutrinos generates the baryon asymmetry via thermal leptogenesis, much before the PBHs evaporate. GW interferometers can test this novel spectrum of masses thanks to the GWs induced by the PBH density fluctuations. In a more refined version, wherein a $U(1)$ gauge symmetry breaking dynamically generates the seesaw scale, the PBHs also cause observable spectral distortions on the GWs from the $U(1)$-breaking cosmic strings. Thence, a low-frequency GW feature related to DM genesis and detectable with a pulsar-timing array must correspond to a mid- or high-frequency GW signature related to baryogenesis at interferometer scales.


title: The statistical properties of stars at redshift, z=5, compared with the present epoch

abstract: We report the statistical properties of stars and brown dwarfs obtained from three radiation hydrodynamical simulations of star cluster formation with metallicities of 1, 1/10 and 1/100 of the solar value. The star-forming clouds are subjected to cosmic microwave background radiation that is appropriate for star formation at a redshift z=5. The results from the three calculations are compared to each other, and to similar previously published calculations that had levels of background radiation appropriate for present-day (z=0) star formation. Each of the calculations treat dust and gas temperatures separately and include a thermochemical model of the diffuse interstellar medium. We find that whereas the stellar mass distribution is insensitive to the metallicity for present-day star formation, at z=5 the characteristic stellar mass increases with increasing metallicity and the mass distribution has a deficit of brown dwarfs and low-mass stars at solar metallicity compared to the Galactic initial mass function. We also find that the multiplicity of M-dwarfs decreases with increasing metallicity at z=5. These effects are a result of metal-rich gas being unable to cool to as low temperatures at z=5 compared to at z=0 due to the hotter cosmic microwave background radiation, which inhibits fragmentation at high densities.


title: Direct Heterogeneous Causal Learning for Resource Allocation Problems in Marketing

abstract: Marketing is an important mechanism to increase user engagement and improve platform revenue, and heterogeneous causal learning can help develop more effective strategies. Most decision-making problems in marketing can be formulated as resource allocation problems and have been studied for decades. Existing works usually divide the solution procedure into two fully decoupled stages, i.e., machine learning (ML) and operation research (OR) -- the first stage predicts the model parameters and they are fed to the optimization in the second stage. However, the error of the predicted parameters in ML cannot be respected and a series of complex mathematical operations in OR lead to the increased accumulative errors. Essentially, the improved precision on the prediction parameters may not have a positive correlation on the final solution due to the side-effect from the decoupled design. In this paper, we propose a novel approach for solving resource allocation problems to mitigate the side-effects. Our key intuition is that we introduce the decision factor to establish a bridge between ML and OR such that the solution can be directly obtained in OR by only performing the sorting or comparison operations on the decision factor. Furthermore, we design a customized loss function that can conduct direct heterogeneous causal learning on the decision factor, an unbiased estimation of which can be guaranteed when the loss converges. As a case study, we apply our approach to two crucial problems in marketing: the binary treatment assignment problem and the budget allocation problem with multiple treatments. Both large-scale simulations and online A/B Tests demonstrate that our approach achieves significant improvement compared with state-of-the-art.


title: Directed flow in a baryonic fireball

abstract: Directed flow of identified hadrons in a baryon rich fireball is an interesting observable as it is expected to probe several physics aspects: the initial three dimensional baryon profile in the thermalised fireball that can be treated as an input for the hydrodynamic evolution, the nature of baryon dissipation current and baryon transport coefficients, the QCD equation of state at finite baryon densities as well as the nature of phase transition between the quark gluon and hadronic phases. Particularly, the mid-rapidity slope of the rapidity dependence of directed flow of protons have been proposed as a sensitive observable to several of these physics aspects while a consistent description of the splitting in directed flow of baryon and its anti-particle has been a challenge. In this work, we propose a suitable ansatz of the initial condition for baryon deposition. When such a baryon deposition ansatz is coupled to a tilted fireball, we manage to find parameter space that can describe the directed flow of identified hadrons including the elusive baryon antibaryon splitting of directed flow. Further, we demonstrate that future measurements of baryon antibaryon directed flow at larger rapidities have the potential to constrain the baryon diffusion coefficient.


title: "Stochastic Inverse Problems" and Changes-of-Variables

abstract: Over the last decade, a series of applied mathematics papers have explored a type of inverse problem--called by a variety of names including "inverse sensitivity", "pushforward based inference", "consistent Bayesian inference", or "data-consistent inversion"--wherein a solution is a probability density whose pushforward takes a given form. The formulation of such a stochastic inverse problem can be unexpected or confusing to those familiar with traditional Bayesian or otherwise statistical inference. To date, two classes of solutions have been proposed, and these have only been justified through applications of measure theory and its disintegration theorem. In this work we show that, under mild assumptions, the formulation of and solution to all stochastic inverse problems can be more clearly understood using basic probability theory: a stochastic inverse problem is simply a change-of-variables or approximation thereof. For the two existing classes of solutions, we derive the relationship to change(s)-of-variables and illustrate using analytic examples where none had previously existed. Our derivations use neither Bayes' theorem nor the disintegration theorem explicitly. Our final contribution is a careful comparison of changes-of-variables to more traditional statistical inference. While taking stochastic inverse problems at face value for the majority of the paper, our final comparative discussion gives a critique of the framework.


title: Controlled Language Generation for Language Learning Items

abstract: This work aims to employ natural language generation (NLG) to rapidly generate items for English language learning applications: this requires both language models capable of generating fluent, high-quality English, and to control the output of the generation to match the requirements of the relevant items. We experiment with deep pretrained models for this task, developing novel methods for controlling items for factors relevant in language learning: diverse sentences for different proficiency levels and argument structure to test grammar. Human evaluation demonstrates high grammatically scores for all models (3.4 and above out of 4), and higher length (24%) and complexity (9%) over the baseline for the advanced proficiency model. Our results show that we can achieve strong performance while adding additional control to ensure diverse, tailored content for individual users.


title: Cache Me If You Can: Accuracy-Aware Inference Engine for Differentially Private Data Exploration

abstract: Differential privacy (DP) allows data analysts to query databases that contain users' sensitive information while providing a quantifiable privacy guarantee to users. Recent interactive DP systems such as APEx provide accuracy guarantees over the query responses, but fail to support a large number of queries with a limited total privacy budget, as they process incoming queries independently from past queries. We present an interactive, accuracy-aware DP query engine, CacheDP, which utilizes a differentially private cache of past responses, to answer the current workload at a lower privacy budget, while meeting strict accuracy guarantees. We integrate complex DP mechanisms with our structured cache, through novel cache-aware DP cost optimization. Our thorough evaluation illustrates that CacheDP can accurately answer various workload sequences, while lowering the privacy loss as compared to related work.


title: An Empirical Study of Library Usage and Dependency in Deep Learning Frameworks

abstract: Recent advances in deep learning (dl) have led to the release of several dl software libraries such as pytorch, Caffe, and TensorFlow, in order to assist machine learning (ml) practitioners in developing and deploying state-of-the-art deep neural networks (DNN), but they are not able to properly cope with limitations in the dl libraries such as testing or data processing. In this paper, we present a qualitative and quantitative analysis of the most frequent dl libraries combination, the distribution of dl library dependencies across the ml workflow, and formulate a set of recommendations to (i) hardware builders for more optimized accelerators and (ii) library builder for more refined future releases. Our study is based on 1,484 open-source dl projects with 46,110 contributors selected based on their reputation. First, we found an increasing trend in the usage of deep learning libraries. Second, we highlight several usage patterns of deep learning libraries. In addition, we identify dependencies between dl libraries and the most frequent combination where we discover that pytorch and Scikit-learn and, Keras and TensorFlow are the most frequent combination in 18% and 14% of the projects. The developer uses two or three dl libraries in the same projects and tends to use different multiple dl libraries in both the same function and the same files. The developer shows patterns in using various deep-learning libraries and prefers simple functions with fewer arguments and straightforward goals. Finally, we present the implications of our findings for researchers, library maintainers, and hardware vendors.


title: Predicting Football Match Outcomes with eXplainable Machine Learning and the Kelly Index

abstract: In this work, a machine learning approach is developed for predicting the outcomes of football matches. The novelty of this research lies in the utilisation of the Kelly Index to first classify matches into categories where each one denotes the different levels of predictive difficulty. Classification models using a wide suite of algorithms were developed for each category of matches in order to determine the efficacy of the approach. In conjunction to this, a set of previously unexplored features were engineering including Elo-based variables. The dataset originated from the Premier League match data covering the 2019-2021 seasons. The findings indicate that the process of decomposing the predictive problem into sub-tasks was effective and produced competitive results with prior works, while the ensemble-based methods were the most effective. The paper also devised an investment strategy in order to evaluate its effectiveness by benchmarking against bookmaker odds. An approach was developed that minimises risk by combining the Kelly Index with the predefined confidence thresholds of the predictive models. The experiments found that the proposed strategy can return a profit when following a conservative approach that focuses primarily on easy-to-predict matches where the predictive models display a high confidence level.


title: Implementing Software Defined Load Balancer and Firewall

abstract: Software-defined networking (SDN) is an architecture that aims to make networks fast and flexible. SDN's goal is to improve network control by enabling service providers as well as enterprises to respond quickly to changing business needs. In SDN, the administrator can shape traffic from a centralized control console without having to modify any of the individual switches belonging to the network. The SDN controller which is centralized directs the switches to deliver network services wherever they are needed, irrespective of the specific connections between a server and devices. This methodology is a shift from traditional network architecture, in which individual network devices make traffic decisions based on their configured routing tables. In this paper, I built and tested an SDN load balancer and firewall module using the Floodlight controller.


title: Post-training Quantization on Diffusion Models

abstract: Denoising diffusion (score-based) generative models have recently achieved significant accomplishments in generating realistic and diverse data. These approaches define a forward diffusion process for transforming data into noise and a backward denoising process for sampling data from noise. Unfortunately, the generation process of current denoising diffusion models is notoriously slow due to the lengthy iterative noise estimations, which rely on cumbersome neural networks. It prevents the diffusion models from being widely deployed, especially on edge devices. Previous works accelerate the generation process of diffusion model (DM) via finding shorter yet effective sampling trajectories. However, they overlook the cost of noise estimation with a heavy network in every iteration. In this work, we accelerate generation from the perspective of compressing the noise estimation network. Due to the difficulty of retraining DMs, we exclude mainstream training-aware compression paradigms and introduce post-training quantization (PTQ) into DM acceleration. However, the output distributions of noise estimation networks change with time-step, making previous PTQ methods fail in DMs since they are designed for single-time step scenarios. To devise a DM-specific PTQ method, we explore PTQ on DM in three aspects: quantized operations, calibration dataset, and calibration metric. We summarize and use several observations derived from all-inclusive investigations to formulate our method, which especially targets the unique multi-time-step structure of DMs. Experimentally, our method can directly quantize full-precision DMs into 8-bit models while maintaining or even improving their performance in a training-free manner. Importantly, our method can serve as a plug-and-play module on other fast-sampling methods, e.g., DDIM. The code is available at https://github.com/42Shawn/PTQ4DM .


title: Consensus-Based Optimization for Multi-Objective Problems: A Multi-Swarm Approach

abstract: We propose a multi-swarm approach to approximate the Pareto front of general multi-objective optimization problems that is based on the Consensus-based Optimization method (CBO). The algorithm is motivated step by step beginning with a simple extension of CBO based on fixed scalarization weights. To overcome the issue of choosing the weights we propose an adaptive weight strategy in the second modelling step. The modelling process is concluded with the incorporation of a penalty strategy that avoids clusters along the Pareto front and a diffusion term that prevents collapsing swarms. Altogether the proposed $K$-swarm CBO algorithm is tailored for a diverse approximation of the Pareto front and, simultaneously, the efficient set of general non-convex multi-objective problems. The feasibility of the approach is justified by analytic results, including convergence proofs, and a performance comparison to the well-known non-dominated sorting genetic algorithm (NSGA2) and the recently proposed one-swarm approach for multi-objective problems involving Consensus-based Optimization.


title: Isoparametric functions and solutions of Yamabe type equations on manifolds with boundary

abstract: Let $(M,g)$ be a compact Riemannian manifold with non-empty boundary. Provided $f$ an isoparametric function of $(M,g)$ we prove existence results for positive solutions of the Yamabe equation that are constant along the level sets of $f$. If $(M,g)$ has positive constant scalar curvature, minimal boundary and admits an isoparametric function we also prove multiplicity results for positive solutions of the Yamabe equation on $(M \times N,g+th) $ where $(N,h)$ is any closed Riemannian manifold with positive constant scalar curvature.


title: CWD: A Machine Learning based Approach to Detect Unknown Cloud Workloads

abstract: Workloads in modern cloud data centers are becoming increasingly complex. The number of workloads running in cloud data centers has been growing exponentially for the last few years, and cloud service providers (CSP) have been supporting on-demand services in real-time. Realizing the growing complexity of cloud environment and cloud workloads, hardware vendors such as Intel and AMD are increasingly introducing cloud-specific workload acceleration features in their CPU platforms. These features are typically targeted towards popular and commonly-used cloud workloads. Nonetheless, uncommon, customer-specific workloads (unknown workloads), if their characteristics are different from common workloads (known workloads), may not realize the potential of the underlying platform. To address this problem of realizing the full potential of the underlying platform, we develop a machine learning based technique to characterize, profile and predict workloads running in the cloud environment. Experimental evaluation of our technique demonstrates good prediction performance. We also develop techniques to analyze the performance of the model in a standalone manner.


title: Dynamical susceptibility of Skyrmion crystal

abstract: Using stereographic projection approach we develop a theory for calculation of dynamical susceptibility tensor of Skyrmion crystals (SkX), formed in thin ferromagnetic films with Dzyaloshinskii-Moriya interaction and in the external magnetic field. Staying whenever possible within analytical framework, we employ the model anzats for static SkX configuration and discuss small fluctuations around it. The obtained formulas are numerically analyzed in the important case of uniform susceptibility, accessible in magnetic resonance (MR) experiments. We show that, in addition to three characteristic MR frequencies discussed earlier both theoretically and experimentally, one should also expect several resonances of smaller amplitude at somewhat higher frequencies.


title: Cooperate or not Cooperate: Transfer Learning with Multi-Armed Bandit for Spatial Reuse in Wi-Fi

abstract: The exponential increase of wireless devices with highly demanding services such as streaming video, gaming and others has imposed several challenges to Wireless Local Area Networks (WLANs). In the context of Wi-Fi, IEEE 802.11ax brings high-data rates in dense user deployments. Additionally, it comes with new flexible features in the physical layer as dynamic Clear-Channel-Assessment (CCA) threshold with the goal of improving spatial reuse (SR) in response to radio spectrum scarcity in dense scenarios. In this paper, we formulate the Transmission Power (TP) and CCA configuration problem with an objective of maximizing fairness and minimizing station starvation. We present four main contributions into distributed SR optimization using Multi-Agent Multi-Armed Bandits (MAMABs). First, we propose to reduce the action space given the large cardinality of action combination of TP and CCA threshold values per Access Point (AP). Second, we present two deep Multi-Agent Contextual MABs (MA-CMABs), named Sample Average Uncertainty (SAU)-Coop and SAU-NonCoop as cooperative and non-cooperative versions to improve SR. In addition, we present an analysis whether cooperation is beneficial using MA-MABs solutions based on the e-greedy, Upper Bound Confidence (UCB) and Thompson techniques. Finally, we propose a deep reinforcement transfer learning technique to improve adaptability in dynamic environments. Simulation results show that cooperation via SAU-Coop algorithm contributes to an improvement of 14.7% in cumulative throughput, and 32.5% improvement of PLR when compared with no cooperation approaches. Finally, under dynamic scenarios, transfer learning contributes to mitigation of service drops for at least 60% of the total of users.


title: Gravitational collapse to extremal black holes and the third law of black hole thermodynamics

abstract: We construct examples of black hole formation from regular, one-ended asymptotically flat Cauchy data for the Einstein-Maxwell-charged scalar field system in spherical symmetry which are exactly isometric to extremal Reissner-Nordstr\"om after a finite advanced time along the event horizon. Moreover, in each of these examples the apparent horizon of the black hole coincides with that of a Schwarzschild solution at earlier advanced times. In particular, our result can be viewed as a definitive disproof of the "third law of black hole thermodynamics." The main step in the construction is a novel $C^k$ characteristic gluing procedure, which interpolates between a light cone in Minkowski space and a Reissner-Nordstr\"om event horizon with specified charge to mass ratio $e/M$. Our setup is inspired by the recent work of Aretakis-Czimek-Rodnianski on perturbative characteristic gluing for the Einstein vacuum equations. However, our construction is fundamentally nonperturbative and is based on a finite collection of scalar field pulses which are modulated by the Borsuk-Ulam theorem.


title: Towards Reliable Item Sampling for Recommendation Evaluation

abstract: Since Rendle and Krichene argued that commonly used sampling-based evaluation metrics are "inconsistent" with respect to the global metrics (even in expectation), there have been a few studies on the sampling-based recommender system evaluation. Existing methods try either mapping the sampling-based metrics to their global counterparts or more generally, learning the empirical rank distribution to estimate the top-$K$ metrics. However, despite existing efforts, there is still a lack of rigorous theoretical understanding of the proposed metric estimators, and the basic item sampling also suffers from the "blind spot" issue, i.e., estimation accuracy to recover the top-$K$ metrics when $K$ is small can still be rather substantial. In this paper, we provide an in-depth investigation into these problems and make two innovative contributions. First, we propose a new item-sampling estimator that explicitly optimizes the error with respect to the ground truth, and theoretically highlight its subtle difference against prior work. Second, we propose a new adaptive sampling method which aims to deal with the "blind spot" problem and also demonstrate the expectation-maximization (EM) algorithm can be generalized for such a setting. Our experimental results confirm our statistical analysis and the superiority of the proposed works. This study helps lay the theoretical foundation for adopting item sampling metrics for recommendation evaluation, and provides strong evidence towards making item sampling a powerful and reliable tool for recommendation evaluation.


title: Sketch-and-solve approaches to k-means clustering by semidefinite programming

abstract: We introduce a sketch-and-solve approach to speed up the Peng-Wei semidefinite relaxation of k-means clustering. When the data is appropriately separated we identify the k-means optimal clustering. Otherwise, our approach provides a high-confidence lower bound on the optimal k-means value. This lower bound is data-driven; it does not make any assumption on the data nor how it is generated. We provide code and an extensive set of numerical experiments where we use this approach to certify approximate optimality of clustering solutions obtained by k-means++.

categories: cs.LG cs.DS cs.IT math.IT math.OC math.ST stat.ML stat.TH


title: Mechanized Noninterference for Gradual Security

abstract: This paper presents the first machine-checked proof of noninterference for a language with gradual information-flow control, thereby establishing a rock solid foundation for secure programming languages that give programmers the choice between runtime versus compile-time enforcement. Along the way we uncovered a flaw in one of the noninterference proofs in the literature, and give a counterexample for one of the main lemmas. The particular language studied in this paper, $\lambda_{\mathtt{SEC}}^\star$, is based on the GLIO language of Azevedo de Amorim et al. [2020]. To make the design more accessible to other researchers, this paper contributes the first traditional semantics for the language, that is, we define compilation from $\lambda_{\mathtt{SEC}}^\star$ to a cast calculus and design a reduction semantics for the latter that includes blame tracking. In addition to the proof of noninterference, we also mechanize proofs of type safety, determinism, and that compilation preserves types.


title: Precision Studies of QCD in the Low Energy Domain of the EIC

abstract: The manuscript focuses on the high impact science of the EIC with objective to identify a portion of the science program for QCD precision studies that requires or greatly benefits from high luminosity and low center-of-mass energies. The science topics include (1) Generalized Parton Distributions, 3D imagining and mechanical properties of the nucleon (2) mass and spin of the nucleon (3) Momentum dependence of the nucleon in semi-inclusive deep inelastic scattering (4) Exotic meson spectroscopy (5) Science highlights of nuclei (6) Precision studies of Lattice QCD in the EIC era (7) Science of far-forward particle detection (8) Radiative effects and corrections (9) Artificial Intelligence (10) EIC interaction regions for high impact science program with discovery potential. This paper documents the scientific basis for supporting such a program and helps to define the path toward the realization of the second EIC interaction region.


title: Certain binary minimal codes constructed using simplicial complexes

abstract: In this manuscript, we work over the non-chain ring $\mathcal{R} = \mathbb{F}_2[u]/\langle u^3 - u\rangle $. Let $m\in \mathbb{N}$ and let $L, M, N \subseteq [m]:=\{1, 2, \dots, m\}$. For $X\subseteq [m]$, define $\Delta_X:=\{v \in \mathbb{F}_2^m : \textnormal{Supp}(v)\subseteq X\}$ and $D:= (1+u^2)D_1 + u^2D_2 + (u+u^2)D_3$, an ordered finite multiset consisting of elements from $\mathcal{R}^m$, where $D_1\in \{\Delta_L, \Delta_L^c\}, D_2\in \{\Delta_M, \Delta_M^c\}, D_3\in \{\Delta_N, \Delta_N^c\}$. The linear code $C_D$ over $\mathcal{R}$ defined by $\{\big(v\cdot d\big)_{d\in D} : v \in \mathcal{R}^m \}$ is studied for each $D$. Further, we also consider simplicial complexes with two maximal elements in the above work. We study their binary Gray images and the binary subfield-like codes corresponding to a certain $\mathbb{F}_{2}$-functional of $\mathcal{R}$. Sufficient conditions for these binary linear codes to be minimal and self-orthogonal are obtained in each case. Besides, we produce an infinite family of optimal codes with respect to the Griesmer bound. Most of the codes obtained in this manuscript are few-weight codes.


title: Detection of phonon helicity in nonchiral crystals with Raman scattering

abstract: Recently, it has been predicted that the Berry curvature of electrons can produce an angular momentum for phonons. In systems with time-reversal symmetry, the direction of the phonon angular momentum is locked to the phonon wave vector. Accordingly, this phenomenon has received the name of ``phonon helicity". Here, we present a theory to unveil the signatures of such phonon helicity using Raman scattering. We show that the intensity of Raman scattering for circularly polarized light in BaMnSb$_2$ (a prototypical nonchiral Dirac insulator) changes under a reversal of the phonon wave vector, and that the phonon helicity can be inferred from that change. We compare our results to recent reports of Raman-based detection of phonon angular momentum in chiral crystals.


title: Hard X-ray Observations of the Hydrogen-poor Superluminous Supernova SN 2018hti with NuSTAR

abstract: Some Hydrogen-poor superluminous supernovae are likely powered by a magnetar central engine, making their luminosity larger than common supernovae. Although a significant amount of X-ray flux is expected from the spin down of the magnetar, direct observational evidence is still to be found, giving rise to the "missing energy" problem. Here we present NuSTAR observations of nearby SN 2018hti 2.4y (rest frame) after its optical peak. We expect that, by this time, the ejecta have become optically thin for photons more energetic than about 15keV. No flux is detected at the position of the supernova down to $F_{\rm{10-30keV}} = 9.0\times 10^{-14}$ erg cm$^{-2}$ s$^{-1}$, or an upper limit of $7.9 \times 10^{41}$ erg s$^{-1}$ at a distance of 271Mpc. This constrains the fraction of bolometric luminosity from the putative spinning down magnetar to be $f_{\rm X} \lesssim 36$% in the 10-30keV range in a conservative case, $f_{\rm X} \lesssim 11$% in an optimistic case.


title: Log-enhanced discretization errors in integrated correlation functions

abstract: Integrated time-slice correlation functions $G(t)$ with weights $K(t)$ appear, e.g., in the moments method to determine $\alpha_s$ from heavy quark correlators, in the muon g-2 determination or in the determination of smoothed spectral functions. For the (leading-order-)normalised moment $R_4$ of the pseudo-scalar correlator we have non-perturbative results down to $a=10^{-2}$ fm and for masses, $m$, of the order of the charm mass in the quenched approximation. A significant bending of $R_4$ as a function of $a^2$ is observed at small lattice spacings. Starting from the Symanzik expansion of the integrand we derive the asymptotic convergence of the integral at small lattice spacing in the free theory and prove that the short distance part of the integral leads to $\log(a)$-enhanced discretisation errors when $G(t)K(t) \sim\, t $ for small $t$. In the interacting theory an unknown, function $K(a\Lambda)$ appears. For the $R_4$-case, we modify the observable to improve the short distance behavior and demonstrate that it results in a very smooth continuum limit. The strong coupling and the $\Lambda$-parameter can then be extracted. In general, and in particular for $g-2$, the short distance part of the integral should be determined by perturbation theory. The (dominating) rest can then be obtained by the controlled continuum limit of the lattice computation.


title: Edge Video Analytics: A Survey on Applications, Systems and Enabling Techniques

abstract: Video, as a key driver in the global explosion of digital information, can create tremendous benefits for human society. Governments and enterprises are deploying innumerable cameras for a variety of applications, e.g., law enforcement, emergency management, traffic control, and security surveillance, all facilitated by video analytics (VA). This trend is spurred by the rapid advancement of deep learning (DL), which enables more precise models for object classification, detection, and tracking. Meanwhile, with the proliferation of Internet-connected devices, massive amounts of data are generated daily, overwhelming the cloud. Edge computing, an emerging paradigm that moves workloads and services from the network core to the network edge, has been widely recognized as a promising solution. The resulting new intersection, edge video analytics (EVA), begins to attract widespread attention. Nevertheless, only a few loosely-related surveys exist on this topic. The basic concepts of EVA (e.g., definition, architectures) were not fully elucidated due to the rapid development of this domain. To fill these gaps, we provide a comprehensive survey of the recent efforts on EVA. In this paper, we first review the fundamentals of edge computing, followed by an overview of VA. EVA systems and their enabling techniques are discussed next. In addition, we introduce prevalent frameworks and datasets to aid future researchers in the development of EVA systems. Finally, we discuss existing challenges and foresee future research directions. We believe this survey will help readers comprehend the relationship between VA and edge computing, and spark new ideas on EVA.


title: Hierarchical Control Strategy for Moving A Robot Manipulator Between Small Containers

abstract: In this paper, we study the implementation of a model predictive controller (MPC) for the task of object manipulation in a highly uncertain environment (e.g., picking objects from a semi-flexible array of densely packed bins). As a real-time perception-driven feedback controller, MPC is robust to the uncertainties in this environment. However, our experiment shows MPC cannot control a robot to complete a sequence of motions in a heavily occluded environment due to its myopic nature. It will benefit from adding a high-level policy that adaptively adjusts the optimization problem for MPC.


title: Prime groupoid graded rings with applications to partial skew groupoid rings

abstract: In this paper, we investigate primeness of groupoid graded rings. We provide a set of necessary and sufficient conditions for primeness of a nearly-epsilon strongly groupoid graded ring. Furthermore, we apply our main result to get a characterization of prime partial skew groupoid rings, and in particular of prime groupoid rings, thereby generalizing a classical result by Connell and partially generalizing recent results by Steinberg.


title: Reconnectads

abstract: We introduce a new operad-like structure that we call a reconnectad; the ``input'' of an element of a reconnectad is a finite simple graph, rather than a finite set, and ``compositions'' of elements are performed according to the notion of the reconnected complement of a subgraph. The prototypical example of a reconnectad is given by the collection of toric varieties of graph associahedra of Carr and Devadoss, with the structure operations given by inclusions of orbits closures. We develop the general theory of reconnectads, and use it to study the ``wonderful reconnectad'' assembled from homology groups of complex toric varieties of graph associahedra.


title: Confidence-Aware Graph Neural Networks for Learning Reliability Assessment Commitments

abstract: Reliability Assessment Commitment (RAC) Optimization is increasingly important in grid operations due to larger shares of renewable generations in the generation mix and increased prediction errors. Independent System Operators (ISOs) also aim at using finer time granularities, longer time horizons, and possibly stochastic formulations for additional economic and reliability benefits. The goal of this paper is to address the computational challenges arising in extending the scope of RAC formulations. It presents RACLearn that (1) uses a Graph Neural Network (GNN) based architecture to predict generator commitments and active line constraints, (2) associates a confidence value to each commitment prediction, (3) selects a subset of the high-confidence predictions, which are (4) repaired for feasibility, and (5) seeds a state-of-the-art optimization algorithm with feasible predictions and active constraints. Experimental results on exact RAC formulations used by the Midcontinent Independent System Operator (MISO) and an actual transmission network (8965 transmission lines, 6708 buses, 1890 generators, and 6262 load units) show that the RACLearn framework can speed up RAC optimization by factors ranging from 2 to 4 with negligible loss in solution quality.


title: Computational Analysis of Bubble-Structure Interactions in Near-Field Underwater Explosion

abstract: The response of underwater structures to a near-field explosion is coupled with the dynamics of the explosion bubble and the surrounding water. This multiphase fluid-structure interaction process is investigated using a model problem that features the yielding and collapse of a thin-walled aluminum cylinder. A recently developed computational framework that couples a compressible fluid dynamics solver with a structural dynamics solver is employed. The fluid-structure and liquid-gas interfaces are tracked using embedded boundary and level set methods. The conservation law across the interfaces is enforced by solving one-dimensional bimaterial Riemann problems. The initial pressure inside the explosion bubble is varied by two orders of magnitude in different test cases. Three different modes of collapse are discovered, including an horizontal collapse (i.e. with one lobe extending towards the explosive charge) that appears counterintuitive, yet has been observed in previous laboratory experiments. Because of the transition of modes, the time it takes for the structure to reach self-contact does not decrease monotonically as the explosion magnitude increases. The flow fields, the bubble dynamics, and the transient structural deformation are visualized to elucidate the cause of each collapse mode and the mode transitions. The result suggests that the pressure pulse resulting from the contraction of the explosion bubble has significant effect on the structure's collapse. The phase difference between the structural vibration and bubble oscillation influences the structure's mode of collapse. Furthermore, the transient structural deformation has clear effect on the bubble dynamics, leading to a two-way interaction. A liquid jet that points away from the structure is observed. Compared to the liquid jets produced by bubbles collapsing near a rigid wall, this jet is in the opposite direction.


title: Reducing Runtime Overhead via Use-Based Migration in Neutral Atom Quantum Architectures

abstract: Neutral atoms are a promising choice for scalable quantum computing architectures. Features such as long distance interactions and native multiqubit gates offer reductions in communication costs and operation count. However, the trapped atoms used as qubits can be lost over the course of computation and due to adverse environmental factors. The value of a lost computation qubit cannot be recovered and requires the reloading of the array and rerunning of the computation, greatly increasing the number of runs of a circuit. Software mitigation strategies exist but exhaust the original mapped locations of the circuit slowly and create more spread out clusters of qubits across the architecture decreasing the probability of success. We increase flexibility by developing strategies that find all reachable qubits, rather only adjacent hardware qubits. Second, we divide the architecture into separate sections, and run the circuit in each section, free of lost atoms. Provided the architecture is large enough, this resets the circuit without having to reload the entire architecture. This increases the number of effective shots before reloading by a factor of two for a circuit that utilizes 30% of the architecture. We also explore using these sections to parallelize execution of circuits, reducing the overall runtime by a total 50% for 30 qubit circuit. These techniques contribute to a dynamic new set of strategies to combat the detrimental effects of lost computational space.


title: Quantum secret aggregation utilizing a network of agents

abstract: In this work we consider the following problem: given a network of spies, all distributed in different locations in space, and assuming that each spy possesses a small, but incomplete by itself part of a big secret, is it possible to securely transmit all these partial secrets to the spymaster, so that they can be combined together in order to reveal the big secret? We refer to it as the Quantum Secret Aggregation problem, and we propose a protocol, in the form of a quantum game, with Alice taking over the role of the spymaster, that addresses this problem in complete generality. Our protocol relies on the use of maximally entangled GHZ tuples, which are symmetrically distributed among Alice and all her spies. It is the power of entanglement that makes possible the secure transmission of the small partial secrets from the agents to the spymaster. As an additional bonus, entanglement guarantees the security of the protocol, by making it statistically improbable for the notorious eavesdropper Eve to steal the big secret.


title: PIDS: Joint Point Interaction-Dimension Search for 3D Point Cloud

abstract: The interaction and dimension of points are two important axes in designing point operators to serve hierarchical 3D models. Yet, these two axes are heterogeneous and challenging to fully explore. Existing works craft point operator under a single axis and reuse the crafted operator in all parts of 3D models. This overlooks the opportunity to better combine point interactions and dimensions by exploiting varying geometry/density of 3D point clouds. In this work, we establish PIDS, a novel paradigm to jointly explore point interactions and point dimensions to serve semantic segmentation on point cloud data. We establish a large search space to jointly consider versatile point interactions and point dimensions. This supports point operators with various geometry/density considerations. The enlarged search space with heterogeneous search components calls for a better ranking of candidate models. To achieve this, we improve the search space exploration by leveraging predictor-based Neural Architecture Search (NAS), and enhance the quality of prediction by assigning unique encoding to heterogeneous search components based on their priors. We thoroughly evaluate the networks crafted by PIDS on two semantic segmentation benchmarks, showing ~1% mIOU improvement on SemanticKITTI and S3DIS over state-of-the-art 3D models.


title: Macroscopic Wave Propagation for 2D Lattice with Random Masses

abstract: We consider a simple two-dimemsional harmonic lattice with random, independent and identically distributed masses. Using the methods of stochastic homogenization, we show that solutions with long wave initial data converge in an appropriate sense to solutions of an effective wave equation. The convergence is strong and almost sure. In addition, the role of the lattice's dimension in the rate of convergence is discussed. The technique combines energy estimates with powerful classical results about sub-Gaussian random variables.


title: Obtaining a Single-Photon Weak Value from Experiments using a Strong (Many-Photon) Coherent State

abstract: A common type of weak-value experiment prepares a single particle in one state, weakly measures the occupation number of another state, and post-selects on finding the particle in a third state (a 'click'). Most weak-value experiments have been done with photons, but the heralded preparation of a single photon is difficult and slow of rate. Here we show that the weak value mentioned above can be measured using strong (many-photon) coherent states, while still needing only a 'click' detector such as an avalanche photodiode. One simply subtracts the no-click weak value from the click weak-value, and scales the answer by a simple function of the click probability.


title: Understanding the Impact of Adversarial Robustness on Accuracy Disparity

abstract: While it has long been empirically observed that adversarial robustness may be at odds with standard accuracy and may have further disparate impacts on different classes, it remains an open question to what extent such observations hold and how the class imbalance plays a role within. In this paper, we attempt to understand this question of accuracy disparity by taking a closer look at linear classifiers under a Gaussian mixture model. We decompose the impact of adversarial robustness into two parts: an inherent effect that will degrade the standard accuracy on all classes due to the robustness constraint, and the other caused by the class imbalance ratio, which will increase the accuracy disparity compared to standard training. Furthermore, we also show that such effects extend beyond the Gaussian mixture model, by generalizing our data model to the general family of stable distributions. More specifically, we demonstrate that while the constraint of adversarial robustness consistently degrades the standard accuracy in the balanced class setting, the class imbalance ratio plays a fundamentally different role in accuracy disparity compared to the Gaussian case, due to the heavy tail of the stable distribution. We additionally perform experiments on both synthetic and real-world datasets to corroborate our theoretical findings. Our empirical results also suggest that the implications may extend to nonlinear models over real-world datasets. Our code is publicly available on GitHub at https://github.com/Accuracy-Disparity/AT-on-AD.


title: Unraveling heterogeneity of ADNI's time-to-event data using conditional entropy Part-I: Cross-sectional study

abstract: Through Alzheimer's Disease Neuroimaging Initiative (ADNI), time-to-event data: from the pre-dementia state of mild cognitive impairment (MCI) to the diagnosis of Alzheimer's disease (AD), is collected and analyzed by explicitly unraveling prognostic heterogeneity among 346 uncensored and 557 right censored subjects under structural dependency among covariate features. The non-informative censoring mechanism is tested and confirmed based on conditional-vs-marginal entropies evaluated upon contingency tables built by the Redistribute-to-the-right algorithm. The Categorical Exploratory Data Analysis (CEDA) paradigm is applied to evaluate conditional entropy-based associative patterns between the categorized response variable against 16 categorized covariable variables all having 4 categories. Two order-1 global major factors: V9 (MEM-mean) and V8 (ADAS13.bl) are selected sharing the highest amounts of mutual information with the response variable. This heavily censored data set is analyzed by Cox's proportional hazard (PH) modeling. Comparisons of PH and CEDA results on a global scale are complicated under the structural dependency of covariate features. To alleviate such complications, V9 and V8 are taken as two potential perspectives of heterogeneity and the entire collections of subjects are divided into two sets of four sub-collections. CEDA major factor selection protocol is applied to all sub-collections to figure out which features provide extra information. Graphic displays are developed to explicitly unravel conditional entropy expansions upon perspectives of heterogeneity in ADNI data. On the local scale, PH analysis is carried out and results are compared with CEDA's. We conclude that, when facing structural dependency among covariates and heterogeneity in data, CEDA and its major factor selection provide significant merits for manifesting data's multiscale information content.


title: Atomic shell structure from an orbital-free-related density-functional-theory Pauli potential

abstract: Polymer self-consistent field theory techniques are used to find radial electron densities and total binding energies for isolated atoms. Quantum particles are modelled as Gaussian threads with ring-polymer architecture in a four dimensional thermal-space, and a Pauli potential is postulated based on classical excluded volume implemented in the thermal-space using Edwards/Flory-Huggins interactions in a mean-field approximation. Other approximations include a Fermi-Amaldi correction for electron-electron self-interactions, a spherical averaging approximation to reduce the dimensionality of the problem, and the neglect of correlations. Polymer scaling theory is used to show that the excluded volume form of Pauli potential reduces to the known Thomas-Fermi energy density in the uniform limit. Self-consistent equations are solved using a bilinear Fourier expansion, with radial basis functions, for the first eighteen elements of the periodic table. Radial electron densities show correct shell structure, and the errors on the total binding energies compared to known binding energies are less than 9% for the lightest elements and drop to 3% or less for atoms heavier than nitrogen. More generally, it is suggested that only two postulates are needed within classical statistical mechanics to achieve equivalency of predictions with static, non-relativistic quantum mechanics: First, quantum particles are modelled as Gaussian threads in four dimensional thermal-space and, second, pairs of threads (allowing for spin) are subject to classical excluded volume in the thermal-space. It is shown that these two postulates in thermal-space become the same as the Heisenberg uncertainty principle and the Pauli exclusion principle in three dimensional space.


title: Inclusion of heavy spin effects in the $u d \bar{b} \bar{b}$ $I(J^{P})=0(1^{-})$ four-quark channel in the Born-Oppenheimer approximation

abstract: We refine our previous study of a $u d \bar{b} \bar{b}$ tetraquark resonance with quantum numbers $I(J^{P})=0(1^{-})$, which is based on antiheavy-antiheavy lattice QCD potentials, by including heavy quark spin effects via the mass difference of the $B$ and the $B^{*}$ meson. This leads to a coupled channel Schr\"odinger equation, where the two channels correspond to $BB$ and $B^{*}B^{*}$, respectively. We search for $\mbox{T}$ matrix poles in the complex energy plane, but do not find any indication for the existence of a tetraquark resonance in this refined coupled channel approach. We also vary the antiheavy-antiheavy potentials as well as the $b$ quark mass to further understand the dynamics of this four-quark system.


title: Superpoint Transformer for 3D Scene Instance Segmentation

abstract: Most existing methods realize 3D instance segmentation by extending those models used for 3D object detection or 3D semantic segmentation. However, these non-straightforward methods suffer from two drawbacks: 1) Imprecise bounding boxes or unsatisfactory semantic predictions limit the performance of the overall 3D instance segmentation framework. 2) Existing method requires a time-consuming intermediate step of aggregation. To address these issues, this paper proposes a novel end-to-end 3D instance segmentation method based on Superpoint Transformer, named as SPFormer. It groups potential features from point clouds into superpoints, and directly predicts instances through query vectors without relying on the results of object detection or semantic segmentation. The key step in this framework is a novel query decoder with transformers that can capture the instance information through the superpoint cross-attention mechanism and generate the superpoint masks of the instances. Through bipartite matching based on superpoint masks, SPFormer can implement the network training without the intermediate aggregation step, which accelerates the network. Extensive experiments on ScanNetv2 and S3DIS benchmarks verify that our method is concise yet efficient. Notably, SPFormer exceeds compared state-of-the-art methods by 4.3% on ScanNetv2 hidden test set in terms of mAP and keeps fast inference speed (247ms per frame) simultaneously. Code is available at https://github.com/sunjiahao1999/SPFormer.


title: Compact optical grating compressor

abstract: A novel design of a grating-based optical pulse compressor is proposed. The proposed compressor provides a large group delay dispersion while keeping the compressor linear size small. The design of the proposed compressor is based on a traditional Treacy compressor with a straightforward modification of inserting two lenses between the compressor's gratings. This simple alternation aims to substantially increase group delay dispersion of the compressor or alternatively to decrease the compressor size while maintaining its group delay dispersion. A theoretical description of the enhanced compressor has been developed in the paraxial approximation. A detailed numerical model has been built to calculate the compressor parameters more accurately. These theoretical studies have revealed that the enhanced optical compressor provides a significant increase in the group delay dispersion compared to a standard Treacy compressor.


title: Well-posedness theory for non-homogeneous incompressible fluids with odd viscosity

abstract: Several fluid systems are characterised by time reversal and parity breaking. Examples of such phenomena arise both in quantum and classical hydrodynamics. In these situations, the viscosity tensor, often dubbed ``odd viscosity'', becomes non-dissipative. At the mathematical level, this fact translates into a loss of derivatives at the level of \textsl{a priori} estimates: while the odd viscosity term depends on derivatives of the velocity field, no parabolic smoothing effect can be expected. In the present paper, we establish a well-posedness theory in Sobolev spaces for a system of incompressible non-homogeneous fluids with odd viscosity. The crucial point of the analysis is the introduction of a set of \emph{good unknowns}, which allow for the emerging of a hidden hyperbolic structure underlying the system of equations. It is exactly this hyperbolic structure which makes it possible to circumvent the derivative loss and propagate high enough Sobolev norms of the solution. The well-posedness result is local in time; two continuation criteria are also established.


title: Graphical models for infinite measures with applications to extremes and L\'evy processes

abstract: Conditional independence and graphical models are well studied for probability distributions on product spaces. We propose a new notion of conditional independence for any measure $\Lambda$ on the punctured Euclidean space $\mathbb R^d\setminus \{0\}$ that explodes at the origin. The importance of such measures stems from their connection to infinitely divisible and max-infinitely divisible distributions, where they appear as L\'evy measures and exponent measures, respectively. We characterize independence and conditional independence for $\Lambda$ in various ways through kernels and factorization of a modified density, including a Hammersley-Clifford type theorem for undirected graphical models. As opposed to the classical conditional independence, our notion is intimately connected to the support of the measure $\Lambda$. Our general theory unifies and extends recent approaches to graphical modeling in the fields of extreme value analysis and L\'evy processes. Our results for the corresponding undirected and directed graphical models lay the foundation for new statistical methodology in these areas.


title: Accelerated Nonnegative Tensor Completion via Integer Programming

abstract: The problem of tensor completion has applications in healthcare, computer vision, and other domains. However, past approaches to tensor completion have faced a tension in that they either have polynomial-time computation but require exponentially more samples than the information-theoretic rate, or they use fewer samples but require solving NP-hard problems for which there are no known practical algorithms. A recent approach, based on integer programming, resolves this tension for nonnegative tensor completion. It achieves the information-theoretic sample complexity rate and deploys the Blended Conditional Gradients algorithm, which requires a linear (in numerical tolerance) number of oracle steps to converge to the global optimum. The tradeoff in this approach is that, in the worst case, the oracle step requires solving an integer linear program. Despite this theoretical limitation, numerical experiments show that this algorithm can, on certain instances, scale up to 100 million entries while running on a personal computer. The goal of this paper is to further enhance this algorithm, with the intention to expand both the breadth and scale of instances that can be solved. We explore several variants that can maintain the same theoretical guarantees as the algorithm, but offer potentially faster computation. We consider different data structures, acceleration of gradient descent steps, and the use of the Blended Pairwise Conditional Gradients algorithm. We describe the original approach and these variants, and conduct numerical experiments in order to explore various tradeoffs in these algorithmic design choices.


title: Approximate Gibbs Sampler for Efficient Inference of Hierarchical Bayesian Models for Grouped Count Data

abstract: Hierarchical Bayesian Poisson regression models (HBPRMs) provide a flexible modeling approach of the relationship between predictors and count response variables. The applications of HBPRMs to large-scale datasets require efficient inference algorithms due to the high computational cost of inferring many model parameters based on random sampling. Although Markov Chain Monte Carlo (MCMC) algorithms have been widely used for Bayesian inference, sampling using this class of algorithms is time-consuming for applications with large-scale data and time-sensitive decision-making, partially due to the non-conjugacy of many models. To overcome this limitation, this research develops an approximate Gibbs sampler (AGS) to efficiently learn the HBPRMs while maintaining the inference accuracy. In the proposed sampler, the data likelihood is approximated with Gaussian distribution such that the conditional posterior of the coefficients has a closed-form solution. Numerical experiments using real and synthetic datasets with small and large counts demonstrate the superior performance of AGS in comparison to the state-of-the-art sampling algorithm, especially for large datasets.


title: Determining the viscosity of the Navier-Stokes equations from observations of finitely many modes

abstract: In this work, we ask and answer the question: when is the viscosity of a fluid uniquely determined from spatially sparse measurements of its velocity field? We pose the question mathematically as an optimization problem using the determining map (the mapping of data to an approximation made via a nudging algorithm) to define a loss functional, the minimization of which solves the inverse problem of identifying the true viscosity given the measurement data. We give explicit a priori conditions for the well-posedness of this inverse problem. In addition, we show that smallness of the loss functional implies proximity to the true viscosity. We then present an algorithm for solving the inverse problem and prove its convergence.


title: Generation of vortices in the Ginzburg-Landau heat flow

abstract: We consider the Ginzburg-Landau heat flow on the two-dimensional flat torus, starting from an initial data with a finite number of nondegenerate zeros -- but possibly very high initial energy. We show that the initial zeros are conserved and the flow rapidly enters a logarithmic energy regime, from which the evolution of vortices can be described by the works of Bethuel, Orlandi and Smets.


title: Decentralized Learning with Multi-Headed Distillation

abstract: Decentralized learning with private data is a central problem in machine learning. We propose a novel distillation-based decentralized learning technique that allows multiple agents with private non-iid data to learn from each other, without having to share their data, weights or weight updates. Our approach is communication efficient, utilizes an unlabeled public dataset and uses multiple auxiliary heads for each client, greatly improving training efficiency in the case of heterogeneous data. This approach allows individual models to preserve and enhance performance on their private tasks while also dramatically improving their performance on the global aggregated data distribution. We study the effects of data and model architecture heterogeneity and the impact of the underlying communication graph topology on learning efficiency and show that our agents can significantly improve their performance compared to learning in isolation.


title: VideoFACT: Detecting Video Forgeries Using Attention, Scene Context, and Forensic Traces

abstract: Fake videos represent an important misinformation threat. While existing forensic networks have demonstrated strong performance on image forgeries, recent results reported on the Adobe VideoSham dataset show that these networks fail to identify fake content in videos. In this paper, we show that this is due to video coding, which introduces local variation into forensic traces. In response, we propose VideoFACT - a new network that is able to detect and localize a wide variety of video forgeries and manipulations. To overcome challenges that existing networks face when analyzing videos, our network utilizes both forensic embeddings to capture traces left by manipulation, context embeddings to control for variation in forensic traces introduced by video coding, and a deep self-attention mechanism to estimate the quality and relative importance of local forensic embeddings. We create several new video forgery datasets and use these, along with publicly available data, to experimentally evaluate our network's performance. These results show that our proposed network is able to identify a diverse set of video forgeries, including those not encountered during training. Furthermore, we show that our network can be fine-tuned to achieve even stronger performance on challenging AI-based manipulations.


title: Families of Perfect Tensors

abstract: Perfect tensors are the tensors corresponding to the absolutely maximally entangled states, a special type of quantum states of interest in quantum information theory. We establish a method to compute parameterized families of perfect tensors in $(\mathbb{C}^d)^{\otimes 4}$ using exponential maps from Lie theory. With this method, we find explicit examples of non-classical perfect tensors in $(\mathbb{C}^3)^{\otimes 4}$. In particular, we answer an open question posted by \.Zyczkowski et al.


title: Exploiting STAR-RISs in Near-Field Communications

abstract: The reconfigurable intelligent surface (RIS) is a promising technology to provide smart radio environment. In contrast to the well-studied patch-array-based RISs, this work focuses on the metasurface-based RISs and simultaneously transmitting and reflecting (STAR)-RISs where the elements have millimeter or even molecular sizes. For these meticulous metasurface structures, near-field effects are dominant and a continuous electric current distribution should be adopted for capturing their electromagnetic response instead of discrete phase-shift matrices. Exploiting the electric current distribution, a Green's function method based channel model is proposed. Based on the proposed model, performance analysis is carried out for RISs and STAR-RISs. 1) For the transmitting/reflecting-only RIS-aided single-user scenario, closed-formed expressions for the near-field/far-field boundary and the end-to-end channel gain are derived. Then, degrees-of-freedom (DoFs) and the power scaling laws are obtained. It is proved that the near-field channel exhibits higher DoFs than the far-field channel. It is also confirmed that when communication distance increases beyond the field boundary, the near-field power scaling law degrades to the well-known far-field result. 2) For the STAR-RIS-aided multi-user scenario, three practical STAR-RIS configuration strategies are proposed, namely power splitting (PS), selective element grouping (SEG), and random element grouping (REG) strategies. The channel gains for users are derived within both the pure near-field regime and the hybrid near-field and far-field regime. Finally, numerical results confirm that: 1) for metasurface-based RISs, the field boundary depends on the sizes of both the RIS and the receiver, 2) the received power scales quadratically with the number of elements within the far-field regime and scales linearly within the near-field regime.


title: Disentanglement of Topological and Dynamical Fields in 3d Higher-Spin Theory within Shifted Homotopy Approach

abstract: The first-order correction to the one-form sector of equations of the $3d$ higher-spin theory is derived from the generating nonlinear HS system by virtue of the shifted homotopy approach. The family of solutions to the generating system that disentangles equations for dynamical and topological fields in the first order of perturbation theory is found. This family is shown to belong to the different cohomology class compared to the solution found earlier by the direct methods. The related cohomology is shown to be the same as that underlying the mass deformation in the matter sector of $3d$ higher-spin equations.


title: Revisiting Over-smoothing and Over-squashing Using Ollivier-Ricci Curvature

abstract: Graph Neural Networks (GNNs) had been demonstrated to be inherently susceptible to the problems of over-smoothing and over-squashing. These issues prohibit the ability of GNNs to model complex graph interactions by limiting their effectiveness in taking into account distant information. Our study reveals the key connection between the local graph geometry and the occurrence of both of these issues, thereby providing a unified framework for studying them at a local scale using the Ollivier-Ricci curvature. Specifically, we demonstrate that over-smoothing is linked to positive graph curvature while over-squashing is linked to negative graph curvature. Based on our theory, we propose the Batch Ollivier-Ricci Flow, a novel rewiring algorithm capable of simultaneously addressing both over-smoothing and over-squashing.


title: Nitrous Oxide and Climate

abstract: Higher concentrations of atmospheric nitrous oxide (N2O) are expected to slightly warm Earth's surface because of increases in radiative forcing. Radiative forcing is the difference in the net upward thermal radiation flux from the Earth through a transparent atmosphere and radiation through an otherwise identical atmosphere with greenhouse gases. Radiative forcing, normally measured in W/m^2, depends on latitude, longitude and altitude, but it is often quoted for the tropopause, about 11 km of altitude for temperate latitudes, or for the top of the atmosphere at around 90 km. For current concentrations of greenhouse gases, the radiative forcing per added N2O molecule is about 230 times larger than the forcing per added carbon dioxide (CO2) molecule. This is due to the heavy saturation of the absorption band of the relatively abundant greenhouse gas, CO2, compared to the much smaller saturation of the absorption bands of the trace greenhouse gas N2O. But the rate of increase of CO2 molecules, about 2.5 ppm/year (ppm = part per million by mole), is about 3000 times larger than the rate of increase of N2O molecules, which has held steady at around 0.00085 ppm/year since 1985. So, the contribution of nitrous oxide to the annual increase in forcing is 230/3000 or about 1/13 that of CO2. If the main greenhouse gases, CO2, CH4 and N2O have contributed about 0.1 C/decade of the warming observed over the past few decades, this would correspond to about 0.00064 K per year or 0.064 K per century of warming from N2O. Proposals to place harsh restrictions on nitrous oxide emissions because of warming fears are not justified by these facts. Restrictions would cause serious harm; for example, by jeopardizing world food supplies.


title: 3UCubed: The IMAP Student Collaboration CubeSat Project

abstract: The 3UCubed project is a 3U CubeSat being jointly developed by the University of New Hampshire, Sonoma State University, and Howard University as a part of the NASA Interstellar Mapping and Acceleration Probe, IMAP, student collaboration. This project comprises of a multidisciplinary team of undergraduate students from all three universities. The mission goal of the 3UCubed is to understand how Earths polar upper atmosphere the thermosphere in Earths auroral regions, responds to particle precipitation and solar wind forcing, and internal magnetospheric processes. 3UCubed includes two instruments with rocket heritage to achieve the science mission: an ultraviolet photomultiplier tube, UVPMT, and an electron retarding potential analyzer ERPA. The spacecraft bus consists of the following subsystems: Attitude Determination and Control, Command and Data Handling, Power, Communication, Structural, and Thermal. Currently, the project is in the post-PDR stage, starting to build and test engineering models to develop a FlatSat prior to critical design review in 2023. The goal is to launch at least one 3U CubeSat to collect science data close to the anticipated peak of Solar Cycle 25 around July 2025. Our mother mission, IMAP, is also projected to launch in 2025, which will let us jointly analyze the science data of the main mission, providing the solar wind measurements and inputs to the magnetosphere with that of 3UCubed, providing the response of Earths cusp to these inputs.


title: Towards Preserving Semantic Structure in Argumentative Multi-Agent via Abstract Interpretation

abstract: Over the recent twenty years, argumentation has received considerable attention in the fields of knowledge representation, reasoning, and multi-agent systems. However, argumentation in dynamic multi-agent systems encounters the problem of significant arguments generated by agents, which comes at the expense of representational complexity and computational cost. In this work, we aim to investigate the notion of abstraction from the model-checking perspective, where several arguments are trying to defend the same position from various points of view, thereby reducing the size of the argumentation framework whilst preserving the semantic flow structure in the system.


title: Mathematically Modeling the Lexicon Entropy of Emergent Language

abstract: We formulate a stochastic process, FiLex, as a mathematical model of lexicon entropy in deep learning-based emergent language systems. Defining a model mathematically allows it to generate clear predictions which can be directly and decisively tested. We empirically verify across four different environments that FiLex predicts the correct correlation between hyperparameters (training steps, lexicon size, learning rate, rollout buffer size, and Gumbel-Softmax temperature) and the emergent language's entropy in 20 out of 20 environment-hyperparameter combinations. Furthermore, our experiments reveal that different environments show diverse relationships between their hyperparameters and entropy which demonstrates the need for a model which can make well-defined predictions at a precise level of granularity.


title: A Survey of Relevant Text Mining Technology

abstract: Recent advances in text mining and natural language processing technology have enabled researchers to detect an authors identity or demographic characteristics, such as age and gender, in several text genres by automatically analysing the variation of linguistic characteristics. However, applying such techniques in the wild, i.e., in both cybercriminal and regular online social media, differs from more general applications in that its defining characteristics are both domain and process dependent. This gives rise to a number of challenges of which contemporary research has only scratched the surface. More specifically, a text mining approach applied on social media communications typically has no control over the dataset size, the number of available communications will vary across users. Hence, the system has to be robust towards limited data availability. Additionally, the quality of the data cannot be guaranteed. As a result, the approach needs to be tolerant to a certain degree of linguistic noise (for example, abbreviations, non-standard language use, spelling variations and errors). Finally, in the context of cybercriminal fora, it has to be robust towards deceptive or adversarial behaviour, i.e. offenders who attempt to hide their criminal intentions (obfuscation) or who assume a false digital persona (imitation), potentially using coded language. In this work we present a comprehensive survey that discusses the problems that have already been addressed in current literature and review potential solutions. Additionally, we highlight which areas need to be given more attention.


title: Data-driven extraction of the substructure of quark and gluon jets in proton-proton and heavy-ion collisions

abstract: The modification of quark- and gluon-initiated jets in the quark-gluon plasma produced in heavy-ion collisions is a long-standing question that has not yet received a definitive answer from experiments. In particular, the size of the modifications in the quark-gluon plasma differs between theoretical models. Therefore a fully data-driven technique is crucial for an unbiased extraction of the quark and gluon jet spectra and substructure. Corroborating past results, I demonstrate the capability of a fully data-driven technique called topic modeling in separating quark and gluon contributions to jet observables. The data-driven topic separation results can further be used to extract jet substructures, such as jet shapes and jet fragmentation function, and their respective QGP modifications. In addition, I propose the use of machine learning constructed observables and demonstrate the potential to increase separability for the input observable. This proof-of-concept study is based on proton-proton and heavy-ion collision events from the PYQUEN generator with statistics accessible in Run 4 of the Large Hadron Collider. These results suggest the potential for an experimental determination of quark- and gluon-jet spectra, their substructures, and their modification in the QGP.