title: Parallel Repetition for the GHZ Game: Exponential Decay

abstract: We show that the value of the $n$-fold repeated GHZ game is at most $2^{-\Omega(n)}$, improving upon the polynomial bound established by Holmgren and Raz. Our result is established via a reduction to approximate subgroup type questions from additive combinatorics.


title: Assessing Quality-Diversity Neuro-Evolution Algorithms Performance in Hard Exploration Problems

abstract: A fascinating aspect of nature lies in its ability to produce a collection of organisms that are all high-performing in their niche. Quality-Diversity (QD) methods are evolutionary algorithms inspired by this observation, that obtained great results in many applications, from wing design to robot adaptation. Recently, several works demonstrated that these methods could be applied to perform neuro-evolution to solve control problems in large search spaces. In such problems, diversity can be a target in itself. Diversity can also be a way to enhance exploration in tasks exhibiting deceptive reward signals. While the first aspect has been studied in depth in the QD community, the latter remains scarcer in the literature. Exploration is at the heart of several domains trying to solve control problems such as Reinforcement Learning and QD methods are promising candidates to overcome the challenges associated. Therefore, we believe that standardized benchmarks exhibiting control problems in high dimension with exploration difficulties are of interest to the QD community. In this paper, we highlight three candidate benchmarks and explain why they appear relevant for systematic evaluation of QD algorithms. We also provide open-source implementations in Jax allowing practitioners to run fast and numerous experiments on few compute resources.


title: SkillS: Adaptive Skill Sequencing for Efficient Temporally-Extended Exploration

abstract: The ability to effectively reuse prior knowledge is a key requirement when building general and flexible Reinforcement Learning (RL) agents. Skill reuse is one of the most common approaches, but current methods have considerable limitations.For example, fine-tuning an existing policy frequently fails, as the policy can degrade rapidly early in training. In a similar vein, distillation of expert behavior can lead to poor results when given sub-optimal experts. We compare several common approaches for skill transfer on multiple domains including changes in task and system dynamics. We identify how existing methods can fail and introduce an alternative approach to mitigate these problems. Our approach learns to sequence existing temporally-extended skills for exploration but learns the final policy directly from the raw experience. This conceptual split enables rapid adaptation and thus efficient data collection but without constraining the final solution.It significantly outperforms many classical methods across a suite of evaluation tasks and we use a broad set of ablations to highlight the importance of differentc omponents of our method.


title: Phase function methods for second order inhomogeneous linear ordinary differential equations

abstract: It is well known that second order homogeneous linear ordinary differential equations with slowly varying coefficients admit slowly varying phase functions. This observation underlies the Liouville-Green method and many other techniques for the asymptotic approximation of the solutions of such equations. It is also the basis of a recently developed numerical algorithm that, in many cases of interest, runs in time independent of the magnitude of the equation's coefficients and achieves accuracy on par with that predicted by its condition number. Here we point out that a large class of second order inhomogeneous linear ordinary differential equations can be efficiently and accurately solved by combining phase function methods for second order homogeneous linear ordinary differential equations with a variant of the adaptive Levin method for evaluating oscillatory integrals.


title: Attention-based Feature Compression for CNN Inference Offloading in Edge Computing

abstract: This paper studies the computational offloading of CNN inference in device-edge co-inference systems. Inspired by the emerging paradigm semantic communication, we propose a novel autoencoder-based CNN architecture (AECNN), for effective feature extraction at end-device. We design a feature compression module based on the channel attention method in CNN, to compress the intermediate data by selecting the most important features. To further reduce communication overhead, we can use entropy encoding to remove the statistical redundancy in the compressed data. At the receiver, we design a lightweight decoder to reconstruct the intermediate data through learning from the received compressed data to improve accuracy. To fasten the convergence, we use a step-by-step approach to train the neural networks obtained based on ResNet-50 architecture. Experimental results show that AECNN can compress the intermediate data by more than 256x with only about 4% accuracy loss, which outperforms the state-of-the-art work, BottleNet++. Compared to offloading inference task directly to edge server, AECNN can complete inference task earlier, in particular, under poor wireless channel condition, which highlights the effectiveness of AECNN in guaranteeing higher accuracy within time constraint.


title: Melting Pot 2.0

abstract: Multi-agent artificial intelligence research promises a path to develop intelligent technologies that are more human-like and more human-compatible than those produced by "solipsistic" approaches, which do not consider interactions between agents. Melting Pot is a research tool developed to facilitate work on multi-agent artificial intelligence, and provides an evaluation protocol that measures generalization to novel social partners in a set of canonical test scenarios. Each scenario pairs a physical environment (a "substrate") with a reference set of co-players (a "background population"), to create a social situation with substantial interdependence between the individuals involved. For instance, some scenarios were inspired by institutional-economics-based accounts of natural resource management and public-good-provision dilemmas. Others were inspired by considerations from evolutionary biology, game theory, and artificial life. Melting Pot aims to cover a maximally diverse set of interdependencies and incentives. It includes the commonly-studied extreme cases of perfectly-competitive (zero-sum) motivations and perfectly-cooperative (shared-reward) motivations, but does not stop with them. As in real-life, a clear majority of scenarios in Melting Pot have mixed incentives. They are neither purely competitive nor purely cooperative and thus demand successful agents be able to navigate the resulting ambiguity. Here we describe Melting Pot 2.0, which revises and expands on Melting Pot. We also introduce support for scenarios with asymmetric roles, and explain how to integrate them into the evaluation protocol. This report also contains: (1) details of all substrates and scenarios; (2) a complete description of all baseline algorithms and results. Our intention is for it to serve as a reference for researchers using Melting Pot 2.0.


title: Giant and Broadband THz and IR Emission in Drift-biased Graphene-Based Hyperbolic Nanostructures

abstract: We demonstrate that Cherenkov radiation can be manipulated in terms of operation frequency, bandwidth, and efficiency by simultaneously controlling the properties of drifting electrons and the photonic states supported by their surrounding media. We analytically show that the radiation rate strongly depends on the momentum of the excited photonic state, in terms of magnitude, frequency dispersion, and its variation versus the properties of the drifting carriers. This approach is applied to design and realize miniaturized, broadband, tunable, and efficient terahertz and far-infrared sources by manipulating and boosting the coupling between drifting electrons and engineered hyperbolic modes in graphene-based nanostructures. The broadband, dispersive, and confined nature of hyperbolic modes relax momentum matching issues, avoid using electron beams, and drastically enhance the radiation rate - allowing that over 90% of drifting electrons emit photons. Our findings open a new paradigm for the development of solid-state terahertz and infrared sources.


title: How We Express Ourselves Freely: Censorship, Self-censorship, and Anti-censorship on a Chinese Social Media

abstract: Censorship, anti-censorship, and self-censorship in an authoritarian regime have been extensively studies, yet the relationship between these intertwined factors is not well understood. In this paper, we report results of a large-scale survey study (N = 526) with Sina Weibo users toward bridging this research gap. Through descriptive statistics, correlation analysis, and regression analysis, we uncover how users are being censored, how and why they conduct self-censorship on different topics and in different scenarios (i.e., post, repost, and comment), and their various anti-censorship strategies. We further identify the metrics of censorship and self-censorship, find the influence factors, and construct a mediation model to measure their relationship. Based on these findings, we discuss implications for democratic social media design and future censorship research.


title: On projections of the tails of a power

abstract: Let $\kappa$ be an inaccessible cardinal, $\mathfrak{U}$ be a universal algebra, and $\sim$ be the equivalence relation on $\mathfrak{U}^{\kappa}$ of eventual equality. From mild assumptions on $\kappa$ we give general constructions of $\mathcal{E} \in End(\mathfrak{U}^{\kappa}/\sim)$ satisfying $\mathcal{E} \circ \mathcal{E} = \mathcal{E}$ which do not descend from $\Delta \in End(\mathfrak{U}^{\kappa})$ having small strong supports. As an application there exists an $\mathcal{E} \in End(\mathbb{Z}^{\kappa}/\sim)$ which does not come from a $\Delta \in End(\mathbb{Z}^{\kappa})$.


title: Comparing Singlet Testing Schemes

abstract: We compare schemes for testing whether two parties share a two-qubit singlet state. The first, standard, scheme tests Braunstein-Caves (or CHSH) inequalities, comparing the correlations of local measurements drawn from a fixed finite set against the quantum predictions for a singlet. The second, alternative, scheme tests the correlations of local measurements, drawn randomly from the set of those that are $\theta$-separated on the Bloch sphere, against the quantum predictions. We formulate each scheme as a hypothesis test and then evaluate the test power in a number of adversarial scenarios involving an eavesdropper altering or replacing the singlet qubits. We find the `random measurement' test to be superior in most natural scenarios.


title: Asymptotic Nusselt numbers for internal flow in the Cassie state

abstract: We consider laminar, fully-developed, Poiseuille flows of liquid in the Cassie state through diabatic, parallel-plate microchannels symmetrically textured with isoflux ridges. Through the use of matched asymptotic expansions we analytically develop expressions for (apparent hydrodynamic) slip lengths and variously-defined Nusselt numbers. Our small parameter ($\epsilon$) is the pitch of the ridges divided by the height of the microchannel. When the ridges are oriented parallel to the flow, we quantify the error in the Nusselt number expressions in the literature and provide a new closed-form result. The latter is accurate to $O\left(\epsilon^2\right)$ and valid for any solid (ridge) fraction, whereas those in the current literature are accurate to $O\left(\epsilon^1\right)$ and breakdown in the important limit when solid fraction approaches zero. When the ridges are oriented transverse to the (periodically fully-developed) flow, the error associated with neglecting inertial effects in the slip length is shown to be $O\left(\epsilon^3\mathrm{Re}\right)$, where $\mathrm{Re}$ is the channel-scale Reynolds number based on its hydraulic diameter. The corresponding Nusselt number expressions are new and their accuracy is shown to be dependent on Reynolds number, Peclet number and Prandtl number in addition to $\epsilon$. Manipulating the solution to the inner temperature problem encountered in the vicinity of the ridges shows that classic results for thermal spreading resistance are better expressed in terms of polylogarithm functions.


title: Sketch-Guided Text-to-Image Diffusion Models

abstract: Text-to-Image models have introduced a remarkable leap in the evolution of machine learning, demonstrating high-quality synthesis of images from a given text-prompt. However, these powerful pretrained models still lack control handles that can guide spatial properties of the synthesized images. In this work, we introduce a universal approach to guide a pretrained text-to-image diffusion model, with a spatial map from another domain (e.g., sketch) during inference time. Unlike previous works, our method does not require to train a dedicated model or a specialized encoder for the task. Our key idea is to train a Latent Guidance Predictor (LGP) - a small, per-pixel, Multi-Layer Perceptron (MLP) that maps latent features of noisy images to spatial maps, where the deep features are extracted from the core Denoising Diffusion Probabilistic Model (DDPM) network. The LGP is trained only on a few thousand images and constitutes a differential guiding map predictor, over which the loss is computed and propagated back to push the intermediate images to agree with the spatial map. The per-pixel training offers flexibility and locality which allows the technique to perform well on out-of-domain sketches, including free-hand style drawings. We take a particular focus on the sketch-to-image translation task, revealing a robust and expressive way to generate images that follow the guidance of a sketch of arbitrary style or domain. Project page: sketch-guided-diffusion.github.io


title: Inverse Problem Approach for Non-Perturbative QCD: Foundation

abstract: We propose a novel theoretical framework to calculate the non-perturbative QCD quantities. It starts from the dispersion relation of quantum field theory, separating the high-energy and low-energy scales and using the known perturbative theories to solve the unknown non-perturbative quantities by the inverse problem. We prove that the inverse problem of dispersion relation is ill-posed, with unique but unstable solutions. The regularization methods must be used to get the stable approximate solutions. The method is based on the strict mathematics, without any artificial assumptions. We have test some toy models to vividly show the main features of the inverse problem. It can be found that this approach can systematically improve the precision of the solutions.


title: Complex Spin: The Missing Zeroes and Newton's Dark Magic

abstract: Conformal Regge theory predicts the existence of analytically continued CFT data for complex spin. How could this work when there are so many more operators with large spin compared to small spin? Using planar N=4 SYM as a testground we find a simple physical picture. Operators do organize themselves into analytic families but the continuation of the higher families have zeroes in their structure OPE constants for lower integer spins. They thus decouple. Newton's interpolation series technique is perfectly suited to this physical problem and will allow us to explore the right complex spin half-plane.


title: TemporalStereo: Efficient Spatial-Temporal Stereo Matching Network

abstract: We present TemporalStereo, a coarse-to-fine stereo matching network that is highly efficient, and able to effectively exploit the past geometry and context information to boost matching accuracy. Our network leverages sparse cost volume and proves to be effective when a single stereo pair is given. However, its peculiar ability to use spatio-temporal information across stereo sequences allows TemporalStereo to alleviate problems such as occlusions and reflective regions while enjoying high efficiency also in this latter case. Notably, our model -- trained once with stereo videos -- can run in both single-pair and temporal modes seamlessly. Experiments show that our network relying on camera motion is robust even to dynamic objects when running on videos. We validate TemporalStereo through extensive experiments on synthetic (SceneFlow, TartanAir) and real (KITTI 2012, KITTI 2015) datasets. Our model achieves state-of-the-art performance on any of these datasets. Code is available at \url{https://github.com/youmi-zym/TemporalStereo.git}.


title: Contrastive pretraining for semantic segmentation is robust to noisy positive pairs

abstract: Domain-specific variants of contrastive learning can construct positive pairs from two distinct in-domain images, while traditional methods just augment the same image twice. For example, we can form a positive pair from two satellite images showing the same location at different times. Ideally, this teaches the model to ignore changes caused by seasons, weather conditions or image acquisition artifacts. However, unlike in traditional contrastive methods, this can result in undesired positive pairs, since we form them without human supervision. For example, a positive pair might consist of one image before a disaster and one after. This could teach the model to ignore the differences between intact and damaged buildings, which might be what we want to detect in the downstream task. Similar to false negative pairs, this could impede model performance. Crucially, in this setting only parts of the images differ in relevant ways, while other parts remain similar. Surprisingly, we find that downstream semantic segmentation is either robust to such badly matched pairs or even benefits from them. The experiments are conducted on the remote sensing dataset xBD, and a synthetic segmentation dataset for which we have full control over the pairing conditions. As a result, practitioners can use these domain-specific contrastive methods without having to filter their positive pairs beforehand, or might even be encouraged to purposefully include such pairs in their pretraining dataset.


title: Diffusion-SDF: Conditional Generative Modeling of Signed Distance Functions

abstract: Probabilistic diffusion models have achieved state-of-the-art results for image synthesis, inpainting, and text-to-image tasks. However, they are still in the early stages of generating complex 3D shapes. This work proposes Diffusion-SDF, a generative model for shape completion, single-view reconstruction, and reconstruction of real-scanned point clouds. We use neural signed distance functions (SDFs) as our 3D representation to parameterize the geometry of various signals (e.g., point clouds, 2D images) through neural networks. Neural SDFs are implicit functions and diffusing them amounts to learning the reversal of their neural network weights, which we solve using a custom modulation module. Extensive experiments show that our method is capable of both realistic unconditional generation and conditional generation from partial inputs. This work expands the domain of diffusion models from learning 2D, explicit representations, to 3D, implicit representations.


title: Propeller states in locally super-critical ULXs

abstract: An expected signature of the presence of neutron stars in the population of ultraluminous X-ray sources (ULXs) are large scale changes in X-ray luminosity, as systems reach spin equilibrium and a propeller state ensues. We explore the predicted luminosity changes when the disc is locally super-critical, finding that a significant parameter space in dipole field strength and accretion rate (at large radius) can be accompanied by changes of less than an order of magnitude in luminosity. We discuss the spectral signature and locate three ULXs (IC 342 X-1, Cir ULX-5 and NGC 1313 X-1) which appear to show changes consistent with super-Eddington systems entering a propeller state, and place rough constraints on the dipole field strength of NGC 1313 X-1 of $<$ 10$^{10}$ G. This work implies that the most reliable means by which to search for putative propeller states will be to search for changes in hardness ratio and at high energies.


title: Chasing Super-Massive Black Hole merging events with $Athena$ and LISA

abstract: The European Space Agency is studying two large-class missions bound to operate in the decade of the 30s, and aiming at investigating the most energetic and violent phenomena in the Universe. $Athena$ is poised to study the physical conditions of baryons locked in large-scale structures from the epoch of their formation, as well as to yield an accurate census of accreting super-massive black holes down to the epoch of reionization; LISA will extend the hunt for Gravitational Wave (GW) events to the hitherto unexplored mHz regime. We discuss in this paper the science that their concurrent operation could yield, and present possible $Athena$ observational strategies. We focus on Super-Massive (M$\lesssim10^7\rm M_{\odot}$) Black Hole Mergers (SMBHMs), potentially accessible to $Athena$ up to $z\sim2$. The simultaneous measurement of their electro-magnetic (EM) and GW signals may enable unique experiments in the domains of astrophysics, fundamental physics, and cosmography, such as the magneto-hydrodynamics of fluid flows in a rapidly variable space-time, the formation of coronae and jets in Active Galactic Nuclei, and the measurement of the speed of GW, among others. Key to achieve these breakthrough results will be the LISA capability of locating a SMBHM event with an error box comparable to, or better than the field-of-view of the $Athena$ Wide Field Imager ($\simeq0.4\,$deg$^2$) and $Athena$ capability to slew fast to detect the source during the inspiral phase and the post-merger phase. Together, the two observatories will open in principle the exciting possibility of truly concurrent EM and GW studies of the SMBHMs


title: Proto-neutron stars as cosmic factories for massive axion-like-particles

abstract: The parameter space of massive axion-like-particles (ALPs) with $m_a \sim {\mathcal O} (100)$ MeV and coupled with nucleons is largely unexplored. Here, we present new constraints in this parameter region. In doing so, we characterize the supernova emissivity of heavy ALPs from a proto-neutron star, including for the first time mass effects in both nucleon-nucleon Bremsstrahlung and pionic Compton processes. In addition, we highlight novel possibilities to probe the couplings with photons and leptons from supernova ALP decays.


title: Water and an escaping helium tail detected in the hazy and methane-depleted atmosphere of HAT-P-18b from JWST NIRISS/SOSS

abstract: JWST is here. The early release observation program (ERO) provides us with the first look at the scientific data and the spectral capabilities. One of the targets from ERO is HAT-P-18b, an inflated Saturn-mass planet with an equilibrium temperature of $\sim$850K. We present the NIRISS/SOSS transmission spectrum of HAT-P-18b from 0.6 to 2.8$\mu m$ and reveal the planet in the infrared beyond 1.6$\mu m$ for the first time. From the spectrum, we see clear water and escaping helium tail features in an otherwise very hazy atmosphere. Our free chemistry retrievals with ATMO show moderate Bayesian evidence (3.79) supporting the presence of methane, but the spectrum does not display any clearly identifiable methane absorption features. The retrieved methane abundance is $\sim$2 orders of magnitude lower than that of solar composition. The methane-depleted atmosphere strongly rejects simple equilibrium chemistry forward models with solar metallicity and C/O ratio and disfavors high metallicity (100 times) and low C/O ratio (0.3). This calls for additional physical processes such as vertical mixing and photochemistry which can remove methane from the atmosphere.


title: ScanNeRF: a Scalable Benchmark for Neural Radiance Fields

abstract: In this paper, we propose the first-ever real benchmark thought for evaluating Neural Radiance Fields (NeRFs) and, in general, Neural Rendering (NR) frameworks. We design and implement an effective pipeline for scanning real objects in quantity and effortlessly. Our scan station is built with less than 500$ hardware budget and can collect roughly 4000 images of a scanned object in just 5 minutes. Such a platform is used to build ScanNeRF, a dataset characterized by several train/val/test splits aimed at benchmarking the performance of modern NeRF methods under different conditions. Accordingly, we evaluate three cutting-edge NeRF variants on it to highlight their strengths and weaknesses. The dataset is available on our project page, together with an online benchmark to foster the development of better and better NeRFs.


title: MOSEL Survey: Extremely weak outflows in EoR analogues at z=3-4

abstract: This paper presents deep K-band spectroscopic observations of galaxies at z=3-4 with composite photometric rest-frame Hb+[OIII] equivalent widths EW_0>600A, comparable to the EW of galaxies observed during the epoch of reionisation (EoR, z>6). The typical spectroscopic [OIII] EW_0 and stellar mass of our targets is ~ 700A and log(M_star/M_sun)=8.98. By stacking the [OIII] emission profiles, we find evidence of a weak broad component with F_broad/F_narrow ~ 0.2 and velocity width sigma_{broad} ~ 170 km/s. The strength and velocity width of the broad component does not change significantly with stellar mass and [OIII] EW_0 of the stacked sample. Assuming similar broad component profiles for [OIII] and Halpha emission, we estimate a mass loading factor ~0.2, similar to low stellar mass galaxies at z>1 even if the star formation rates of our sample is 10 times higher. We hypothesize that either the multi-phase nature of supernovae driven outflows or the suppression of winds in the extreme star-forming regime is responsible for the weak signature of outflows in the EoR analogues.


title: X-ray Polarization Observations of BL Lacertae

abstract: Blazars are a class of jet-dominated active galactic nuclei with a typical double-humped spectral energy distribution. It is of common consensus the Synchrotron emission to be responsible for the low frequency peak, while the origin of the high frequency hump is still debated. The analysis of X-rays and their polarization can provide a valuable tool to understand the physical mechanisms responsible for the origin of high-energy emission of blazars. We report the first observations of BL Lacertae performed with the Imaging X-ray Polarimetry Explorer ({IXPE}), from which an upper limit to the polarization degree $\Pi_X<$12.6\% was found in the 2-8 keV band. We contemporaneously measured the polarization in radio, infrared, and optical wavelengths. Our multiwavelength polarization analysis disfavors a significant contribution of proton synchrotron radiation to the X-ray emission at these epochs. Instead, it supports a leptonic origin for the X-ray emission in BL Lac.


title: Implicit differentiation of variational quantum algorithms

abstract: Several quantities important in condensed matter physics, quantum information, and quantum chemistry, as well as quantities required in meta-optimization of machine learning algorithms, can be expressed as gradients of implicitly defined functions of the parameters characterizing the system. Here, we show how to leverage implicit differentiation for gradient computation through variational quantum algorithms and explore applications in condensed matter physics, quantum machine learning, and quantum information. A function defined implicitly as the solution of a quantum algorithm, e.g., a variationally obtained ground- or steady-state, can be automatically differentiated using implicit differentiation while being agnostic to how the solution is computed. We apply this notion to the evaluation of physical quantities in condensed matter physics such as generalized susceptibilities studied through a variational quantum algorithm. Moreover, we develop two additional applications of implicit differentiation -- hyperparameter optimization in a quantum machine learning algorithm, and the variational construction of entangled quantum states based on a gradient-based maximization of a geometric measure of entanglement. Our work ties together several types of gradient calculations that can be computed using variational quantum circuits in a general way without relying on tedious analytic derivations, or approximate finite-difference methods.


title: Dynamical Backaction Evading Magnomechanics

abstract: The interaction between magnons and mechanical vibrations dynamically modify the properties of the mechanical oscillator, such as its frequency and decay rate. Known as dynamical backaction, this effect is the basis for many theoretical protocols, such as entanglement generation or mechanical ground-state cooling. However, dynamical backaction is also detrimental for specific applications. Here, we demonstrate the implementation of a cavity magnomechanical measurement that fully evades dynamical backaction effects. Through careful engineering, the magnomechanical scattering rate into the hybrid magnon-photon modes can be precisely matched, eliminating dynamical backaction damping. Backaction evasion is confirmed via the measurement of a drive-power-independent mechanical linewidth.


title: Quantum Adversarial Learning in Emulation of Monte-Carlo Methods for Max-cut Approximation: QAOA is not optimal

abstract: One of the leading candidates for near-term quantum advantage is the class of Variational Quantum Algorithms, but these algorithms suffer from classical difficulty in optimizing the variational parameters as the number of parameters increases. Therefore, it is important to understand the expressibility and power of various ans\"atze to produce target states and distributions. To this end, we apply notions of emulation to Variational Quantum Annealing and the Quantum Approximate Optimization Algorithm (QAOA) to show that QAOA is outperformed by variational annealing schedules with equivalent numbers of parameters. Our Variational Quantum Annealing schedule is based on a novel polynomial parameterization that can be optimized in a similar gradient-free way as QAOA, using the same physical ingredients. In order to compare the performance of ans\"atze types, we have developed statistical notions of Monte-Carlo methods. Monte-Carlo methods are computer programs that generate random variables that approximate a target number that is computationally hard to calculate exactly. While the most well-known Monte-Carlo method is Monte-Carlo integration (e.g. Diffusion Monte-Carlo or path-integral quantum Monte-Carlo), QAOA is itself a Monte-Carlo method that finds good solutions to NP-complete problems such as Max-cut. We apply these statistical Monte-Carlo notions to further elucidate the theoretical framework around these quantum algorithms.


title: Strong Dark Matter Self-interactions Diversify Halo Populations within and surrounding the Milky Way

abstract: We perform a high-resolution cosmological zoom-in simulation of a Milky Way (MW)--like system, which includes a realistic Large Magellanic Cloud analog, using a large differential elastic dark matter self-interaction cross section that reaches $\approx 100~\mathrm{cm}^2\ \mathrm{g}^{-1}$ at relative velocities of $\approx 10~\mathrm{km\ s}^{-1}$, motivated by the diverse and orbitally dependent central densities of dwarf galaxies within and surrounding the MW. We explore the effects of dark matter self-interactions on satellite, splashback, and isolated halos through their abundance, central densities, maximum circular velocities, orbital parameters, and correlations between these variables. We use an effective constant cross section model to analytically predict the stages of our simulated halos' gravothermal evolution, demonstrating that deviations from the collisionless $R_{\rm max}$--$V_{\rm max}$ relation can be used to select deeply core-collapsed halos, where $V_{\rm max}$ is a halo's maximum circular velocity, and $R_{\rm max}$ is the radius at which it occurs. We predict that a sizable fraction ($\approx 20\%$) of subhalos with masses down to $\approx 10^8~M_{\odot}$ is deeply core collapsed in our SIDM model. Core-collapsed systems form $\approx 10\%$ of the isolated halo population down to the same mass; these isolated, core-collapsed halos would host faint dwarf field galaxies with extremely steep central density profiles. Finally, most halos with masses above $\approx 10^9~M_{\odot}$ are core-forming in our simulation. Our study thus demonstrates how self-interactions diversify halo populations in an environmentally dependent fashion within and surrounding MW-mass hosts, providing a compelling avenue to address the diverse dark matter distributions of observed dwarf galaxies.


title: On Designing Light-Weight Object Trackers through Network Pruning: Use CNNs or Transformers?

abstract: Object trackers deployed on low-power devices need to be light-weight, however, most of the current state-of-the-art (SOTA) methods rely on using compute-heavy backbones built using CNNs or transformers. Large sizes of such models do not allow their deployment in low-power conditions and designing compressed variants of large tracking models is of great importance. This paper demonstrates how highly compressed light-weight object trackers can be designed using neural architectural pruning of large CNN and transformer based trackers. Further, a comparative study on architectural choices best suited to design light-weight trackers is provided. A comparison between SOTA trackers using CNNs, transformers as well as the combination of the two is presented to study their stability at various compression ratios. Finally results for extreme pruning scenarios going as low as 1% in some cases are shown to study the limits of network pruning in object tracking. This work provides deeper insights into designing highly efficient trackers from existing SOTA methods.


title: Recent results on femtoscopic correlations with the CMS experiment

abstract: The study of femtoscopic correlations in high-energy collisions is a powerful tool to investigate the space-time structure of the particle emitting region formed in such collisions, as well as to probe interactions that the involved particles may undergo after being emitted. An overview of the recent results from the CMS experiment at the LHC on the two-particle femtoscopic correlations measurements using charged particles and identified hadrons in pp and PbPb collisions is presented. In general, the femtoscopic parameters are obtained assuming a Gaussian or an exponential shape to describe the emitting source distribution. In some cases, however, the generalized Gaussian, i.e., the symmetric alpha-stable L\'evy distribution, is favored to describe the source. Some of the measurements allow to extract the parameters of the strong interaction felt by hadrons using their femtoscopic correlations. The studies are performed in a wide range of the pair average transverse momentum (or average transverse mass) and charged particle multiplicities. In addition, prospects for future physics results using the CMS experiment are also discussed.


title: Towards Practical Control of Singular Values of Convolutional Layers

abstract: In general, convolutional neural networks (CNNs) are easy to train, but their essential properties, such as generalization error and adversarial robustness, are hard to control. Recent research demonstrated that singular values of convolutional layers significantly affect such elusive properties and offered several methods for controlling them. Nevertheless, these methods present an intractable computational challenge or resort to coarse approximations. In this paper, we offer a principled approach to alleviating constraints of the prior art at the expense of an insignificant reduction in layer expressivity. Our method is based on the tensor-train decomposition; it retains control over the actual singular values of convolutional mappings while providing structurally sparse and hardware-friendly representation. We demonstrate the improved properties of modern CNNs with our method and analyze its impact on the model performance, calibration, and adversarial robustness. The source code is available at: https://github.com/WhiteTeaDragon/practical_svd_conv


title: Generative Joint Source-Channel Coding for Semantic Image Transmission

abstract: Recent works have shown that joint source-channel coding (JSCC) schemes using deep neural networks (DNNs), called DeepJSCC, provide promising results in wireless image transmission. However, these methods mostly focus on the distortion of the reconstructed signals with respect to the input image, rather than their perception by humans. However, focusing on traditional distortion metrics alone does not necessarily result in high perceptual quality, especially in extreme physical conditions, such as very low bandwidth compression ratio (BCR) and low signal-to-noise ratio (SNR) regimes. In this work, we propose two novel JSCC schemes that leverage the perceptual quality of deep generative models (DGMs) for wireless image transmission, namely InverseJSCC and GenerativeJSCC. While the former is an inverse problem approach to DeepJSCC, the latter is an end-to-end optimized JSCC scheme. In both, we optimize a weighted sum of mean squared error (MSE) and learned perceptual image patch similarity (LPIPS) losses, which capture more semantic similarities than other distortion metrics. InverseJSCC performs denoising on the distorted reconstructions of a DeepJSCC model by solving an inverse optimization problem using style-based generative adversarial network (StyleGAN). Our simulation results show that InverseJSCC significantly improves the state-of-the-art (SotA) DeepJSCC in terms of perceptual quality in edge cases. In GenerativeJSCC, we carry out end-to-end training of an encoder and a StyleGAN-based decoder, and show that GenerativeJSCC significantly outperforms DeepJSCC both in terms of distortion and perceptual quality.


title: Impact of NOMA on Age of Information: A Grant-Free Transmission Perspective

abstract: The aim of this paper is to characterize the impact of non-orthogonal multiple access (NOMA) on the age of information (AoI) of grant-free transmission. In particular, a low-complexity form of NOMA, termed NOMA-assisted random access, is applied to grant-free transmission in order to illustrate the two benefits of NOMA for AoI reduction, namely increasing channel access and reducing user collisions. Closed-form analytical expressions for the AoI achieved by NOMA assisted grant-free transmission are obtained, and asymptotic studies are carried out to demonstrate that the use of the simplest form of NOMA is already sufficient to reduce the AoI of orthogonal multiple access (OMA) by more than 40%. In addition, the developed analytical expressions are also shown to be useful for optimizing the users' transmission attempt probabilities, which are key parameters for grant-free transmission.


title: Investigating Non-linear and Stochastic Hard X-ray Variability of Active Galactic Nuclei using Recurrence Analysis

abstract: We present results of recurrence analysis of 46 active galactic nuclei (AGN) using light curves from the 157-month catalog of the Swift Burst Alert Telescope (BAT) in the 14-150 keV band. We generate recurrence plots and compute recurrence plot metrics for each object. We use the surrogate data method to compare all derived recurrence-based quantities to three sets of stochastic light curves with identical power spectrum, flux distribution, or both, in order to determine the presence of determinism, non-linearity, entropy, and non-stationarity. We compare these quantities with known physical characteristics of each system, such as black hole mass, Eddington ratio, and bolometric luminosity, radio loudness, obscuration, and spectroscopic type. We find that almost all AGN in this sample exhibit substantial higher-order modes of variability than is contained in the power spectrum, with approximately half exhibiting nonlinear or non-stationary behavior. We find that Type 2 AGN are more likely to contain deterministic variability than Type 1 AGN while the same distinction is not found between obscured and unobscured AGN. The complexity of variability among Type 1 AGN is anticorrelated with Eddington ratio, while no relationship is found among Type 2 AGN. The connections between the recurrence properties and AGN class suggest that hard X-ray emission is a probe of distinct accretion processes among classes of AGN, which supports interpretations of changing-look AGN and challenges the traditional unification model that classifies AGN only on viewing angle.


title: SAGA: Spectral Adversarial Geometric Attack on 3D Meshes

abstract: A triangular mesh is one of the most popular 3D data representations. As such, the deployment of deep neural networks for mesh processing is widely spread and is increasingly attracting more attention. However, neural networks are prone to adversarial attacks, where carefully crafted inputs impair the model's functionality. The need to explore these vulnerabilities is a fundamental factor in the future development of 3D-based applications. Recently, mesh attacks were studied on the semantic level, where classifiers are misled to produce wrong predictions. Nevertheless, mesh surfaces possess complex geometric attributes beyond their semantic meaning, and their analysis often includes the need to encode and reconstruct the geometry of the shape. We propose a novel framework for a geometric adversarial attack on a 3D mesh autoencoder. In this setting, an adversarial input mesh deceives the autoencoder by forcing it to reconstruct a different geometric shape at its output. The malicious input is produced by perturbing a clean shape in the spectral domain. Our method leverages the spectral decomposition of the mesh along with additional mesh-related properties to obtain visually credible results that consider the delicacy of surface distortions. Our code is publicly available at https://github.com/StolikTomer/SAGA.


title: German Phoneme Recognition with Text-to-Phoneme Data Augmentation

abstract: In this study, we experimented to examine the effect of adding the most frequent n phoneme bigrams to the basic vocabulary on the German phoneme recognition model using the text-to-phoneme data augmentation strategy. As a result, compared to the baseline model, the vowel30 model and the const20 model showed an increased BLEU score of more than 1 point, and the total30 model showed a significant decrease in the BLEU score of more than 20 points, showing that the phoneme bigrams could have a positive or negative effect on the model performance. In addition, we identified the types of errors that the models repeatedly showed through error analysis.


title: The Short-Term Predictability of Returns in Order Book Markets: a Deep Learning Perspective

abstract: In this paper, we conduct a systematic large-scale analysis of order book-driven predictability in high-frequency returns by leveraging deep learning techniques. First, we introduce a new and robust representation of the order book, the volume representation. Next, we carry out an extensive empirical experiment to address various questions regarding predictability. We investigate if and how far ahead there is predictability, the importance of a robust data representation, the advantages of multi-horizon modeling, and the presence of universal trading patterns. We use model confidence sets, which provide a formalized statistical inference framework particularly well suited to answer these questions. Our findings show that at high frequencies predictability in mid-price returns is not just present, but ubiquitous. The performance of the deep learning models is strongly dependent on the choice of order book representation, and in this respect, the volume representation appears to have multiple practical advantages.


title: Design and Prototyping Distributed CNN Inference Acceleration in Edge Computing

abstract: For time-critical IoT applications using deep learning, inference acceleration through distributed computing is a promising approach to meet a stringent deadline. In this paper, we implement a working prototype of a new distributed inference acceleration method HALP using three raspberry Pi 4. HALP accelerates inference by designing a seamless collaboration among edge devices (EDs) in Edge Computing. We maximize the parallelization between communication and computation among the collaborative EDs by optimizing the task partitioning ratio based on the segment-based partitioning. Experimental results show that the distributed inference HALP achieves 1.7x inference acceleration for VGG-16. Then, we combine distributed inference with conventional neural network model compression by setting up different shrinking hyperparameters for MobileNet-V1. In this way, we can further accelerate inference but at the cost of inference accuracy loss. To strike a balance between latency and accuracy, we propose dynamic model selection to select a model which provides the highest accuracy within the latency constraint. It is shown that the model selection with distributed inference HALP can significantly improve service reliability compared to the conventional stand-alone computation.


title: Learning to Play Trajectory Games Against Opponents with Unknown Objectives

abstract: Many autonomous agents, such as intelligent vehicles, are inherently required to interact with one another. Game theory provides a natural mathematical tool for robot motion planning in such interactive settings. However, tractable algorithms for such problems usually rely on a strong assumption, namely that the objectives of all players in the scene are known. To make such tools applicable for ego-centric planning with only local information, we propose an adaptive model-predictive game solver, which jointly infers other players' objectives online and computes a corresponding generalized Nash equilibrium (GNE) strategy. The adaptivity of our approach is enabled by a differentiable trajectory game solver whose gradient signal is used for maximum likelihood estimation (MLE) of opponents' objectives. This differentiability of our pipeline facilitates direct integration with other differentiable elements, such as neural networks (NNs). Furthermore, in contrast to existing solvers for cost inference in games, our method handles not only partial state observations but also general inequality constraints. In two simulated traffic scenarios, we find superior performance of our approach over both existing game-theoretic methods and non-game-theoretic model-predictive control (MPC) approaches. We also demonstrate our approach's real-time planning capabilities and robustness in two hardware experiments.


title: CryptoLight: An Electro-Optical Accelerator for Fully Homomorphic Encryption

abstract: Fully homomorphic encryption (FHE) protects data privacy in cloud computing by enabling computations to directly occur on ciphertexts. To improve the time-consuming FHE operations, we present an electro-optical (EO) FHE accelerator, CryptoLight. Compared to prior FHE accelerators, on average, CryptoLight reduces the latency of various FHE applications by >94.4% and the energy consumption by >95%


title: Realizability of Iso-$g_2$ Processes via Effective Pair Interactions

abstract: An outstanding problem in statistical mechanics is the determination of whether prescribed functional forms of the pair correlation function $g_2(r)$ [or equivalently, structure factor $S(k)$] at some number density $\rho$ can be achieved by $d$-dimensional many-body systems. The Zhang-Torquato conjecture states that any realizable set of pair statistics, whether from a nonequilibrium or equilibrium system, can be achieved by equilibrium systems involving up to two-body interactions. In light of this conjecture, we study the realizability problem of the nonequilibrium iso-$g_2$ process, i.e., the determination of density-dependent effective potentials that yield equilibrium states in which $g_2$ remains invariant for a positive range of densities. Using a precise inverse methodology that determines effective potentials that match hypothesized functional forms of $g_2(r)$ for all $r$ and $S(k)$ for all $k$, we show that the unit-step function $g_2$, which is the zero-density limit of the hard-sphere potential, is remarkably numerically realizable up to the packing fraction $\phi=0.49$ for $d=1$. For $d=2$ and 3, it is realizable up to the maximum ``terminal'' packing fraction $\phi_c=1/2^d$, at which the systems are hyperuniform, implying that the explicitly known necessary conditions for realizability are sufficient up through $\phi_c$. For $\phi$ near but below $\phi_c$, the large-$r$ behaviors of the effective potentials are given exactly by the functional forms $\exp[-\kappa(\phi) r]$ for $d=1$, $r^{-1/2}\exp[-\kappa(\phi) r]$ for $d=2$, and $r^{-1}\exp[-\kappa(\phi) r]$ (Yukawa form) for $d=3$, where $\kappa^{-1}(\phi)$ is a screening length, and for $\phi=\phi_c$, the potentials at large $r$ are given by the pure Coulomb forms in the respective dimensions, as predicted by Torquato and Stillinger [\textit{Phys. Rev. E}, 68, 041113 1-25 (2003)].


title: Engineering non-Markovianity from defect-phonon interactions

abstract: Understanding defect-phonon interactions in solid-state devices is crucial for improving our current knowledge of quantum platforms. In this work, we develop first-principles calculations for a defect composed of two spin-$1/2$ particles that interact with phonon modes in a one-dimensional lattice. We follow a bottom-up approach that begins with a dipolar magnetic interaction to ultimately derive the spectral density function and time-local master equation that describes the open dynamics of the defect. We provide theoretical and numerical analysis for the non-Markovian features of the defect-phonon dynamics induced by a pure dephasing channel acting on the Bell basis. Finally, we analyze two measures of non-Markovianity based on the canonical rates and Coherence, shedding more light on the role of the spectral density function and temperature; and envisioning experimental realizations.


title: Studies of transport coefficients in charged AdS$_{4}$ black holes on $\kappa$-deformed space

abstract: In this work, we study the effect of $\kappa$-deformed space on the thermodynamic quantities, this are find through the holographic renormalization that provide the free energy, which is fundamental to derive the another thermodynamic quantities. For this scenario we consider an charged AdS$_{4}$ black hole for an Einstein-Maxwell model where the derivative quadrivector is replaced by a deformed version inspired in Kaniadakis statistics. Besides, we extract the transport coefficient know as electrical conductivity.


title: Late lumping of observer-based state feedback for boundary control systems

abstract: Infinite-dimensional linear systems with unbounded input and output operators are considered. For the purpose of finite-dimensional observer-based state feedback, an observer approximation scheme will be developed which can be directly combined with existing late-lumping controllers and observer output injection gains. It relies on a decomposition of the feedback gain, resp. observer output injection gain, into a bounded and an unbounded part. Based on a perturbation result, the spectrum-determined growth condition is established, for the closed loop.


title: PuzzleFusion: Unleashing the Power of Diffusion Models for Spatial Puzzle Solving

abstract: This paper presents an end-to-end neural architecture based on Diffusion Models for spatial puzzle solving, particularly jigsaw puzzle and room arrangement tasks. In the latter task, for instance, the proposed system "PuzzleFusion" takes a set of room layouts as polygonal curves in the top-down view and aligns the room layout pieces by estimating their 2D translations and rotations, akin to solving the jigsaw puzzle of room layouts. A surprising discovery of the paper is that the simple use of a Diffusion Model effectively solves these challenging spatial puzzle tasks as a conditional generation process. To enable learning of an end-to-end neural system, the paper introduces new datasets with ground-truth arrangements: 1) 2D Voronoi jigsaw dataset, a synthetic one where pieces are generated by Voronoi diagram of 2D pointset; and 2) MagicPlan dataset, a real one offered by MagicPlan from its production pipeline, where pieces are room layouts constructed by augmented reality App by real-estate consumers. The qualitative and quantitative evaluations demonstrate that our approach outperforms the competing methods by significant margins in all the tasks.


title: PyTAIL: Interactive and Incremental Learning of NLP Models with Human in the Loop for Online Data

abstract: Online data streams make training machine learning models hard because of distribution shift and new patterns emerging over time. For natural language processing (NLP) tasks that utilize a collection of features based on lexicons and rules, it is important to adapt these features to the changing data. To address this challenge we introduce PyTAIL, a python library, which allows a human in the loop approach to actively train NLP models. PyTAIL enhances generic active learning, which only suggests new instances to label by also suggesting new features like rules and lexicons to label. Furthermore, PyTAIL is flexible enough for users to accept, reject, or update rules and lexicons as the model is being trained. Finally, we simulate the performance of PyTAIL on existing social media benchmark datasets for text classification. We compare various active learning strategies on these benchmarks. The model closes the gap with as few as 10% of the training data. Finally, we also highlight the importance of tracking evaluation metric on remaining data (which is not yet merged with active learning) alongside the test dataset. This highlights the effectiveness of the model in accurately annotating the remaining dataset, which is especially suitable for batch processing of large unlabelled corpora. PyTAIL will be available at https://github.com/socialmediaie/pytail.


title: Semantic Communication Enabling Robust Edge Intelligence for Time-Critical IoT Applications

abstract: This paper aims to design robust Edge Intelligence using semantic communication for time-critical IoT applications. We systematically analyze the effect of image DCT coefficients on inference accuracy and propose the channel-agnostic effectiveness encoding for offloading by transmitting the most meaningful task data first. This scheme can well utilize all available communication resource and strike a balance between transmission latency and inference accuracy. Then, we design an effectiveness decoding by implementing a novel image augmentation process for convolutional neural network (CNN) training, through which an original CNN model is transformed into a Robust CNN model. We use the proposed training method to generate Robust MobileNet-v2 and Robust ResNet-50. The proposed Edge Intelligence framework consists of the proposed effectiveness encoding and effectiveness decoding. The experimental results show that the effectiveness decoding using the Robust CNN models perform consistently better under various image distortions caused by channel errors or limited communication resource. The proposed Edge Intelligence framework using semantic communication significantly outperforms the conventional approach under latency and data rate constraints, in particular, under ultra stringent deadlines and low data rate.


title: Characterisation of a single photon event camera for quantum imaging

abstract: We show a simple yet effective method that can be used to characterize the per pixel quantum efficiency and temporal resolution of a single photon event camera for quantum imaging applications. Utilizing photon pairs generated through spontaneous parametric down-conversion, the detection efficiency of each pixel, and the temporal resolution of the system, are extracted through coincidence measurements. We use this method to evaluate the TPX3CAM, with appended image intensifier, and measure an average efficiency of 7.4% and a temporal resolution of 7.3ns. Furthermore, this technique reveals important error mechanisms that can occur in post-processing. We expect that this technique, and elements therein, will be useful to characterise other quantum imaging systems.


title: Detection of Einstein Telescope gravitational wave signals from binary black holes using deep learning

abstract: The expected volume of data from the third-generation gravitational waves (GWs) Einstein Telescope (ET) detector would make traditional GWs search methods such as match filtering impractical. This is due to the large template bank required and the difficulties in waveforms modelling. In contrast, machine learning (ML) algorithms have shown a promising alternative for GWs data analysis, where ML can be used in developing semi-automatic and automatic tools for the detection, denoising and parameter estimation of GWs sources. Compared to second generation detectors, ET will have a wider accessible frequency band but also a lower noise. The ET will have a detection rate for Binary Black Holes (BBHs) and Binary Neutron Stars (BNSs) of order 1e5 - 1e6 per year and 7e4 per year respectively. In this work, we explore the possibility and efficiency of using convolutional neural networks (CNNs) for the detection of BBHs mergers in synthetic GWs signals buried in gaussian noise. The data was generated according to the ETs parameters using open-source tools. Without performing data whitening or applying bandpass filtering, we trained four CNN networks with the state-of-the-art performance in computer vision, namely VGG, ResNet and DenseNet. ResNet has significantly better performance, detecting BBHs sources with SNR of 8 or higher with 98.5% accuracy, and with 92.5%, 85%, 60% and 62% accuracy for sources with SNR range of 7-8, 6-7, 5-6 and 4-5 respectively. ResNet, in qualitative evaluation, was able to detect a BBHs merger at 60 Gpc with 4.3 SNR. It was also shown that, using CNN for BBHs merger on long time series data is computationally efficient, and can be used for near-real-time detection.


title: Approximating the chromatic polynomial is as hard as computing it exactly

abstract: We show that for any non-real algebraic number $q$ such that $|q-1|>1$ or $\Re(q)>\frac{3}{2}$ it is \textsc{\#P}-hard to compute a multiplicative (resp. additive) approximation to the absolute value (resp. argument) of the chromatic polynomial evaluated at $q$ on planar graphs. This implies \textsc{\#P}-hardness for all non-real algebraic $q$ on the family of all graphs. We moreover prove several hardness results for $q$ such that $|q-1|\leq 1$. Our hardness results are obtained by showing that a polynomial time algorithm for approximately computing the chromatic polynomial of a planar graph at non-real algebraic $q$ (satisfying some properties) leads to a polynomial time algorithm for \emph{exactly} computing it, which is known to be hard by a result of Vertigan. Many of our results extend in fact to the more general partition function of the random cluster model, a well known reparametrization of the Tutte polynomial.


title: Elliptic soliton solutions of the spin non-chiral intermediate long-wave equation

abstract: We construct elliptic multi-soliton solutions of the spin non-chiral intermediate long-wave (sncILW) equation with periodic boundary conditions. These solutions are obtained by a spin-pole ansatz including a dynamical background term; we show that this ansatz solves the periodic sncILW equation provided the spins and poles satisfy the elliptic $A$-type spin Calogero-Moser (sCM) system with certain constraints on the initial conditions. The key to this result is a B\"{a}cklund transformation for the elliptic sCM system which includes a non-trivial dynamical background term. We also present solutions of the sncILW equation on the real line and of the spin Benjamin-Ono equation which generalize previously obtained solutions by allowing for a non-trivial background term.


title: Violation of detailed balance in microwave circuits: theory and experiment

abstract: We propose a new approach to detailed balance violation in electrical circuits by relying on the scattering matrix formalism commonly used in microwave electronics. This allows to include retardation effects which are paramount at high frequencies. We define the spectral densities of phase space angular momentum, heat transfer and cross power, which can serve as criteria for detailed balance violation. We confirm our theory with measurements in the 4-8 GHz frequency range on several two port circuits of varying symmetries, in space and time. This validates our approach, which will allow to treat quantum circuits at ultra-low temperature.


title: Tensor Decomposition of Large-scale Clinical EEGs Reveals Interpretable Patterns of Brain Physiology

abstract: Identifying abnormal patterns in electroencephalography (EEG) remains the cornerstone of diagnosing several neurological diseases. The current clinical EEG review process relies heavily on expert visual review, which is unscalable and error-prone. In an effort to augment the expert review process, there is a significant interest in mining population-level EEG patterns using unsupervised approaches. Current approaches rely either on two-dimensional decompositions (e.g., principal and independent component analyses) or deep representation learning (e.g., auto-encoders, self-supervision). However, most approaches do not leverage the natural multi-dimensional structure of EEGs and lack interpretability. In this study, we propose a tensor decomposition approach using the canonical polyadic decomposition to discover a parsimonious set of population-level EEG patterns, retaining the natural multi-dimensional structure of EEGs (time x space x frequency). We then validate their clinical value using a cohort of patients including varying stages of cognitive impairment. Our results show that the discovered patterns reflect physiologically meaningful features and accurately classify the stages of cognitive impairment (healthy vs mild cognitive impairment vs Alzheimer's dementia) with substantially fewer features compared to classical and deep learning-based baselines. We conclude that the decomposition of population-level EEG tensors recovers expert-interpretable EEG patterns that can aid in the study of smaller specialized clinical cohorts.


title: Question Answering and Question Generation for Finnish

abstract: Recent advances in the field of language modeling have improved the state-of-the-art in question answering (QA) and question generation (QG). However, the development of modern neural models, their benchmarks, and datasets for training them has mainly focused on English. Finnish, like many other languages, faces a shortage of large QA/QG model training resources, which has prevented experimenting with state-of-the-art QA/QG fine-tuning methods. We present the first neural QA and QG models that work with Finnish. To train the models, we automatically translate the SQuAD dataset and then use normalization methods to reduce the amount of problematic data created during the translation. Using the synthetic data, together with the Finnish partition of the TyDi-QA dataset, we fine-tune several transformer-based models to both QA and QG and evaluate their performance. To the best of our knowledge, the resulting dataset is the first large-scale QA/QG resource for Finnish. This paper also sets the initial benchmarks for Finnish-language QA and QG.


title: Two-dimensional diffusiophoretic colloidal banding: Optimizing the spatial and temporal design of solute sinks and sources

abstract: In this work, we numerically investigate the impact of two-dimensional solute gradients on the distribution of colloidal particles, i.e., colloidal banding, induced via diffusiophoresis. The solute gradients are generated by spatially arranged sources and sinks that emit/absorb a time-dependent solute flux. First we study a dipole system, i.e., one source and one sink, and discover that interdipole diffusion and flux decay timescales dictate colloidal banding. At timescales shorter than the interdipole diffusion timescale, we observe a rapid enhancement in particle enrichment around the source due to repulsion from the sink. However, at timescales longer than the interdipole diffusion timescale, the source and sink screen each other, leading to a slower enhancement. If the solute flux decays at the timescale of interdipole diffusion, an optimal separation distance is obtained such that particle enrichment is maximized. We find that the partition coefficient between solute inside the source and the bulk strongly impacts the optimal separation distance. Surprisingly, the diffusivity ratio between solute in the source and bulk has a much weaker impact on the optimal dipole separation distance. We also examine an octupole configuration, i.e., four sinks and four sources, arranged in a circle, and demonstrate that the geometric arrangement that maximizes enrichment depends on the radius of the circle. If the radius of the circle is small, it is preferred to have sources and sinks arranged in an alternating fashion. However, if the radius of the circle is large, a consecutive arrangement of sources and sinks is optimal. Our numerical framework introduces a novel method for spatially and temporally designing the banded structure of colloidal particles in two dimensions using diffusiophoresis and opens up new avenues in a field that has primarily focused on one-dimensional solute gradients.


title: Development of Hybrid Resistive Plate Chambers

abstract: Resistive Plate Chambers (RPCs) are essential active media of large-scale experiments as part of the muon systems and (semi-)digital hadron calorimeters. Among the several outstanding issues associated with the RPCs, the loss of efficiency for the detection of particles when subjected to high particle fluxes, and the limitations associated with the common RPC gases can be listed. In order to address the latter issue, we developed novel RPC designs with special anode plates coated with high secondary electron emission yield materials such as Al$_2$O$_3$ and TiO$_2$. The proof of principle was obtained for various designs and is in progress for the rest. The idea was initiated following the achievements on the development of the novel 1-glass RPCs. Here we report on the construction of various different RPC designs, and their performance measurements in laboratory tests and with particle beams; and discuss the future test plans.


title: Data-Driven Distributionally Robust Electric Vehicle Balancing for Autonomous Mobility-on-Demand Systems under Demand and Supply Uncertainties

abstract: Electric vehicles (EVs) are being rapidly adopted due to their economic and societal benefits. Autonomous mobility-on-demand (AMoD) systems also embrace this trend. However, the long charging time and high recharging frequency of EVs pose challenges to efficiently managing EV AMoD systems. The complicated dynamic charging and mobility process of EV AMoD systems makes the demand and supply uncertainties significant when designing vehicle balancing algorithms. In this work, we design a data-driven distributionally robust optimization (DRO) approach to balance EVs for both the mobility service and the charging process. The optimization goal is to minimize the worst-case expected cost under both passenger mobility demand uncertainties and EV supply uncertainties. We then propose a novel distributional uncertainty sets construction algorithm that guarantees the produced parameters are contained in desired confidence regions with a given probability. To solve the proposed DRO AMoD EV balancing problem, we derive an equivalent computationally tractable convex optimization problem. Based on real-world EV data of a taxi system, we show that with our solution the average total balancing cost is reduced by 14.49%, and the average mobility fairness and charging fairness are improved by 15.78% and 34.51%, respectively, compared to solutions that do not consider uncertainties.


title: On uniform estimates for $(n-1)-$form fully nonlinear partial differential equations on compact Hermitian manifolds

abstract: We obtain a priori $L^\infty$ estimate for a general class of $(n-1)-$form fully nonlinear partial differential equations on compact Hermitian manifolds. Our method relies on the local version of comparison with auxiliary Monge-Amp\`ere equations, developed earlier by B. Guo and D. H. Phong. The key is to find the appropriate elliptic operator such that the maximum principle applies.


title: Bifacial thermophotovoltaic energy conversion

abstract: Thermophotovoltaic (TPV) energy conversion efficiency has recently surpassed 30%. The key behind such high efficiency is the inclusion of a highly efficient mirror in the rear of the TPV cell that turns back to the thermal emitter the outband energy photons. Efficiencies over 50% could be theoretically attainable by approaching a mirror reflectance of 100%. However, the very few percent of outband absorption significantly deteriorate the conversion efficiency. Thus, current research focuses on developing advance mirror designs able to reach an extreme high outband reflectance over 95%. In this article I propose a bifacial TPV cell that enables very efficient photon recycling without using mirrors and that is less sensitive to outband optical losses. The key to this design is that the cell is introduced in a thermal emitter enclosure where it is irradiated from both sides. Then, outband photons transmit through the cell and are re-absorbed in the emitter. Therefore, the optical losses linked to the mirror/cell interface are eliminated, potentially enabling higher photon recycling efficiencies. This article presents a detailed balance simulation of an edge-cooled bifacial TPV cell to demonstrate that bifacial configuration enables higher conversion efficiencies and twice much as power density than monofacial designs, the latter being a remarkable advantage for moderate temperature and low-cost TPV power generation. Therefore, bifacial TPV cells are appealing for developing practical high-efficient and low-cost TPV devices for power generation in an extended range of heat source temperatures.


title: Estimation of a Causal Directed Acyclic Graph Process using Non-Gaussianity

abstract: Numerous approaches have been proposed to discover causal dependencies in machine learning and data mining; among them, the state-of-the-art VAR-LiNGAM (short for Vector Auto-Regressive Linear Non-Gaussian Acyclic Model) is a desirable approach to reveal both the instantaneous and time-lagged relationships. However, all the obtained VAR matrices need to be analyzed to infer the final causal graph, leading to a rise in the number of parameters. To address this issue, we propose the CGP-LiNGAM (short for Causal Graph Process-LiNGAM), which has significantly fewer model parameters and deals with only one causal graph for interpreting the causal relations by exploiting Graph Signal Processing (GSP).


title: Theoretical Study of Optimizing Rugged Landscapes with the cGA

abstract: Estimation of distribution algorithms (EDAs) provide a distribution - based approach for optimization which adapts its probability distribution during the run of the algorithm. We contribute to the theoretical understanding of EDAs and point out that their distribution approach makes them more suitable to deal with rugged fitness landscapes than classical local search algorithms. Concretely, we make the OneMax function rugged by adding noise to each fitness value. The cGA can nevertheless find solutions with n(1 - \epsilon) many 1s, even for high variance of noise. In contrast to this, RLS and the (1+1) EA, with high probability, only find solutions with n(1/2+o(1)) many 1s, even for noise with small variance.


title: Sequential Gradient Coding For Straggler Mitigation

abstract: In distributed computing, slower nodes (stragglers) usually become a bottleneck. Gradient Coding (GC), introduced by Tandon et al., is an efficient technique that uses principles of error-correcting codes to distribute gradient computation in the presence of stragglers. In this paper, we consider the distributed computation of a sequence of gradients $\{g(1),g(2),\ldots,g(J)\}$, where processing of each gradient $g(t)$ starts in round-$t$ and finishes by round-$(t+T)$. Here $T\geq 0$ denotes a delay parameter. For the GC scheme, coding is only across computing nodes and this results in a solution where $T=0$. On the other hand, having $T>0$ allows for designing schemes which exploit the temporal dimension as well. In this work, we propose two schemes that demonstrate improved performance compared to GC. Our first scheme combines GC with selective repetition of previously unfinished tasks and achieves improved straggler mitigation. In our second scheme, which constitutes our main contribution, we apply GC to a subset of the tasks and repetition for the remainder of the tasks. We then multiplex these two classes of tasks across workers and rounds in an adaptive manner, based on past straggler patterns. Using theoretical analysis, we demonstrate that our second scheme achieves significant reduction in the computational load. In our experiments, we study a practical setting of concurrently training multiple neural networks over an AWS Lambda cluster involving 256 worker nodes, where our framework naturally applies. We demonstrate that the latter scheme can yield a 16\% improvement in runtime over the baseline GC scheme, in the presence of naturally occurring, non-simulated stragglers.


title: RIXS interferometry and the role of disorder in the quantum magnet Ba$_3$Ti$_{3-x}$Ir$_{x}$O$_9$

abstract: Motivated by several claims of spin-orbit driven spin-liquid physics in hexagonal Ba$_3$Ti$_{3-x}$Ir$_x$O$_9$ hosting Ir2O9 dimers, we report on resonant inelastic x-ray scattering (RIXS) at the Ir L3 edge for different x. We demonstrate that magnetism in Ba$_3$Ti$_{3-x}$Ir$_x$O$_9$ is governed by an unconventional realization of strong disorder, where cation disorder affects the character of the local moments. RIXS interferometry, studying the RIXS intensity over a broad range of transferred momentum q, is ideally suited to assign different excitations to different Ir sites. We find pronounced Ir-Ti site mixing. Both ions are distributed over two crystallographically inequivalent sites, giving rise to a coexistence of quasimolecular singlet states on Ir2O9 dimers and spin-orbit entangled j=1/2 moments of 5d$^5$ Ir$^{4+}$ ions. RIXS reveals different kinds of strong magnetic couplings for different bonding geometries, highlighting the role of cation disorder for the suppression of long-range magnetic order in this family of compounds.


title: On the Linguistic and Computational Requirements for Creating Face-to-Face Multimodal Human-Machine Interaction

abstract: In this study, conversations between humans and avatars are linguistically, organizationally, and structurally analyzed, focusing on what is necessary for creating face-to-face multimodal interfaces for machines. We videorecorded thirty-four human-avatar interactions, performed complete linguistic microanalysis on video excerpts, and marked all the occurrences of multimodal actions and events. Statistical inferences were applied to data, allowing us to comprehend not only how often multimodal actions occur but also how multimodal events are distributed between the speaker (emitter) and the listener (recipient). We also observed the distribution of multimodal occurrences for each modality. The data show evidence that double-loop feedback is established during a face-to-face conversation. This led us to propose that knowledge from Conversation Analysis (CA), cognitive science, and Theory of Mind (ToM), among others, should be incorporated into the ones used for describing human-machine multimodal interactions. Face-to-face interfaces require an additional control layer to the multimodal fusion layer. This layer has to organize the flow of conversation, integrate the social context into the interaction, as well as make plans concerning 'what' and 'how' to progress on the interaction. This higher level is best understood if we incorporate insights from CA and ToM into the interface system.


title: Short-ranged ordering for improved mean-field simulation of disordered media: insights from refractory-metal high-entropy alloy carbonitrides

abstract: Multi-principal element materials (MPEMs) have been attracting a rapidly growing interest due to their exceptional performance under extreme conditions, from cryogenic conditions to extreme-high temperatures and pressures. Despite the simple conceptual premise behind their formation, computational high-throughput first-principles design of such materials is extremely challenging due to the large number of realizations required for sufficient statistical sampling of their design space. Furthermore, MPEMs are also known to develop short-ranged orderings (SROs) which can play a significant role in their stability and properties. Here, we present an expedient and efficient first-principles computational framework for assessing the compositional and mechanical properties of MPEMs, including SRO effects. This heuristic methodology systematically corrects phase-averaged free-energies of MPEMs to include SRO phases, while imposing constraints for materials design. To illustrate the methodology, we study the stability and mechanical properties of equi-molar refractory-metal high-entropy alloy carbonitrides (RHEA-CNs) such as ZrNbMoHfTaWC3N3. We show that SRO, arising due to preferential neighboring among refractory metals, is necessary for thermodynamic and mechanical stability and to satisfy the imposed design criteria, leading to complex compositions for which their molar fraction and mechanical properties are predicted.

categories: cond-mat.mtrl-sci cond-mat.dis-nn cond-mat.mes-hall physics.chem-ph physics.comp-ph


title: Chiral magnons in altermagnetic RuO2

abstract: Magnons in ferromagnets have one chirality, and typically are in the GHz range and have a quadratic dispersion near the zero wavevector. In contrast, magnons in antiferromagnets are commonly considered to have bands with both chiralities that are degenerate across the entire Brillouin zone, and to be in the THz range and to have a linear dispersion near the center of the Brillouin zone. Here we theoretically demonstrate a new class of magnons on a prototypical $d$-wave altermagnet RuO$_2$ with the compensated antiparallel magnetic order in the ground state. Based on density-functional-theory calculations we observe that the THz-range magnon bands in RuO$_2$ have an alternating chirality splitting, similar to the alternating spin splitting of the electronic bands, and a linear magnon dispersion near the zero wavevector. We also show that, overall, the Landau damping of this metallic altermagnet is suppressed due to the spin-split electronic structure, as compared to an artificial antiferromagnetic phase of the same RuO$_2$ crystal with spin-degenerate electronic bands and chirality-degenerate magnon bands.


title: GEFF: Improving Any Clothes-Changing Person ReID Model using Gallery Enrichment with Face Features

abstract: In the Clothes-Changing Re-Identification (CC-ReID) problem, given a query sample of a person, the goal is to determine the correct identity based on a labeled gallery in which the person appears in different clothes. Several models tackle this challenge by extracting clothes-independent features. However, the performance of these models is still lower for the clothes-changing setting compared to the same-clothes setting in which the person appears with the same clothes in the labeled gallery. As clothing-related features are often dominant features in the data, we propose a new process we call Gallery Enrichment, to utilize these features. In this process, we enrich the original gallery by adding to it query samples based on their face features, using an unsupervised algorithm. Additionally, we show that combining ReID and face feature extraction modules alongside an enriched gallery results in a more accurate ReID model, even for query samples with new outfits that do not include faces. Moreover, we claim that existing CC-ReID benchmarks do not fully represent real-world scenarios, and propose a new video CC-ReID dataset called 42Street, based on a theater play that includes crowded scenes and numerous clothes changes. When applied to multiple ReID models, our method (GEFF) achieves an average improvement of 33.5% and 6.7% in the Top-1 clothes-changing metric on the PRCC and LTCC benchmarks. Combined with the latest ReID models, our method achieves new SOTA results on the PRCC, LTCC, CCVID, LaST and VC-Clothes benchmarks and the proposed 42Street dataset.


title: Detecting Anomalies using Generative Adversarial Networks on Images

abstract: Automatic detection of anomalies such as weapons or threat objects in baggage security, or detecting impaired items in industrial production is an important computer vision task demanding high efficiency and accuracy. Most of the available data in the anomaly detection task is imbalanced as the number of positive/anomalous instances is sparse. Inadequate availability of the data makes training of a deep neural network architecture for anomaly detection challenging. This paper proposes a novel Generative Adversarial Network (GAN) based model for anomaly detection. It uses normal (non-anomalous) images to learn about the normality based on which it detects if an input image contains an anomalous/threat object. The proposed model uses a generator with an encoder-decoder network having dense convolutional skip connections for enhanced reconstruction and to capture the data distribution. A self-attention augmented discriminator is used having the ability to check the consistency of detailed features even in distant portions. We use spectral normalisation to facilitate stable and improved training of the GAN. Experiments are performed on three datasets, viz. CIFAR-10, MVTec AD (for industrial applications) and SIXray (for X-ray baggage security). On the MVTec AD and SIXray datasets, our model achieves an improvement of upto 21% and 4.6%, respectively


title: High-Precision 4D Tracking with Large Pixels using Thin Resistive Silicon Detectors

abstract: The basic principle of operation of silicon sensors with resistive read-out is built-in charge sharing. Resistive Silicon Detectors (RSD, also known as AC-LGAD), exploiting the signals seen on the electrodes surrounding the impact point, achieve excellent space and time resolutions even with very large pixels. In this paper, a TCT system using a 1064 nm picosecond laser is used to characterize sensors from the second RSD production at the Fondazione Bruno Kessler. The paper first introduces the parametrization of the errors in the determination of the position and time coordinates in RSD, then outlines the reconstruction method, and finally presents the results. Three different pixel sizes are used in the analysis: 200 x 340, 450 x 450, and 1300 x 1300 microns^2. At gain = 30, the 450 x 450 microns^2 pixel achieves a time jitter of 20 ps and a spatial resolution of 15 microns concurrently, while the 1300 x 1300 microns^2 pixel achieves 30 ps and 30 micron, respectively. The implementation of cross-shaped electrodes improves considerably the response uniformity over the pixel surface.


title: Enhanced Inversion of Schema Evolution with Provenance

abstract: Long-term data-driven studies have become indispensable in many areas of science. Often, the data formats, structures and semantics of data change over time, the data sets evolve. Therefore, studies over several decades in particular have to consider changing database schemas. The evolution of these databases lead at some point to a large number of schemas, which have to be stored and managed, costly and time-consuming. However, in the sense of reproducibility of research data each database version must be reconstructable with little effort. So a previously published result can be validated and reproduced at any time. Nevertheless, in many cases, such an evolution can not be fully reconstructed. This article classifies the 15 most frequently used schema modification operators and defines the associated inverses for each operation. For avoiding an information loss, it furthermore defines which additional provenance information have to be stored. We define four classes dealing with dangling tuples, duplicates and provenance-invariant operators. Each class will be presented by one representative. By using and extending the theory of schema mappings and their inverses for queries, data analysis, why-provenance, and schema evolution, we are able to combine data analysis applications with provenance under evolving database structures, in order to enable the reproducibility of scientific results over longer periods of time. While most of the inverses of schema mappings used for analysis or evolution are not exact, but only quasi-inverses, adding provenance information enables us to reconstruct a sub-database of research data that is sufficient to guarantee reproducibility.


title: A global view on star formation: The GLOSTAR Galactic plane survey. VII. Supernova remnants in the Galactic longitude range $28^\circ<l<36^\circ$

abstract: Context. While over 1000 supernova remnants (SNRs) are estimated to exist in the Milky Way, only less than 400 have been found to date. In the context of this apparent deficiency, more than 150 SNR candidates were recently identified in the D-configuration Very Large Array (VLA-D) continuum images of the 4--8 GHz global view on star formation (GLOSTAR) survey, in the Galactic longitude range $-2^\circ<l<60^\circ$. Aims. We attempt to find evidence of nonthermal synchrotron emission from 35 SNR candidates in the region of Galactic longitude range $28^\circ<l<36^\circ$, and also to study the radio continuum emission from the previously confirmed SNRs in this region. Methods. Using the short-spacing corrected GLOSTAR VLA-D+Effelsberg images, we measure ${\sim}6$ GHz total and linearly polarized flux densities of the SNR candidates and the SNRs that were previously confirmed. We also attempt to determine the spectral indices by measuring flux densities from complementary Galactic plane surveys and from the temperature-temperature plots of the GLOSTAR-Effelsberg images. Results. We provide evidence of nonthermal emission from four candidates that have spectral indices and polarization consistent with a SNR origin, and, considering their morphology, we are confident that three of these (G28.36+0.21, G28.78-0.44, and G29.38+0.10) are indeed SNRs. However, about $25\%$ of the candidates have spectral index measurements that indicate thermal emission, and the rest of them are too faint to have a good constraint on the spectral index yet. Conclusions. Additional observations at longer wavelengths and higher sensitivities will shed more light on the nature of these candidates. A simple Monte-Carlo simulation reiterates the view that future studies must persist with the current strategy of searching for SNRs with small angular size to solve the problem of the Milky Way's missing SNRs.


title: Multi-Template Temporal Siamese Network for Long-Term Object Tracking

abstract: Siamese Networks are one of most popular visual object tracking methods for their high speed and high accuracy tracking ability as long as the target is well identified. However, most Siamese Network based trackers use the first frame as the ground truth of an object and fail when target appearance changes significantly in next frames. They also have dif iculty distinguishing the target from similar other objects in the frame. We propose two ideas to solve both problems. The first idea is using a bag of dynamic templates, containing diverse, similar, and recent target features and continuously updating it with diverse target appearances. The other idea is to let a network learn the path history and project a potential future target location in a next frame. This tracker achieves state-of-the-art performance on the long-term tracking dataset UAV20L by improving the success rate by a large margin of 15% (65.4 vs 56.6) compared to the state-of-the-art method, HiFT. The of icial python code of this paper is publicly available.


title: Multi-label Few-shot ICD Coding as Autoregressive Generation with Prompt

abstract: Automatic International Classification of Diseases (ICD) coding aims to assign multiple ICD codes to a medical note with an average of 3,000+ tokens. This task is challenging due to the high-dimensional space of multi-label assignment (155,000+ ICD code candidates) and the long-tail challenge - Many ICD codes are infrequently assigned yet infrequent ICD codes are important clinically. This study addresses the long-tail challenge by transforming this multi-label classification task into an autoregressive generation task. Specifically, we first introduce a novel pretraining objective to generate free text diagnoses and procedure using the SOAP structure, the medical logic physicians use for note documentation. Second, instead of directly predicting the high dimensional space of ICD codes, our model generates the lower dimension of text descriptions, which then infer ICD codes. Third, we designed a novel prompt template for multi-label classification. We evaluate our Generation with Prompt model with the benchmark of all code assignment (MIMIC-III-full) and few shot ICD code assignment evaluation benchmark (MIMIC-III-few). Experiments on MIMIC-III-few show that our model performs with a marco F1 30.2, which substantially outperforms the previous MIMIC-III-full SOTA model (marco F1 4.3) and the model specifically designed for few/zero shot setting (marco F1 18.7). Finally, we design a novel ensemble learner, a cross attention reranker with prompts, to integrate previous SOTA and our best few-shot coding predictions. Experiments on MIMIC-III-full show that our ensemble learner substantially improves both macro and micro F1, from 10.4 to 14.6 and from 58.2 to 59.1, respectively.


title: Non-monotonic behavior of timescales of passage in heterogeneous media: Dependence on the nature of barriers

abstract: Usually time of passage across a region may be expected to increase with the number of barriers along the path. Can this intuition fail depending on the special nature of the barrier? We study experimentally the transport of a robotic bug which navigates through a spatially patterned array of obstacles. Depending on the nature of the obstacles we call them either entropic or energetic barriers. For energetic barriers we find that the timescales of first passage vary non-monotonically with the number of barriers, while for entropic barriers first passage times increase monotonically. We perform an exact analytic calculation to derive closed form solutions for the mean first passage time for different theoretical models of diffusion. Our analytic results capture this counter-intuitive non-monotonic behaviour for energetic barriers. We also show non-monotonic effective diffusivity in the case of energetic barriers. Finally, using numerical simulations, we show this non-monotonic behaviour for energetic barriers continues to hold true for super-diffusive transport. These results may be relevant for timescales of intra-cellular biological processes.


title: Using Selective Masking as a Bridge between Pre-training and Fine-tuning

abstract: Pre-training a language model and then fine-tuning it for downstream tasks has demonstrated state-of-the-art results for various NLP tasks. Pre-training is usually independent of the downstream task, and previous works have shown that this pre-training alone might not be sufficient to capture the task-specific nuances. We propose a way to tailor a pre-trained BERT model for the downstream task via task-specific masking before the standard supervised fine-tuning. For this, a word list is first collected specific to the task. For example, if the task is sentiment classification, we collect a small sample of words representing both positive and negative sentiments. Next, a word's importance for the task, called the word's task score, is measured using the word list. Each word is then assigned a probability of masking based on its task score. We experiment with different masking functions that assign the probability of masking based on the word's task score. The BERT model is further trained on MLM objective, where masking is done using the above strategy. Following this standard supervised fine-tuning is done for different downstream tasks. Results on these tasks show that the selective masking strategy outperforms random masking, indicating its effectiveness.


title: Reentrant phase transitions involving glassy and superfluid orders in the random hopping Bose-Hubbard model

abstract: We study a system of strongly correlated bosons with off-diagonal disorder, i.e., randomness in the kinetic energy, and find a family of reentrant phase transitions that occur as a function of the on-site interaction. We model the system using the paradigmatic Bose-Hubbard Hamiltonian with a random hopping term and solve it employing the replica trick and Trotter-Suzuki expansion known from quantum spin-glasses. From subsequent numerical calculations, we find three distinct phase boundaries at which the reentrant transitions occur: between glass and disordered phase, between superglass and superfluid ones, and between superfluid and disordered phases. All three happen at temperatures slightly above critical temperatures of corresponding non-interacting systems. When the emerging and disappearing order is glassy, this corresponds to the interplay of the thermal energy and the spread of hoppings. When superfluidity is involved, thermal fluctuations must slightly overcome the mean hopping in turn for the reentrance to occur.


title: Psychometric Instruments in Software Engineering Research on Personality: Status Quo After Fifty Years

abstract: Context: Although software development is a human activity, Software Engineering (SE) research has focused mostly on processes and tools, making human factors underrepresented. This kind of research may be improved using knowledge from human-focused disciplines. An example of missed opportunities is how SE employs psychometric instruments. Objective: Provide an overview of psychometric instruments in SE research regarding personality and provide recommendations for adopting them. Method: We conducted a systematic mapping to build an overview of instruments used within SE for assessing personality and reviewed their use from a multidisciplinary perspective of SE and social science. Results: We contribute with a secondary study covering fifty years of research (1970 to 2020). One of the most adopted instruments (MBTI) faces criticism within social sciences, and we identified discrepancies between its application and existing recommendations. We emphasize that several instruments refer to the Five-Factor Model, which despite its relevance in social sciences, has no specific advice for its application within SE. We discuss general advice for its proper application. Conclusion: The findings show that the adoption of psychometric instruments regarding personality in SE needs to be improved, ideally with the support of social science researchers. We believe that the review presented in this study can help to understand limitations and to evolve in this direction.


title: Digital Twin-Driven Computing Resource Management for Vehicular Networks

abstract: This paper presents a novel approach for computing resource management of edge servers in vehicular networks based on digital twins and artificial intelligence (AI). Specifically, we construct two-tier digital twins tailored for vehicular networks to capture networking-related features of vehicles and edge servers. By exploiting such features, we propose a two-stage computing resource allocation scheme. First, the central controller periodically generates reference policies for real-time computing resource allocation according to the network dynamics and service demands captured by digital twins of edge servers. Second, computing resources of the edge servers are allocated in real time to individual vehicles via low-complexity matching-based allocation that complies with the reference policies. By leveraging digital twins, the proposed scheme can adapt to dynamic service demands and vehicle mobility in a scalable manner. Simulation results demonstrate that the proposed digital twin-driven scheme enables the vehicular network to support more computing tasks than benchmark schemes.


title: Detecting Entities in the Astrophysics Literature: A Comparison of Word-based and Span-based Entity Recognition Methods

abstract: Information Extraction from scientific literature can be challenging due to the highly specialised nature of such text. We describe our entity recognition methods developed as part of the DEAL (Detecting Entities in the Astrophysics Literature) shared task. The aim of the task is to build a system that can identify Named Entities in a dataset composed by scholarly articles from astrophysics literature. We planned our participation such that it enables us to conduct an empirical comparison between word-based tagging and span-based classification methods. When evaluated on two hidden test sets provided by the organizer, our best-performing submission achieved $F_1$ scores of 0.8307 (validation phase) and 0.7990 (testing phase).