title: Feasibility of using survey data and semi-variogram kriging to obtain bespoke indices of neighbourhood characteristics: a simulation and a case study

abstract: Data on neighbourhood characteristics are not typically collected in epidemiological studies. They are however useful in the study of small-area health inequalities. Neighbourhood characteristics are collected in some surveys and could be linked to the data of other studies. We propose to use kriging based on semi-variogram models to predict values at non-observed locations with the aim of constructing bespoke indices of neighbourhood characteristics to be linked to data from epidemiological studies. We perform a simulation study to assess the feasibility of the method as well as a case study using data from the RECORD study. Apart from having enough observed data at small distances to the non-observed locations, a good fitting semi-variogram, a larger range and the absence of nugget effects for the semi-variogram models are factors leading to a higher reliability.


title: Atomic resolution observations of silver segregation in a [111] tilt grain boundary in copper

abstract: Alloying a material and hence segregating solutes to grain boundaries is one way to tailor a material to the demands of its application. Direct observation of solute segregation is necessary to understand how the interfacial properties are altered. In this study, we investigate the atomic structure of a high angle grain boundary both in pure copper and upon silver segregation by aberration-corrected scanning transmission electron microscopy and spectroscopy. We further correlate the experiments to atomistic simulations to quantify the local solute excess and its impact on grain boundary properties. We observe that the grain boundary structure remains intact upon silver segregation and up to five different positions within a structural unit serve as segregation sites. By combining the atomic resolution observation with atomistic modelling, we are able to quantify the local silver concentration and elucidate the underlying segregation mechanism.


title: Charge density wave induced nodal lines in LaTe$_3$

abstract: LaTe$_3$ is a noncentrosymmetric (NC) material with time reversal (TR) symmetry in which the charge density wave (CDW) is hosted by the Te bilayers. Here, we show that LaTe$_3$ hosts a Kramers nodal line (KNL), a twofold degenerate nodal line that connects the TR invariant momenta in NC achiral systems, using angle resolved photoemission spectroscopy (ARPES), density functional theory (DFT), effective band structure (EBS) calculated by band unfolding, and symmetry arguments. DFT incorporating spin-orbit coupling (SOC) reveals that the KNL -- protected by the TR and lattice symmetries -- imposes gapless crossings between the bilayer-split CDW-induced shadow bands and the main bands. In excellent agreement with the EBS, ARPES data corroborate the presence of the KNL and show that the crossings traverse the Fermi level. Furthermore, spinless nodal lines - entirely gapped out by the SOC - are formed by the linear crossings of the shadow and main bands with a high Fermi velocity.


title: Impact of generalized holonomy corrections on the cosmological primordial power spectra

abstract: The propagation of perturbations is studied with generalized holonomy corrections in a fully consistent way, ensuring that the deformed algebra of constraints remains closed. The primordial cosmological power spectra are calculated. It is shown that, although the detailed form of the correction does unavoidably impact the observables, the main known results of loop quantum cosmology are robust in this respect.


title: Interplay of stripe and double-Q magnetism with superconductivity in $\mathrm{Ba}_{1-x}\mathrm{K}_{x}\mathrm{Fe}_{2}\mathrm{As}_{2}$ under the influence of magnetic fields

abstract: At $x\approx0.25$ $\mathrm{Ba}_{1-x}\mathrm{K}_{x}\mathrm{Fe}_{2}\mathrm{As}_{2}$ undergoes a novel first-order transition from a four-fold symmetric double-Q magnetic phase to a two-fold symmetric single-Q phase, which was argued to occur simultaneously with the onset of superconductivity (B\"ohmer et al., Nat. Comm. 6, 7911 (2015)). Here, by applying magnetic fields up to 10T, we investigate in more detail the interplay of superconductivity with this magneto-structural transition using a combination of high-resolution thermal-expansion and heat-capacity measurements. We find that a magnetic field suppresses the reentrance of the single-Q orthorhombic phase more strongly than the superconducting transition, resulting in a splitting of the zero-field first-order transition. The suppression rate of the orthorhombic reentrance transition is stronger for out-of-plane than for in-plane fields and scales with the anisotropy of the superconducting state. These effects are captured within a phenomenological Ginzburg-Landau model, strongly suggesting that the suppression of the reentrant orthorhombic single-Q phase is primarily linked to the field-induced weakening of the superconducting order. Not captured by this model is however a strong reduction of the orthorhombic distortion for out-of-plane fields, which deserves further theoretical attention.


title: Global stability for nonlinear wave equations satisfying a generalized null condition

abstract: We prove global stability for a system of nonlinear wave equations satisfying a generalized null condition. The generalized null condition allows for null forms whose coefficients have bounded $C^k$ norms. We prove both pointwise decay and improved decay of good derivatives using bilinear energy estimates and duality arguments. Combining this strategy with the $r^p$ estimates of Dafermos--Rodnianski then allows us to prove global stability. The proof requires analyzing the geometry of intersecting null hypersurfaces adapted to solutions of wave equations.


title: A Learned Pixel-by-Pixel Lossless Image Compression Method with 59K Parameters and Parallel Decoding

abstract: This paper considers lossless image compression and presents a learned compression system that can achieve state-of-the-art lossless compression performance but uses only 59K parameters, which is more than 30x less than other learned systems proposed recently in the literature. The explored system is based on a learned pixel-by-pixel lossless image compression method, where each pixel's probability distribution parameters are obtained by processing the pixel's causal neighborhood (i.e. previously encoded/decoded pixels) with a simple neural network comprising 59K parameters. This causality causes the decoder to operate sequentially, i.e. the neural network has to be evaluated for each pixel sequentially, which increases decoding time significantly with common GPU software and hardware. To reduce the decoding time, parallel decoding algorithms are proposed and implemented. The obtained lossless image compression system is compared to traditional and learned systems in the literature in terms of compression performance, encoding-decoding times and computational complexity.


title: A General Purpose Supervisory Signal for Embodied Agents

abstract: Training effective embodied AI agents often involves manual reward engineering, expert imitation, specialized components such as maps, or leveraging additional sensors for depth and localization. Another approach is to use neural architectures alongside self-supervised objectives which encourage better representation learning. In practice, there are few guarantees that these self-supervised objectives encode task-relevant information. We propose the Scene Graph Contrastive (SGC) loss, which uses scene graphs as general-purpose, training-only, supervisory signals. The SGC loss does away with explicit graph decoding and instead uses contrastive learning to align an agent's representation with a rich graphical encoding of its environment. The SGC loss is generally applicable, simple to implement, and encourages representations that encode objects' semantics, relationships, and history. Using the SGC loss, we attain significant gains on three embodied tasks: Object Navigation, Multi-Object Navigation, and Arm Point Navigation. Finally, we present studies and analyses which demonstrate the ability of our trained representation to encode semantic cues about the environment.


title: Surrogate Gradient Spiking Neural Networks as Encoders for Large Vocabulary Continuous Speech Recognition

abstract: Compared to conventional artificial neurons that produce dense and real-valued responses, biologically-inspired spiking neurons transmit sparse and binary information, which can also lead to energy-efficient implementations. Recent research has shown that spiking neural networks can be trained like standard recurrent neural networks using the surrogate gradient method. They have shown promising results on speech command recognition tasks. Using the same technique, we show that they are scalable to large vocabulary continuous speech recognition, where they are capable of replacing LSTMs in the encoder with only minor loss of performance. This suggests that they may be applicable to more involved sequence-to-sequence tasks. Moreover, in contrast to their recurrent non-spiking counterparts, they show robustness to exploding gradient problems without the need to use gates.


title: Improving Simultaneous Machine Translation with Monolingual Data

abstract: Simultaneous machine translation (SiMT) is usually done via sequence-level knowledge distillation (Seq-KD) from a full-sentence neural machine translation (NMT) model. However, there is still a significant performance gap between NMT and SiMT. In this work, we propose to leverage monolingual data to improve SiMT, which trains a SiMT student on the combination of bilingual data and external monolingual data distilled by Seq-KD. Preliminary experiments on En-Zh and En-Ja news domain corpora demonstrate that monolingual data can significantly improve translation quality (e.g., +3.15 BLEU on En-Zh). Inspired by the behavior of human simultaneous interpreters, we propose a novel monolingual sampling strategy for SiMT, considering both chunk length and monotonicity. Experimental results show that our sampling strategy consistently outperforms the random sampling strategy (and other conventional typical NMT monolingual sampling strategies) by avoiding the key problem of SiMT -- hallucination, and has better scalability. We achieve +0.72 BLEU improvements on average against random sampling on En-Zh and En-Ja. Data and codes can be found at https://github.com/hexuandeng/Mono4SiMT.


title: Denoising after Entropy-based Debiasing A Robust Training Method for Dataset Bias with Noisy Labels

abstract: Improperly constructed datasets can result in inaccurate inferences. For instance, models trained on biased datasets perform poorly in terms of generalization (i.e., dataset bias). Recent debiasing techniques have successfully achieved generalization performance by underestimating easy-to-learn samples (i.e., bias-aligned samples) and highlighting difficult-to-learn samples (i.e., bias-conflicting samples). However, these techniques may fail owing to noisy labels, because the trained model recognizes noisy labels as difficult-to-learn and thus highlights them. In this study, we find that earlier approaches that used the provided labels to quantify difficulty could be affected by the small proportion of noisy labels. Furthermore, we find that running denoising algorithms before debiasing is ineffective because denoising algorithms reduce the impact of difficult-to-learn samples, including valuable bias-conflicting samples. Therefore, we propose an approach called denoising after entropy-based debiasing, i.e., DENEB, which has three main stages. (1) The prejudice model is trained by emphasizing (bias-aligned, clean) samples, which are selected using a Gaussian Mixture Model. (2) Using the per-sample entropy from the output of the prejudice model, the sampling probability of each sample that is proportional to the entropy is computed. (3) The final model is trained using existing denoising algorithms with the mini-batches constructed by following the computed sampling probability. Compared to existing debiasing and denoising algorithms, our method achieves better debiasing performance on multiple benchmarks.


title: Scalar-Induced Gravitational Waves in a $\Lambda$CDM Cosmology

abstract: We reconsider the gravitational wave spectrum induced by scalar perturbations in spatially flat Friedmann-Lema\^itre-Robertson-Walker spacetimes, focusing on the matter- and $\Lambda$-dominated epochs. During matter domination, sub-horizon modes are not free and a commonly applied approximation for the derivative of the tensor perturbation is flawed. We show analytically that this leads to a significant overestimation of the energy density spectrum. In addition, we demonstrate that gauge-dependent non-oscillating tensor perturbations appear in the presence of a cosmological constant. Complementing the analytical calculations, we compute the according present-day spectrum numerically for a Planck-like $\Lambda$CDM cosmology, finding that non-oscillating growing modes appear during the transition between matter and $\Lambda$ domination in conformal Newtonian gauge.


title: Martinize2 and Vermouth: Unified Framework for Topology Generation

abstract: Ongoing advances in force field and computer hardware development enable the use of molecular dynamics (MD) to simulate increasingly complex systems with the ultimate goal of reaching cellular complexity. At the same time, rational design by high-throughput (HT) simulations is another forefront of MD. In these areas, the Martini coarse-grained force field, especially the latest version (i.e. v3), is being actively explored because it offers enhanced spatial-temporal resolution. However, the automation tools for preparing simulations with the Martini force field, accompanying the previous version, were not designed for HT simulations or studies of complex cellular systems. Therefore, they become a major limiting factor. To address these shortcomings, we present the open-source vermouth python library. Vermouth is designed to become the unified framework for developing programs, which prepare, run, and analyze Martini simulations of complex systems. To demonstrate the power of the vermouth library, the martinize2 program is showcased as a generalization of the martinize script, originally aimed to set up simulations of proteins. In contrast to the previous version, martinize2 automatically handles protonation states in proteins and post-translation modifications, offers more options to fine-tune structural biases such as the elastic network, and can convert non-protein molecules such as ligands. Finally, martinize2 is used in two high-complexity benchmarks. The entire I-TASSER protein template database as well as a subset of 200,000 structures from the AlphaFold Protein Structure Database are converted to CG resolution and we illustrate how the checks on input structure quality can safeguard HT applications.


title: Policy iteration using Q-functions: Linear dynamics with multiplicative noise

abstract: This paper presents a novel model-free and fully data-driven policy iteration scheme for quadratic regulation of linear dynamics with state- and input-multiplicative noise. The implementation is similar to the least-squares temporal difference scheme for Markov decision processes, estimating Q-functions by solving a least-squares problem with instrumental variables. The scheme is compared with a model-based system identification scheme and natural policy gradient through numerical experiments.


title: Thermoelectric properties of Sb doped AlFe$_2$B$_2$

abstract: In this work, thermoelectric properties of Al$_{1.2}$Fe$_2$B$_2$ compound were investigated over a temperature range from 300\,K to 773\,K. Al$_{1.2}$Fe$_2$B$_2$ compound was produced by vacuum arc melting of Al, Fe, and B followed by annealing at 1323 K under argon atmosphere. The annealed ingots were subsequently crushed into powder and hot pressed at 1273 K under vacuum. The hot-pressed alloy predominantly contained Al$_{1.2}$Fe$_2$B$_2$ phase with a small fraction of FeB, which decreases further upon 0.1 \% Sb doping in Al$_{1.2}$Fe$_2$B$_2$. The pristine Al$_{1.2}$Fe$_2$B$_2$ exhibits n-type conductivity with a maximum figure of merit (zT) of 0.03 at 773\,K. The Sb doping improves the Seebeck coefficient at high temperatures and also reduces the phonon thermal conductivity across the temperature range studied. The decrease in phonon thermal conductivity is attributed to the point-defect phonon scattering due to mass fluctuation between the Fe and Sb atoms. The 0.1 at\% Sb doping at the Fe site results in improved zT of 0.056 at 773\,K in spite of its limited dissolution in Al$_{1.2}$Fe$_2$B$_2$ and forms FeSb$_2$ secondary phase.


title: Inheritance and Blockchain: Thoughts and Open Questions

abstract: Inheritance is the fundamental building block of civilization. This is the addition of wealth, knowledge and properties over time that produce the society in which we are living. Every generation does not have to start from zero and can capitalize on the efforts of previous generations. Blockchain based assets are very efficiently and securely transferred between living entities. Yet the actual way to make heirs inherit crypto-assets is seldom discussed. It appears that the problems linked with the inheritance of crypto-assets raise a lot of technical, societal and legal issues. Part of those issues have to be tackled with at the level of the blockchain infrastructure itself. The aim of this paper is to open a research field, and to discuss some ideas, with regards to this overlooked issue. Inheritance is neither a peripheral question nor one that can be dodged. It comes with its own set of challenges that have to be met if blockchain based finance, and asset management, is to be taken seriously.


title: Exotic light transition between superluminal and subliminal group velocity in a $\mathcal{PT}$ coupled slab waveguide

abstract: We propose a rigorous full-wave modal analysis based on the eigenmodes approach (\textquotedblleft supermodes\textquotedblright), that allows the calculation of the transverse electric ($TE$) and transverse magnetic ($TM$) stationary propagation eigenmodes in a coupled $\mathcal{PT}$-symmetric slab waveguide. Our findings show that the group velocity, for the fundamental $TE_{0}$ supermode, passes from superluminal to subluminal speed over both sides of a critical point (CP), located near to the exceptional point (EP). We also demonstrate that the first higher-order supermode, $TE_{1}$, exhibits a slow light phenomenon around the EP.


title: Vector Symbolic Finite State Machines in Attractor Neural Networks

abstract: Hopfield attractor networks are robust distributed models of human memory, but lack a general mechanism for effecting state-dependent attractor transitions in response to input. We propose construction rules such that an attractor network may implement an arbitrary finite state machine (FSM), where states and stimuli are represented by high-dimensional random vectors, and all state transitions are enacted by the attractor network's dynamics. Numerical simulations show the capacity of the model, in terms of the maximum size of implementable FSM, to be linear in the size of the attractor network for dense bipolar state vectors, and approximately quadratic for sparse binary state vectors. We show that the model is robust to imprecise and noisy weights, and so a prime candidate for implementation with high-density but unreliable devices. By endowing attractor networks with the ability to emulate arbitrary FSMs, we propose a plausible path by which FSMs could exist as a distributed computational primitive in biological neural networks.


title: FedALA: Adaptive Local Aggregation for Personalized Federated Learning

abstract: A key challenge in federated learning (FL) is the statistical heterogeneity that impairs the generalization of the global model on each client. To address this, we propose a method Federated learning with Adaptive Local Aggregation (FedALA) by capturing the desired information in the global model for client models in personalized FL. The key component of FedALA is an Adaptive Local Aggregation (ALA) module, which can adaptively aggregate the downloaded global model and local model towards the local objective on each client to initialize the local model before training in each iteration. To evaluate the effectiveness of FedALA, we conduct extensive experiments with five benchmark datasets in computer vision and natural language processing domains. FedALA outperforms eleven state-of-the-art baselines by up to 3.27% in test accuracy. Furthermore, we also apply ALA module to other federated learning methods and achieve up to 24.19% improvement in test accuracy.


title: Club Stationary Reflection and other Combinatorial Principles at $\aleph_{\omega+2}$

abstract: In this paper we continue the study in [Gilton-Levine-Stejskalova] of compactness and incompactness principles at double successors, focusing here on the case of double successors of singulars of countable cofinality. We obtain models which satisfy the tree property and club stationary reflection at these double successors. Moreover, we can additionally obtain either approachability or its failure. We also show how to obtain our results on $\aleph_{\omega+2}$ by incorporating collapses; particularly relevant for these circumstances is a new indestructibility theorem of ours showing that posets satisfying certain linked assumptions preserve club stationary reflection.


title: Gibbs-Helmholtz Graph Neural Network: capturing the temperature dependency of activity coefficients at infinite dilution

abstract: The accurate prediction of physicochemical properties of chemical compounds in mixtures (such as the activity coefficient at infinite dilution $\gamma_{ij}^\infty$) is essential for developing novel and more sustainable chemical processes. In this work, we analyze the performance of previously-proposed GNN-based models for the prediction of $\gamma_{ij}^\infty$, and compare them with several mechanistic models in a series of 9 isothermal studies. Moreover, we develop the Gibbs-Helmholtz Graph Neural Network (GH-GNN) model for predicting $\ln \gamma_{ij}^\infty$ of molecular systems at different temperatures. Our method combines the simplicity of a Gibbs-Helmholtz-derived expression with a series of graph neural networks that incorporate explicit molecular and intermolecular descriptors for capturing dispersion and hydrogen bonding effects. We have trained this model using experimentally determined $\ln \gamma_{ij}^\infty$ data of 40,219 binary-systems involving 1032 solutes and 866 solvents, overall showing superior performance compared to the popular UNIFAC-Dortmund model. We analyze the performance of GH-GNN for continuous and discrete inter/extrapolation and give indications for the model's applicability domain and expected accuracy. In general, GH-GNN is able to produce accurate predictions for extrapolated binary-systems if at least 25 systems with the same combination of solute-solvent chemical classes are contained in the training set and a similarity indicator above 0.35 is also present. This model and its applicability domain recommendations have been made open-source at https://github.com/edgarsmdn/GH-GNN.


title: Searching for Light Physics at the LHC

abstract: Over the last years, new physics in terms of a novel weakly-interacting massive particle (WIMP) has come more and more under pressure from experimental null results. While the remaining WIMP parameter space will be probed by next generation dark matter experiments, models of light new physics have become increasingly popular over the last decade. In an effort to explore the parameter space of such light physics, a myriad of custom designed high-precision/low-energy experiments has been proposed. In this note, however, I argue that existing LHC multipurpose experiments like ATALS and CMS have a so far unexploited potential to probe light physics via appearing displaced recoil jets. In the first part, I discuss the sensitivity of this signature to (ultra-)light scalar and axionic dark matter, while in the second part I show its sensitivity to high-energy neutrino scattering.


title: Sublimable complexes with spin switching: Chemical design, processing as thin films and integration in graphene-based devices

abstract: Among the different types of switchable molecular compounds, sublimable Fe(II) SCO molecules provide a suitable platform to develop smart devices that respond to external stimuli. Here we report the synthesis, crystallographic structure and magnetic properties of three new neutral Fe(II) SCO molecules belonging to the {Fe[H2B(pz)2]2(L)} family with bidentate-alpha-diimine ligands L = 3-(pyridin-2-yl)-[1,2,3]triazolo[1,5-a]pyridine (tzpy), 5,5,6,6-tetrahydro-4H,4H-2,2-bi(1,3-thiazine) (btz) and 4,4,5,5-tetrahydro-2,2-bithiazole (bt) (1, 2 and 3, respectively), as well as two solvated forms of 1 and 3. All three desolvated compounds present thermal- and light-induced SCO transitions with different degrees of cooperativity and effectiveness. Furthermore, 1 and 2 are demonstrated to be sublimable under HV conditions affording homogeneous thin films 200 nm thick (TF1 and TF2) that retain the chemical integrity of the original molecules regardless the deposition surface. The SCO behaviour of the films is characterized by XAS technique revealing the partial retainment of both thermal- and light-induced spin transitions, yet losing the cooperativity. Finally, SCO/2D horizontal hybrid devices based on CVD-graphene are produced using these films. Being the first ones of this type utilizing molecules of {Fe[H2B(pz)2]2(L)} family, with L = tzpy and btz, the devices have allowed the successful detection of the thermal SCO transition through the electric properties of the CVD-graphene.


title: Comparative Judgement Modeling to Map Forced Marriage at Local Levels

abstract: Forcing someone into marriage against their will is a violation of their human rights. In 2021, the county of Nottinghamshire, UK, launched a strategy to tackle forced marriage and violence against women and girls. However, accessing information about where victims are located in the county could compromise their safety, so it is not possible to develop interventions for different areas of the county. Comparative judgement studies offer a way to map the risk of human rights abuses without collecting data that could compromise victim safety. Current methods require studies to have a large number of participants, so we develop a comparative judgement model that provides a more flexible spatial modelling structure and a mechanism to schedule comparisons more effectively. The methods reduce the data collection burden on participants and make a comparative judgement study feasible with a small number of participants. Underpinning these methods is a latent variable representation that improves on the scalability of previous comparative judgement models. We use these methods to map the risk of forced marriage across Nottinghamshire thereby supporting the county's strategy for tackling violence against women and girls.


title: Thermal diode assisted by geometry under cycling temperature

abstract: Technological progress in electronics usually requires their use in increasingly aggressive environments, such as rapid thermal cycling and high power density. Thermal diodes appear as excellent candidates to thermally protect critical electronic components and ensure durability and reliability. We model the heat transport across a square plate with a hole subjected to an oscillating external temperature, such spatial and temporal symmetries are broken. We find rectification of the heat current that strongly depends on the frequency and the geometry of the hole. This system behaves as a thermal diode that could be used as part of a thermal architecture to dissipate heat under cycling temperature conditions.


title: Designing videos for undergraduate mathematics

abstract: This article presents some technical and pedagogical considerations about a series of videos made by the authors to teach elementary theory of differential equations. Intended to be a pedagogical support for undergraduate students of scientific curricula, these videos provide rigorous mathematical contents in a form that takes into account the specificities of the tool. Videos for teaching mathematics should be seen as a specific way for providing rigorous scientific content to learners, and should not be reduced to oral manuals or standard classroom lessons. Research Contribution: Arij Bouzelmate and Beno{\^i}t Rittaud are searcher and teacher in mathematics. Arij Bouzelmate is a specialist in partial differential equations and director of LaR2A. Beno{\^i}t Rittaud is a specialist in discrete mathematics and is involved in popularization of mathematics.


title: Diver Interest via Pointing: Human-Directed Object Inspection for AUVs

abstract: In this paper, we present the Diver Interest via Pointing (DIP) algorithm, a highly modular method for conveying a diver's area of interest to an autonomous underwater vehicle (AUV) using pointing gestures for underwater human-robot collaborative tasks. DIP uses a single monocular camera and exploits human body pose, even with complete dive gear, to extract underwater human pointing gesture poses and their directions. By extracting 2D scene geometry based on the human body pose and density of salient feature points along the direction of pointing, using a low-level feature detector, the DIP algorithm is able to locate objects of interest as indicated by the diver.


title: DiffRF: Rendering-Guided 3D Radiance Field Diffusion

abstract: We introduce DiffRF, a novel approach for 3D radiance field synthesis based on denoising diffusion probabilistic models. While existing diffusion-based methods operate on images, latent codes, or point cloud data, we are the first to directly generate volumetric radiance fields. To this end, we propose a 3D denoising model which directly operates on an explicit voxel grid representation. However, as radiance fields generated from a set of posed images can be ambiguous and contain artifacts, obtaining ground truth radiance field samples is non-trivial. We address this challenge by pairing the denoising formulation with a rendering loss, enabling our model to learn a deviated prior that favours good image quality instead of trying to replicate fitting errors like floating artifacts. In contrast to 2D-diffusion models, our model learns multi-view consistent priors, enabling free-view synthesis and accurate shape generation. Compared to 3D GANs, our diffusion-based approach naturally enables conditional generation such as masked completion or single-view 3D synthesis at inference time.


title: Joint Open Knowledge Base Canonicalization and Linking

abstract: Open Information Extraction (OIE) methods extract a large number of OIE triples (noun phrase, relation phrase, noun phrase) from text, which compose large Open Knowledge Bases (OKBs). However, noun phrases (NPs) and relation phrases (RPs) in OKBs are not canonicalized and often appear in different paraphrased textual variants, which leads to redundant and ambiguous facts. To address this problem, there are two related tasks: OKB canonicalization (i.e., convert NPs and RPs to canonicalized form) and OKB linking (i.e., link NPs and RPs with their corresponding entities and relations in a curated Knowledge Base (e.g., DBPedia). These two tasks are tightly coupled, and one task can benefit significantly from the other. However, they have been studied in isolation so far. In this paper, we explore the task of joint OKB canonicalization and linking for the first time, and propose a novel framework JOCL based on factor graph model to make them reinforce each other. JOCL is flexible enough to combine different signals from both tasks, and able to extend to fit any new signals. A thorough experimental study over two large scale OIE triple data sets shows that our framework outperforms all the baseline methods for the task of OKB canonicalization (OKB linking) in terms of average F1 (accuracy).


title: Isovector Axial Form Factor of the Nucleon from Lattice QCD

abstract: The isovector axial form factor of the nucleon plays a key role in interpreting data from long-baseline neutrino oscillation experiments. We present a lattice QCD calculation of this form factor, introducing a new method to directly extract its z-expansion from lattice correlators. Our final parameterization of the form factor, which extends up to spacelike virtualities of 0.7 GeV^2 with fully quantified uncertainties, agrees with previous lattice calculations but is significantly less steep than neutrino-deuterium scattering data suggests.


title: FECAM: Frequency Enhanced Channel Attention Mechanism for Time Series Forecasting

abstract: Time series forecasting is a long-standing challenge due to the real-world information is in various scenario (e.g., energy, weather, traffic, economics, earthquake warning). However some mainstream forecasting model forecasting result is derailed dramatically from ground truth. We believe it's the reason that model's lacking ability of capturing frequency information which richly contains in real world datasets. At present, the mainstream frequency information extraction methods are Fourier transform(FT) based. However, use of FT is problematic due to Gibbs phenomenon. If the values on both sides of sequences differ significantly, oscillatory approximations are observed around both sides and high frequency noise will be introduced. Therefore We propose a novel frequency enhanced channel attention that adaptively modelling frequency interdependencies between channels based on Discrete Cosine Transform which would intrinsically avoid high frequency noise caused by problematic periodity during Fourier Transform, which is defined as Gibbs Phenomenon. We show that this network generalize extremely effectively across six real-world datasets and achieve state-of-the-art performance, we further demonstrate that frequency enhanced channel attention mechanism module can be flexibly applied to different networks. This module can improve the prediction ability of existing mainstream networks, which reduces 35.99% MSE on LSTM, 10.01% on Reformer, 8.71% on Informer, 8.29% on Autoformer, 8.06% on Transformer, etc., at a slight computational cost ,with just a few line of code. Our codes and data are available at https://github.com/Zero-coder/FECAM.


title: Octocopter Design: Modelling, Control and Motion Planning

abstract: This book provides a solution to the control and motion planning design for an octocopter system. It includes a particular choice of control and motion planning algorithms which is based on the authors' previous research work, so it can be used as a reference design guidance for students, researchers as well as autonomous vehicles hobbyists. The control is constructed based on a fault tolerant approach aiming to increase the chances of the system to detect and isolate a potential failure in order to produce feasible control signals to the remaining active motors. The used motion planning algorithm is risk-aware by means that it takes into account the constraints related to the fault-dependant and mission-related maneuverability analysis of the octocopter system during the planning stage. Such a planner generates only those reference trajectories along which the octocopter system would be safe and capable of good tracking in case of a single motor fault and of majority of double motor fault scenarios. The control and motion planning algorithms presented in the book aim to increase the overall reliability of the system for completing the mission.


title: Sometimes Two Irrational Guards are Needed

abstract: In the art gallery problem, we are given a closed polygon $P$, with rational coordinates and an integer $k$. We are asked whether it is possible to find a set (of guards) $G$ of size $k$ such that any point $p\in P$ is seen by a point in $G$. We say two points $p$, $q$ see each other if the line segment $pq$ is contained inside $P$. It was shown by Abrahamsen, Adamaszek, and Miltzow that there is a polygon that can be guarded with three guards, but requires four guards if the guards are required to have rational coordinates. In other words, an optimal solution of size three might need to be irrational. We show that an optimal solution of size two might need to be irrational. Note that it is well-known that any polygon that can be guarded with one guard has an optimal guard placement with rational coordinates. Hence, our work closes the gap on when irrational guards are possible to occur.


title: The Cauchy problem for an inviscid and non-diffusive Oldroyd-B model in two dimensions

abstract: A two-dimensional inviscid and diffusive Oldroyd-B model was investigated by [T. M. Elgindi, F. Rousset, Commun. Pure Appl. Math. 68 (2015), 2005--2021] where the global existence and uniqueness of the strong solution were established for arbitrarily large initial data. As pointed out by [A. V. Bhave, R. C. Armstrong, R. A. Brown, J. Chem. Phys. 95(1991), 2988--3000], the diffusion coefficient is significantly smaller than other effects, it is interesting to study the non-diffusive model. In the present work, we obtain the global-in-time existence and uniqueness of the strong solution to the non-diffusive model with small initial data via deriving some uniform regularity estimates and taking vanishing diffusion limits. In addition, the large time behavior of the solution is studied and the optimal time-decay rates for each order of spatial derivatives are obtained. The main challenges focus on the lack of dissipation and regularity effects of the system and on the slower decay in the two-dimensional settings. A combination of the spectral analysis and the Fourier splitting method is adopted.


title: Compressive Instabilities Enable Cell-Induced Extreme Densification Patterns in the Fibrous Extracellular Matrix: Discrete Model Predictions

abstract: Through modelling and simulations we show that material instabilities play a dominant role in the mechanical behavior of the fibrous collagen Extracellular Matrix (ECM), as observed when the ECM is deformed by contractile biological cells. We compare two families of fiber network models, Family 1 with stable and Family 2 with unstable force-stretch response of individual fibers in compression. The latter is a characteristic of post-buckling of beams with hierarchical structure. Our simulations reveal different compression instabilities at play in each family, namely, fiber collapse (buckling) in Family 2 and fiber element collapse (snap-through) in Family 1. These result in highly localized densification zones consisting of strongly aligned fibers emanating from individual contractile cells or joining neighbouring cells, as observed in experiments. Despite substantial differences in the response of the two families, our work underscores the importance of buckling/compression instabilities in the behavior of fibrous biological tissues, with implications in cancer invasion and metastasis.


title: Holographic two-point functions in medium

abstract: We study two-point correlation function in a medium composed of two kinds of matter, which is the dual of a three-dimensional generalized $p$-brane gas geometry. Following the holographic prescription, we calculate temporal and spatial two-point functions in the medium. In general, the screening effect of the medium makes two-point functions decrease more rapidly than the CFT's two-point function. In the extremal limit, however, we find that a temporal two-point function is still conformal. This indicates that a two-dimensional UV CFT flows into a one-dimensional quantum mechanics in the IR limit. This is consistent with the fact that the near horizon geometry in the extremal limit reduces to AdS$_2$. We also investigate holographic mutual information representing the correlation between two subsystems. We show that a critical distance in the IR region, where the mutual information vanishes, leads to a similar behavior to the correlation length of a two-point function.


title: Olive Branch Learning: A Topology-Aware Federated Learning Framework for Space-Air-Ground Integrated Network

abstract: The space-air-ground integrated network (SAGIN), one of the key technologies for next-generation mobile communication systems, can facilitate data transmission for users all over the world, especially in some remote areas where vast amounts of informative data are collected by Internet of remote things (IoRT) devices to support various data-driven artificial intelligence (AI) services. However, training AI models centrally with the assistance of SAGIN faces the challenges of highly constrained network topology, inefficient data transmission, and privacy issues. To tackle these challenges, we first propose a novel topology-aware federated learning framework for the SAGIN, namely Olive Branch Learning (OBL). Specifically, the IoRT devices in the ground layer leverage their private data to perform model training locally, while the air nodes in the air layer and the ring-structured low earth orbit (LEO) satellite constellation in the space layer are in charge of model aggregation (synchronization) at different scales.To further enhance communication efficiency and inference performance of OBL, an efficient Communication and Non-IID-aware Air node-Satellite Assignment (CNASA) algorithm is designed by taking the data class distribution of the air nodes as well as their geographic locations into account. Furthermore, we extend our OBL framework and CNASA algorithm to adapt to more complex multi-orbit satellite networks. We analyze the convergence of our OBL framework and conclude that the CNASA algorithm contributes to the fast convergence of the global model. Extensive experiments based on realistic datasets corroborate the superior performance of our algorithm over the benchmark policies.


title: Absolute negative mobility of an active tracer in a crowded environment

abstract: Absolute negative mobility (ANM) refers to the situation where the average velocity of a driven tracer is opposite to the direction of the driving force. This effect was evidenced in different models of nonequilibrium transport in complex environments, whose description remains effective. Here, we provide a microscopic theory for this phenomenon. We show that it emerges in the model of an active tracer particle submitted to an external force, and evolving on a discrete lattice populated with mobile passive crowders. Resorting to a decoupling approximation, we compute analytically the velocity of the tracer particle as a function of the different parameters of the system, and confront our results to numerical simulations. We determine the range of parameters where ANM can be observed, characterize the response of the environment to the displacement of the tracer, and clarify the mechanism underlying ANM and its relationship with negative differential mobility (another hallmark of driven systems far from the linear response).


title: Using Large Pre-Trained Language Model to Assist FDA in Premarket Medical Device

abstract: This paper proposes a possible method using natural language processing that might assist in the FDA medical device marketing process. Actual device descriptions are taken and matched with the device description in FDA Title 21 of CFR to determine their corresponding device type. Both pre-trained word embeddings such as FastText and large pre-trained sentence embedding models such as sentence transformers are evaluated on their accuracy in characterizing a piece of device description. An experiment is also done to test whether these models can identify the devices wrongly classified in the FDA database. The result shows that sentence transformer with T5 and MPNet and GPT-3 semantic search embedding show high accuracy in identifying the correct classification by narrowing down the correct label to be contained in the first 15 most likely results, as compared to 2585 types of device descriptions that must be manually searched through. On the other hand, all methods demonstrate high accuracy in identifying completely incorrectly labeled devices, but all fail to identify false device classifications that are wrong but closely related to the true label.


title: Answer ranking in Community Question Answering: a deep learning approach

abstract: Community Question Answering is the field of computational linguistics that deals with problems derived from the questions and answers posted to websites such as Quora or Stack Overflow. Among some of these problems we find the issue of ranking the multiple answers posted in reply to each question by how informative they are in the attempt to solve the original question. This work tries to advance the state of the art on answer ranking for community Question Answering by proceeding with a deep learning approach. We started off by creating a large data set of questions and answers posted to the Stack Overflow website. We then leveraged the natural language processing capabilities of dense embeddings and LSTM networks to produce a prediction for the accepted answer attribute, and present the answers in a ranked form ordered by how likely they are to be marked as accepted by the question asker. We also produced a set of numerical features to assist with the answer ranking task. These numerical features were either extracted from metadata found in the Stack Overflow posts or derived from the questions and answers texts. We compared the performance of our deep learning models against a set of forest and boosted trees ensemble methods and found that our models could not improve the best baseline results. We speculate that this lack of performance improvement versus the baseline models may be caused by the large number of out of vocabulary words present in the programming code snippets found in the questions and answers text. We conclude that while a deep learning approach may be helpful in answer ranking problems new methods should be developed to assist with the large number of out of vocabulary words present in the programming code snippets


title: Coevolutionary Framework for Generalized Multimodal Multi-objective Optimization

abstract: Most multimodal multi-objective evolutionary algorithms (MMEAs) aim to find all global Pareto optimal sets (PSs) for a multimodal multi-objective optimization problem (MMOP). However, in real-world problems, decision makers (DMs) may be also interested in local PSs. Also, searching for both global and local PSs is more general in view of dealing with MMOPs, which can be seen as a generalized MMOP. In addition, the state-of-the-art MMEAs exhibit poor convergence on high-dimension MMOPs. To address the above two issues, in this study, a novel coevolutionary framework termed CoMMEA for multimodal multi-objective optimization is proposed to better obtain both global and local PSs, and simultaneously, to improve the convergence performance in dealing with high-dimension MMOPs. Specifically, the CoMMEA introduces two archives to the search process, and coevolves them simultaneously through effective knowledge transfer. The convergence archive assists the CoMMEA to quickly approaching the Pareto optimal front (PF). The knowledge of the converged solutions is then transferred to the diversity archive which utilizes the local convergence indicator and the $\epsilon$-dominance-based method to obtain global and local PSs effectively. Experimental results show that CoMMEA is competitive compared to seven state-of-the-art MMEAs on fifty-four complex MMOPs.


title: Experimental overview of electromagnetic probes in ultra-relativistic nucleus-nucleus collisions

abstract: Electromagnetic probes are not affected by hadronization and provide direct information about the space-time evolution of high-energy nucleus-nucleus collisions. In particular, the measurement of thermal radiation from the quark-gluon plasma and the extraction of an effective medium temperature belong to the key objectives in heavy-ion physics. We provide a brief tour of current results and an outlook to future measurements.


title: Localized and degenerate controls for the incompressible Navier-Stokes system

abstract: We consider the global approximate controllability of the two-dimensional incompressible Navier-Stokes system driven by a physically localized and degenerate force. In other words, the fluid is regulated via four scalar controls that depend only on time and appear as coefficients in an effectively constructed driving force supported in a given subdomain. Our idea consists of squeezing low mode controls into a small region, essentially by tracking their actions along the characteristic curves of a linearized vorticity equation. In this way, through explicit constructions and by connecting Coron's return method with recent concepts from geometric control, the original problem for the nonlinear Navier-Stokes system is reduced to one for a linear transport equation steered by a global force. This article can be viewed as an attempt to tackle a well-known open problem due to Agrachev.


title: Evaluation of Explanation Methods of AI -- CNNs in Image Classification Tasks with Reference-based and No-reference Metrics

abstract: The most popular methods in AI-machine learning paradigm are mainly black boxes. This is why explanation of AI decisions is of emergency. Although dedicated explanation tools have been massively developed, the evaluation of their quality remains an open research question. In this paper, we generalize the methodologies of evaluation of post-hoc explainers of CNNs' decisions in visual classification tasks with reference and no-reference based metrics. We apply them on our previously developed explainers (FEM, MLFEM), and popular Grad-CAM. The reference-based metrics are Pearson correlation coefficient and Similarity computed between the explanation map and its ground truth represented by a Gaze Fixation Density Map obtained with a psycho-visual experiment. As a no-reference metric, we use stability metric, proposed by Alvarez-Melis and Jaakkola. We study its behaviour, consensus with reference-based metrics and show that in case of several kinds of degradation on input images, this metric is in agreement with reference-based ones. Therefore, it can be used for evaluation of the quality of explainers when the ground truth is not available.


title: On the Change of Decision Boundaries and Loss in Learning with Concept Drift

abstract: The notion of concept drift refers to the phenomenon that the distribution generating the observed data changes over time. If drift is present, machine learning models may become inaccurate and need adjustment. Many technologies for learning with drift rely on the interleaved test-train error (ITTE) as a quantity which approximates the model generalization error and triggers drift detection and model updates. In this work, we investigate in how far this procedure is mathematically justified. More precisely, we relate a change of the ITTE to the presence of real drift, i.e., a changed posterior, and to a change of the training result under the assumption of optimality. We support our theoretical findings by empirical evidence for several learning algorithms, models, and datasets.


title: Software Requirements Engineering Healthcare Implementation Maturity Model (SRE-HIMM) for Global Health-Care Information System

abstract: The fundamental objective of this research work is to develop a Software Requirement Engineering Healthcare Implementation Maturity Model (SRE-HIMM) that will assist healthcare organizations to effectively evaluate and implement HIS development process. The model was developed based on the systematic literature review (SLR) approach and Empirical results. The 53 primary studies were extracted using the SLR approach and CSFs, CBs, and best practices were identified form the extracted primary studies. The identified success factors and barriers were further ranked using the analytical hierarchy process (AHP) approach. Furthermore, I have adopted the critical success factors (CSFs) and critical barriers (CBs) instead of PAs and available Maturity models i.e., CMMI for the development of (SRE-HIMM). The identified CSFs and CBs were classified into five maturity levels based on the CMMI, IMM, and SOVRM. The empirical investigation was conducted HIS experts to evaluate the findings of SLR. Further, a case study was conducted with the company to evaluate the effectiveness of SRE-HIMM which shows satisfactory results.


title: A Game of NFTs: Characterizing NFT Wash Trading in the Ethereum Blockchain

abstract: The Non-Fungible Token (NFT) market in the Ethereum blockchain experienced explosive growth in 2021, with a monthly trade volume reaching \$6 billion in January 2022. However, concerns have emerged about possible wash trading, a form of market manipulation in which one party repeatedly trades an NFT to inflate its volume artificially. Our research examines the effects of wash trading on the NFT market in Ethereum from the beginning until January 2022, using multiple approaches. We find that wash trading affects 5.66% of all NFT collections, with a total artificial volume of \$3,406,110,774. We look at two ways to profit from wash trading: Artificially increasing the price of the NFT and taking advantage of the token reward systems provided by some marketplaces. Our findings show that exploiting the token reward systems of NFTMs is much more profitable (mean gain of successful operations is \$1.055M on LooksRare), more likely to succeed (more than 80% of operations), and less risky than reselling an NFT at a higher price using wash trading (50% of activities result in a loss). Our research highlights that wash trading is frequent in Ethereum and that NFTMs should implement protective mechanisms to stop such illicit behavior.


title: Quantum NETwork: from theory to practice

abstract: The quantum internet is envisioned as the ultimate stage of the quantum revolution, which surpasses its classical counterpart in various aspects, such as the efficiency of data transmission, the security of network services, and the capability of information processing. Given its disruptive impact on the national security and the digital economy, a global race to build scalable quantum networks has already begun. With the joint effort of national governments, industrial participants and research institutes, the development of quantum networks has advanced rapidly in recent years, bringing the first primitive quantum networks within reach. In this work, we aim to provide an up-to-date review of the field of quantum networks from both theoretical and experimental perspectives, contributing to a better understanding of the building blocks required for the establishment of a global quantum internet. We also introduce a newly developed quantum network toolkit to facilitate the exploration and evaluation of innovative ideas. Particularly, it provides dual quantum computing engines, supporting simulations in both the quantum circuit and measurement-based models. It also includes a compilation scheme for mapping quantum network protocols onto quantum circuits, enabling their emulations on real-world quantum hardware devices. We showcase the power of this toolkit with several featured demonstrations, including a simulation of the Micius quantum satellite experiment, a testing of a four-layer quantum network architecture with resource management, and a quantum emulation of the CHSH game. We hope this work can give a better understanding of the state-of-the-art development of quantum networks and provide the necessary tools to make further contributions along the way.


title: Almost positively closed models

abstract: We introduce the notions of almost positively closed models and positive strong amalgamation property. We study the fundamental properties of these notions and develop some interactions between them.


title: AEther as an Inevitable Consequence of Quantum Gravity

abstract: The fact that quantum gravity does not admit an invariant vacuum state has far-reaching consequences for all physics. It points out that space could not be empty, and we return to the notion of an aether. Such a concept requires a preferred reference frame for describing universe expansion and black holes. Here, we intend to find a reference system or class of metrics that could be attributed to ``aether''. We discuss a vacuum and quantum gravity from three essential viewpoints: universe expansion, black hole existence, and quantum decoherence.


title: New physics in $B \to K^* \tau^+ \tau^-$: A model independent analysis

abstract: In this work we consider the implications of current $b \to s \ell^+ \ell^-$ ($\ell=e,\,\mu$) measurements on several $B \to K^* \tau^+ \tau^-$ observables under the assumption that the possible new physics can have both universal as well as nonuniversal couplings to leptons. For new physics solutions which provide a good fit to all $b \to s \ell^+ \ell^-$ data, we intend to identify observables with large deviations from the Standard Model (SM) predictions as well as to discriminate between various new physics solutions. For this we consider the $B \to K^* \tau^+ \tau^-$ branching fraction, the $K^*$ longitudinal fraction $f_L$, the tau forward-backward asymmetry $A_{FB}$ and the optimized observables in the $P_i^{(')}$ basis. Further, we construct the $\tau - \mu$ lepton-flavor differences ($Q^{\tau\mu}$) between these tau observables and their muonic counterparts in $B \to K^* \mu^+ \mu^-$ decay. Moreover, we also consider lepton-flavor ratios ($R^{\tau\mu}$) of all of these observables. We find that the current data allows for deviations ranging from 25% up to an order of magnitude from the SM value in a number of observables. For e.g., the magnitudes of $Q^{\tau \mu}_{P_3}$ and $Q^{\tau \mu}_{P'_8}$ observables can be enhanced up to an order of magnitude, a twofold enhancement in $Q^{\tau\mu}_{A_{FB}}$ is possible along with $\sim$50% enhancement in $R^{\tau\mu}_{K^*}$ and $\sim$25% in $R^{\tau\mu}_{A_{FB}}$. Moreover, the branching ratio of $B \to K^* \tau^+ \tau^-$ can be suppressed up to 25%. A precise measurement of these observables can also discriminate between a number of new physics solutions.


title: Anomalous optical response of graphene on hexagonal boron nitride substrates

abstract: Graphene/hBN heterostructures can be considered as one of the basic building blocks for the next-generation optoelectronics mostly owing to the record-high electron mobilities. However, currently, the studies of the intrinsic optical properties of graphene are limited to the standard substrates (SiO2/Si, glass, quartz) despite the growing interest in graphene/hBN heterostructures. This can be attributed to a challenging task of the determination of hBN's strongly anisotropic dielectric tensor in the total optical response. In this study, we overcome this issue through imaging spectroscopic ellipsometry utilizing simultaneous analysis of hBN's optical response with and without graphene monolayers. Our technique allowed us to retrieve the optical constants of graphene from graphene/hBN heterostructures in a broad spectral range of 250-950 nm. Our results suggest that graphene's absorption on hBN may exceed the one of graphene on SiO2/Si by about 60 %.


title: BEV-SAN: Accurate BEV 3D Object Detection via Slice Attention Networks

abstract: Bird's-Eye-View (BEV) 3D Object Detection is a crucial multi-view technique for autonomous driving systems. Recently, plenty of works are proposed, following a similar paradigm consisting of three essential components, i.e., camera feature extraction, BEV feature construction, and task heads. Among the three components, BEV feature construction is BEV-specific compared with 2D tasks. Existing methods aggregate the multi-view camera features to the flattened grid in order to construct the BEV feature. However, flattening the BEV space along the height dimension fails to emphasize the informative features of different heights. For example, the barrier is located at a low height while the truck is located at a high height. In this paper, we propose a novel method named BEV Slice Attention Network (BEV-SAN) for exploiting the intrinsic characteristics of different heights. Instead of flattening the BEV space, we first sample along the height dimension to build the global and local BEV slices. Then, the features of BEV slices are aggregated from the camera features and merged by the attention mechanism. Finally, we fuse the merged local and global BEV features by a transformer to generate the final feature map for task heads. The purpose of local BEV slices is to emphasize informative heights. In order to find them, we further propose a LiDAR-guided sampling strategy to leverage the statistical distribution of LiDAR to determine the heights of local slices. Compared with uniform sampling, LiDAR-guided sampling can determine more informative heights. We conduct detailed experiments to demonstrate the effectiveness of BEV-SAN. Code will be released.


title: Loss shaping enhances exact gradient learning with EventProp in Spiking Neural Networks

abstract: Event-based machine learning promises more energy-efficient AI on future neuromorphic hardware. Here, we investigate how the recently discovered Eventprop algorithm for gradient descent on exact gradients in spiking neural networks can be scaled up to challenging keyword recognition benchmarks. We implemented Eventprop in the GPU-enhanced Neural Networks framework and used it for training recurrent spiking neural networks on the Spiking Heidelberg Digits and Spiking Speech Commands datasets. We found that learning depended strongly on the loss function and extended Eventprop to a wider class of loss functions to enable effective training. When combined with the right additional mechanisms from the machine learning toolbox, Eventprop networks achieved state-of-the-art performance on Spiking Heidelberg Digits and good accuracy on Spiking Speech Commands. This work is a significant step towards a low-power neuromorphic alternative to current machine learning paradigms.


title: Safe machine learning model release from Trusted Research Environments: The AI-SDC package

abstract: We present AI-SDC, an integrated suite of open source Python tools to facilitate Statistical Disclosure Control (SDC) of Machine Learning (ML) models trained on confidential data prior to public release. AI-SDC combines (i) a SafeModel package that extends commonly used ML models to provide ante-hoc SDC by assessing the vulnerability of disclosure posed by the training regime; and (ii) an Attacks package that provides post-hoc SDC by rigorously assessing the empirical disclosure risk of a model through a variety of simulated attacks after training. The AI-SDC code and documentation are available under an MIT license at https://github.com/AI-SDC/AI-SDC.


title: Nearly Toric Schubert Varieties and Dyck Paths

abstract: In this article, we consider Ding's partition Schubert varieties whose members are very close to being a toric variety. More precisely, we characterize the spherical partition Schubert varieties in terms of Dyck paths. We introduce a notion of a nearly toric variety. We identify the nearly toric partition Schubert varieties as well as all singular nearly toric Schubert varieties. We find the cardinalities of the sets of these Schubert varieties.


title: Investigating certain choices of CNN configurations for brain lesion segmentation

abstract: Brain tumor imaging has been part of the clinical routine for many years to perform non-invasive detection and grading of tumors. Tumor segmentation is a crucial step for managing primary brain tumors because it allows a volumetric analysis to have a longitudinal follow-up of tumor growth or shrinkage to monitor disease progression and therapy response. In addition, it facilitates further quantitative analysis such as radiomics. Deep learning models, in particular CNNs, have been a methodology of choice in many applications of medical image analysis including brain tumor segmentation. In this study, we investigated the main design aspects of CNN models for the specific task of MRI-based brain tumor segmentation. Two commonly used CNN architectures (i.e. DeepMedic and U-Net) were used to evaluate the impact of the essential parameters such as learning rate, batch size, loss function, and optimizer. The performance of CNN models using different configurations was assessed with the BraTS 2018 dataset to determine the most performant model. Then, the generalization ability of the model was assessed using our in-house dataset. For all experiments, U-Net achieved a higher DSC compared to the DeepMedic. However, the difference was only statistically significant for whole tumor segmentation using FLAIR sequence data and tumor core segmentation using T1w sequence data. Adam and SGD both with the initial learning rate set to 0.001 provided the highest segmentation DSC when training the CNN model using U-Net and DeepMedic architectures, respectively. No significant difference was observed when using different normalization approaches. In terms of loss functions, a weighted combination of soft Dice and cross-entropy loss with the weighting term set to 0.5 resulted in an improved segmentation performance and training stability for both DeepMedic and U-Net models.


title: Data-Driven Prognosis of Failure Detection and Prediction of Lithium-ion Batteries

abstract: Battery prognostics and health management predictive models are essential components of safety and reliability protocols in battery management system frameworks. Overall, developing a robust and efficient battery model that aligns with the current literature is a useful step in ensuring the safety of battery function. For this purpose, a multi-physics, multi-scale deterministic data-driven prognosis (DDP) is proposed that only relies on in situ measurements of data and estimates the failure based on the curvature information extracted from the system. Unlike traditional applications that require explicit expression of conservation principle, the proposed method devices a local conservation functional in the neighborhood of each data point which is represented as the minimization of curvature in the system. By eliminating the need for offline training, the method can predict the onset of instability for a variety of systems over a prediction horizon. The prediction horizon to prognosticate the instability, alternatively, is considered as the remaining useful life (RUL) metric. The framework is then employed to analyze the health status of Li-ion batteries. Based on the results, it has demonstrated that the DDP technique can accurately predict the onset of failure of Li-ion batteries.


title: The Bumpy Road of Taking Automated Debugging to Industry

abstract: Debugging is arguably among the most difficult and extremely time consuming tasks of the software development life cycle. Therefore, it comes as no surprise that researchers have invested a considerable amount of effort in developing automated techniques and tools to support developers excel in these tasks. Despite the significant advances, including demonstrations of usefulness, efficacy, and efficiency, these techniques are yet to find their way into industrial adoption. In this paper, we reflect upon the commercialization efforts of a particular automated debugging technique and lay down potential reasons for lack of success stories as well as ideas to move forward.


title: Ablation threshold and temperature dependent thermal conductivity of high entropy carbide thin films

abstract: High entropy carbides (HECs) are a promising new class of ultra-high temperature ceramics that could provide novel material solutions for leading edges of hypersonic vehicles, which can reach temperatures above 3500C and experience extreme thermal gradients. Although the mechanical and thermal properties of HECs have been studied extensively at room temperature, few works have examined HEC properties at high temperatures or considered these materials' responses to thermal shock. In this work, we measure the thermal conductivity of a five-cation HEC up to 1200C. We find that thermal conductivity increases with temperature, consistent with trends demonstrated in single-metal carbides. We also measure thermal conductivity of an HEC deposited with varying CH4 flow rate, and find that although thermal conductivity is reduced when carbon content surpasses stoichiometric concentrations, the films all exhibited the same temperature dependent trends regardless of carbon content. To compare the thermal shock resistance of HECs with a refractory carbide, we conduct pulsed laser ablation measurements to determine the fluence threshold the HECs can withstand before damaging. We find that this metric for the average bond strength trends with the theoretical hardness of the HECs as expected.


title: A $\sim$15 kpc outflow cone piercing through the halo of the blue compact metal-poor galaxy SBS0335-052

abstract: Context: Outflows from low-mass star-forming galaxies are a fundamental ingredient for models of galaxy evolution and cosmology. Aims: The onset of kpc-scale ionised filaments in the halo of the metal-poor compact dwarf SBS 0335-052E was previously not linked to an outflow. We here we investigate whether these filaments provide evidence for an outflow. Methods: We obtained new VLT/MUSE WFM and deep NRAO/VLA B-configuration 21cm data of the galaxy. The MUSE data provide morphology, kinematics, and emission line ratios H$\beta$/H$\alpha$ and [\ion{O}{iii}]$\lambda5007$/H$\alpha$ of the low surface-brightness filaments, while the VLA data deliver morphology and kinematics of the neutral gas in and around the system. Both datasets are used in concert for comparisons between the ionised and the neutral phase. Results: We report the prolongation of a lacy filamentary ionised structure up to a projected distance of 16 kpc at $\mathrm{SB}_\mathrm{H\alpha} = 1.5\times10^{-18}$erg s$^{-1}$ cm$^{-2}$arcsec$^{-2}$. The filaments exhibit unusual low H$\alpha$/H$\beta \approx 2.4$ and low [\ion{O}{iii}]/H$\alpha \sim 0.4 - 0.6$ typical of diffuse ionised gas. They are spectrally narrow ($\sim 20$ km s$^{-1}$) and exhibit no velocity sub-structure. The filaments extend outwards of the elongated \ion{H}{I} halo. On small scales the $N_\mathrm{HI}$ peak is offset from the main star-forming sites. Morphology and kinematics of \ion{H}{I} and \ion{H}{II} reveal how star-formation driven feedback interacts differently with the ionised and the neutral phase. Conclusions: We reason that the filaments are a large scale manifestation of star-formation driven feedback, namely limb-brightened edges of a giant outflow cone that protrudes through the halo of this gas-rich system. A simple toy model of such a conical-structure is found to be commensurable with the observations.


title: Circumferential buckling of a hydrogel tube emptying upon dehydration

abstract: A cylindrical hydrogel tube, completely submerged in water, hydrates by swelling and filling its internal cavity. When it comes back into contact with air, it dehydrates: the tube thus expels the solvent through the walls, shrinking. This dehydration process causes a depression in the tube cavity, which can lead to circumferential buckling. Here we study the occurrence of such buckling using a continuous model that combines non-linear elasticity with Flory-Rehner theory, to take into account both the large deformations and the active behavior of the hydrogel. In quasi-static approximation, we use the incremental deformation formalism, extended to the chemo-mechanical equations, to determine the threshold value of the enclosed volume at which buckling is triggered. This critical value is found to depend on the shell thickness, chemical potential and constitutive features. The results obtained are in good agreement with the results of the finite element simulations of the complete dynamic problem.


title: MMBench: Benchmarking End-to-End Multi-modal DNNs and Understanding Their Hardware-Software Implications

abstract: The explosive growth of various types of big data and advances in AI technologies have catalyzed a new type of workloads called multi-modal DNNs. Multi-modal DNNs are capable of interpreting and reasoning about information from multiple modalities, making them more applicable to real-world AI scenarios. In recent research, multi-modal DNNs have outperformed the best uni-modal DNN in a wide range of distributed computing applications from traditional multimedia systems to emerging autonomous edge systems. However, despite their importance and superiority, very limited research attention has been devoted to understand the characteristics of multi-modal DNNs and their implications on current computing software/hardware platforms. Existing benchmarks either target uni-modal DNNs or only focus on the algorithm characteristics of multi-modal DNNs. There lacks representative benchmark suites that provide comprehensive system and architecture level analysis of multi-modal networks. To advance the understanding of these multi-modal DNN workloads and facilitate related research, we present MMBench, an open-source, end-to-end benchmark suite consisting of a set of real-world multi-modal DNN workloads with relevant performance metrics for evaluation. We then use MMBench to conduct an in-depth analysis on the characteristics of multi-modal DNNs. We demonstrate their unique characteristics of clear multi-stage execution, frequent synchronization and high heterogeneity, which distinguish them from conventional uni-modal DNNs. Finally, we conduct a case study and extend our benchmark to edge devices. We hope that our work can provide insights for future software/hardware design and optimization to underpin multi-modal DNNs on both cloud and edge computing platforms.


title: Hybrid Tunable Magnet Actuator: Modeling and Design

abstract: Reluctance actuators are preferred for high-precision applications. Due to resistive losses in the coils, the accuracy of this type of actuator will reduce in quasi-static operation mode within a vacuum environment. By using soft permanent magnets whose magnetization states are in-situ tuned, no constant power is needed to create a force and thereby the resistive losses will reduce. In this paper, a new tuning method is investigated in order to reduce the resistive losses. By using a history-dependent and non-linear hysteresis model, a more efficient tuning algorithm is designed. Besides this, the position accuracy and control simplicity of a variable reluctance tunable magnet actuator are improved by linearizing the non-linear force-flux relationship. This is achieved by using bias fluxes generated by hard permanent magnets.


title: Brachistochrone of off-centered cylinders

abstract: We consider the problem of finding paths of shortest transit time between two points (popularly known as Brachistochrone) for cylinders with off-centered center of mass, rolling down without slip, subject solely to the force of gravity. This problem is set up using principles of classical rigid body dynamics and the desired path function is solved for numerically using the method of discrete calculus of variations. We discover a distinct array of brachistochrone trajectories for off-centered cylinders, demonstrate a critical dependence of such paths on the initial location and orientation of cylinders' centers of mass and bring new insights into the family of brachistochrone problems and solutions.


title: Rate-induced tipping can trigger plankton blooms

abstract: Plankton blooms are complex nonlinear phenomena whose occurrence can be described by the two-timescale (fast-slow) phytoplankton-zooplankton model intrpduced by Truscott and Brindley 1994. In their work, they observed that a sufficiently fast rise of the water temperature causes a critical transition from a low phytoplankton concentration to a single outburst: a so-called plankton bloom. However, the dynamical mechanism responsible for the observed transition has not been identified to the present day. Using techniques from geometric singular perturbation theory, we uncover the formerly overlooked rate-sensitive quasithreshold which is given by special trajectories called canards. The transition from low to high concentrations occurs when this rate-sensitive quasithreshold moves past the current state of the plankton system at some narrow critical range of warming rates. In this way, we identify rate-induced tipping as the underlying dynamical mechanism. Our findings explain the previously reported transitions to a single plankton bloom, and allow us to predict a new type of transition to a sequence of blooms for higher rates of warming. This could provide a possible mechanism of the observed increased frequency of harmful algal blooms.


title: Preliminary Study on SSCF-derived Polar Coordinate for ASR

abstract: The transition angles are defined to describe the vowel-to-vowel transitions in the acoustic space of the Spectral Subband Centroids, and the findings show that they are similar among speakers and speaking rates. In this paper, we propose to investigate the usage of polar coordinates in favor of angles to describe a speech signal by characterizing its acoustic trajectory and using them in Automatic Speech Recognition. According to the experimental results evaluated on the BRAF100 dataset, the polar coordinates achieved significantly higher accuracy than the angles in the mixed and cross-gender speech recognitions, demonstrating that these representations are superior at defining the acoustic trajectory of the speech signal. Furthermore, the accuracy was significantly improved when they were utilized with their first and second-order derivatives ($\Delta$, $\Delta$$\Delta$), especially in cross-female recognition. However, the results showed they were not much more gender-independent than the conventional Mel-frequency Cepstral Coefficients (MFCCs).


title: ViTAL: Vision-Based Terrain-Aware Locomotion for Legged Robots

abstract: This work is on vision-based planning strategies for legged robots that separate locomotion planning into foothold selection and pose adaptation. Current pose adaptation strategies optimize the robot's body pose relative to given footholds. If these footholds are not reached, the robot may end up in a state with no reachable safe footholds. Therefore, we present a Vision-Based Terrain-Aware Locomotion (ViTAL) strategy that consists of novel pose adaptation and foothold selection algorithms. ViTAL introduces a different paradigm in pose adaptation that does not optimize the body pose relative to given footholds, but the body pose that maximizes the chances of the legs in reaching safe footholds. ViTAL plans footholds and poses based on skills that characterize the robot's capabilities and its terrain-awareness. We use the 90 kg HyQ and 140 kg HyQReal quadruped robots to validate ViTAL, and show that they are able to climb various obstacles including stairs, gaps, and rough terrains at different speeds and gaits. We compare ViTAL with a baseline strategy that selects the robot pose based on given selected footholds, and show that ViTAL outperforms the baseline.


title: CC-3DT: Panoramic 3D Object Tracking via Cross-Camera Fusion

abstract: To track the 3D locations and trajectories of the other traffic participants at any given time, modern autonomous vehicles are equipped with multiple cameras that cover the vehicle's full surroundings. Yet, camera-based 3D object tracking methods prioritize optimizing the single-camera setup and resort to post-hoc fusion in a multi-camera setup. In this paper, we propose a method for panoramic 3D object tracking, called CC-3DT, that associates and models object trajectories both temporally and across views, and improves the overall tracking consistency. In particular, our method fuses 3D detections from multiple cameras before association, reducing identity switches significantly and improving motion modeling. Our experiments on large-scale driving datasets show that fusion before association leads to a large margin of improvement over post-hoc fusion. We set a new state-of-the-art with 12.6% improvement in average multi-object tracking accuracy (AMOTA) among all camera-based methods on the competitive NuScenes 3D tracking benchmark, outperforming previously published methods by 6.5% in AMOTA with the same 3D detector.


title: Clustering -- Basic concepts and methods

abstract: We review clustering as an analysis tool and the underlying concepts from an introductory perspective. What is clustering and how can clusterings be realised programmatically? How can data be represented and prepared for a clustering task? And how can clustering results be validated? Connectivity-based versus prototype-based approaches are reflected in the context of several popular methods: single-linkage, spectral embedding, k-means, and Gaussian mixtures are discussed as well as the density-based protocols (H)DBSCAN, Jarvis-Patrick, CommonNN, and density-peaks.


title: Adaptive Immersed Mesh Method (AIMM) for Fluid Structure Interaction

abstract: Our paper proposes an innovative approach for modeling Fluid-Structure Interaction (FSI). Our method combines both traditional monolithic and partitioned approaches, creating a hybrid solution that facilitates FSI. At each time iteration, the solid mesh is immersed within a fluid-solid mesh, all while maintaining its independent Lagrangian hyperelastic solver. The Eulerian mesh encompasses both the fluid and solid components and accommodates various physical phenomena. We enhance the interaction between solid and fluid through anisotropic mesh adaptation and the Level-Set methods. This enables a more accurate representation of their interaction. Together, these components constitute the Adaptive Immersed Mesh Method (AIMM). For both solvers, we utilize the Variational Multi-Scale (VMS) method, mitigating potential spurious oscillations common with piecewise linear tetrahedral elements. The framework operates in 3D with parallel computing capabilities. Our methods accuracy, robustness, and capabilities are assessed through a series of 2D numerical problems. Furthermore, we present various three-dimensional test cases and compare their results to experimental data.


title: Discontinuous codimension-two bifurcation in a Vlasov equation

abstract: In a Vlasov equation, the destabilization of a homogeneous stationary state is typically described by a continuous bifurcation characterized by strong resonances between the unstable mode and the continuous spectrum. However, when the reference stationary state has a flat top, it is known that resonances drastically weaken, and the bifurcation becomes discontinuous. In this article, we use a combination of analytical tools and precise numerical simulations to demonstrate that this behavior is related to a codimension-two bifurcation, which we study in details.


title: The Tracking Tapered Gridded Estimator (TTGE) for the power spectrum from drift scan observations

abstract: Intensity mapping with the redshifted 21-cm line is an emerging tool in cosmology. Drift scan observations, where the antennas are fixed to the ground and the telescope's pointing center (PC) changes continuously on the sky due to earth's rotation, provide broad sky coverage and sustained instrumental stability needed for 21-cm intensity mapping. Here we present the Tracking Tapered Grided Estimator (TTGE) to quantify the power spectrum of the sky signal estimated directly from the visibilities measured in drift scan radio interferometric observations. The TTGE uses the data from the different PC to estimate the power spectrum of the signal from a small angular region located around a fixed tracking center (TC). The size of this angular region is decided by a suitably chosen tapering window function which serves to reduce the foreground contamination from bright sources located at large angles from the TC. It is possible to cover the angular footprint of the drift scan observations using multiple TC, and combine the estimated power spectra to increase the signal to noise ratio. Here we have validated the TTGE using simulations of $154 \, {\rm MHz}$ MWA drift scan observations. We show that the TTGE can recover the input model angular power spectrum $C_{\ell}$ within $20 \%$ accuracy over the $\ell$ range $40 < \ell < 700$.


title: Transfer Loop and Statistical Equilibrium of Korteweg-de Vries-Burgers Systems Associated to Classical Nonlinear Acoustics and Quantum Shock Waves

abstract: We propose and demonstrate, with the one-dimensional Korteweg-de Vries-Burgers model, the scenarios of transfer loop and \textit{all-scale} statistical equilibrium, the former being associated to shock formation and the latter to Gaussian distributions as in a canonical ensemble, but with wavelength-dependent temperatures. The discussions emphasize, among the multi-disciplinary relevance, the classical nonlinear acoustics and quantum shock waves, for the possibility of more favorable experimental tests.

categories: nlin.PS cond-mat.quant-gas cond-mat.stat-mech math-ph math.MP nlin.CD physics.comp-ph physics.flu-dyn


title: Multislice forward modeling of Coherent Surface Scattering Imaging on surface and interfacial structures

abstract: To study nanostructures on substrates, surface-sensitive reflection-geometry scattering techniques such as grazing incident small angle x-ray scattering are commonly used to yield an averaged statistical structural information of the surface sample. Grazing incidence geometry can probe the absolute three-dimensional structural morphology of the sample if a highly coherent beam is used. Coherent Surface Scattering Imaging (CSSI) is a powerful yet non-invasive technique similar to Coherent X-ray Diffractive Imaging (CDI) but performed at small angles and grazing-incidence reflection geometry. A challenge with CSSI is that conventional CDI reconstruction techniques cannot be directly applied to CSSI because the Fourier-transform-based forward models cannot reproduce the dynamical scattering phenomenon near the critical angle of total external reflection of the substrate-supported samples. To overcome this challenge, we have developed a multislice forward model which can successfully simulate the dynamical or multi-beam scattering generated from surface structures and the underlying substrate. The forward model is also demonstrated to be able to reconstruct an elongated 3D pattern from a single shot scattering image in the CSSI geometry through fast-performing CUDA-assisted PyTorch optimization with automatic differentiation.


title: Deep-Learning-based Vulnerability Detection in Binary Executables

abstract: The identification of vulnerabilities is an important element in the software development life cycle to ensure the security of software. While vulnerability identification based on the source code is a well studied field, the identification of vulnerabilities on basis of a binary executable without the corresponding source code is more challenging. Recent research [1] has shown, how such detection can be achieved by deep learning methods. However, that particular approach is limited to the identification of only 4 types of vulnerabilities. Subsequently, we analyze to what extent we could cover the identification of a larger variety of vulnerabilities. Therefore, a supervised deep learning approach using recurrent neural networks for the application of vulnerability detection based on binary executables is used. The underlying basis is a dataset with 50,651 samples of vulnerable code in the form of a standardized LLVM Intermediate Representation. The vectorised features of a Word2Vec model are used to train different variations of three basic architectures of recurrent neural networks (GRU, LSTM, SRNN). A binary classification was established for detecting the presence of an arbitrary vulnerability, and a multi-class model was trained for the identification of the exact vulnerability, which achieved an out-of-sample accuracy of 88% and 77%, respectively. Differences in the detection of different vulnerabilities were also observed, with non-vulnerable samples being detected with a particularly high precision of over 98%. Thus, the methodology presented allows an accurate detection of 23 (compared to 4 [1]) vulnerabilities.


title: Falsifiable analog model predictions of $W$ mass in CDF II and ATLAS

abstract: The CDF II measurement of $W$ boson mass is at significant ($6.9\,\sigma$) tension with the Standard Model, and moderate ($4.0\,\sigma$) tension with recent results from ATLAS. Any attempt to interpret this as a signature of new physics requires high-precision, robust, falsifiable predictions. The Classical Analogue to the Standard Model In pseudo-Riemannian spacetime (CASMIR) is an analogue model predicting $W$ and $Z$ boson masses of $80.3587(22)~\mathrm{GeV}/c^2$ and $91.1877(35)~\mathrm{GeV}/c^2$ respectively. During baryon collisions satisfying $\sqrt{s}< 3.09~\mathrm{TeV}$, CASMIR predicts a color-mediated enhancement of $W$ and $Z$ boson masses, becoming $80.4340(22)~\mathrm{GeV}/c^2$ and $91.1922(35)~\mathrm{GeV}/c^2$ respectively. The unenhanced masses are consistent with ATLAS data collected at $\sqrt{s}=7~\mathrm{TeV}$, and the enhanced masses are consistent with CDF II data collected at $\sqrt{s}=1.96~\mathrm{TeV}$. According to CASMIR, operation of the LHC at centre-of-mass energies small compared with $3.09~\mathrm{TeV}$ but large enough for $W$ boson formation should permit ATLAS to replicate the result from CDF II.


title: Shaping Nonlinearity in Reset Controllers for Precision Motion Systems

abstract: The precision motion industry has an ever-increasing demand for faster, more precise and more robust controllers. From the perspective of frequency domain and loopshaping technique, this demand has pushed the linear controllers to their inherent limits, namely, the waterbed effect and Bode's phase-gain relationship. Mathematically, complex-order transfer functions are not bound by Bode's phase-gain relationship. However, implementing them in practice is a challenge to be solved. This extended abstract will show review the previous work of the authors in shaping nonlinearities in reset controllers and contribute and propose an overall architecture for reset control systems to approximate complex order controllers.


title: Holographic MIMO Communications: Theoretical Foundations, Enabling Technologies, and Future Directions

abstract: Future wireless systems are envisioned to create an endogenously holography-capable, intelligent, and programmable radio propagation environment, that will offer unprecedented capabilities for high spectral and energy efficiency, low latency, and massive connectivity. A potential and promising technology for supporting the expected extreme requirements of the sixth-generation (6G) communication systems is the concept of the holographic multiple-input multiple-output (HMIMO), which will actualize holographic radios with reasonable power consumption and fabrication cost. The HMIMO is facilitated by ultra-thin, extremely large, and nearly continuous surfaces that incorporate reconfigurable and sub-wavelength-spaced antennas and/or metamaterials. Such surfaces comprising dense electromagnetic (EM) excited elements are capable of recording and manipulating impinging fields with utmost flexibility and precision, as well as with reduced cost and power consumption, thereby shaping arbitrary-intended EM waves with high energy efficiency. The powerful EM processing capability of HMIMO opens up the possibility of wireless communications of holographic imaging level, paving the way for signal processing techniques realized in the EM-domain, possibly in conjunction with their digital-domain counterparts. However, in spite of the significant potential, the studies on HMIMO communications are still at an initial stage, its fundamental limits remain to be unveiled, and a certain number of critical technical challenges need to be addressed. In this survey, we present a comprehensive overview of the latest advances in the HMIMO communications paradigm, with a special focus on their physical aspects, their theoretical foundations, as well as the enabling technologies for HMIMO systems. We also compare the HMIMO with existing multi-antenna technologies, especially the massive MIMO, present various...


title: Absence of nuclear polycyclic aromatic hydrocarbon emission from a compact starburst: The case of the type-2 quasar Mrk 477

abstract: Mrk 477 is the closest type-2 quasar (QSO2), at a distance of 163 Mpc. This makes it an ideal laboratory for studying the interplay between nuclear activity and star formation with a great level of detail and signal-to-noise. In this Letter we present new mid-infrared (mid-IR) imaging and spectroscopic data with an angular resolution of 0.4 arcsec (~300 pc) obtained with the Gran Telescopio Canarias (GTC) instrument CanariCam. The N-band (8-13 micron) spectrum of the central ~400 pc of the galaxy reveals [S IV]10.51 micron emission, but no 8.6 or 11.3 micron PAH features, which are commonly used as tracers of recent star formation. This is in stark contrast with the presence of a nuclear starburst of ~300 pc in size, an age of 6 Myr, and a mass of 1.1x10^8 Msun, as constrained from ultraviolet Hubble Space Telescope observations. Considering this, we argue that even the more resilient, neutral molecules that mainly produce the 11.3 micron PAH band are most likely being destroyed in the vicinity of the active nucleus despite the relatively large X-ray column density, of log N_H=23.5 cm^-2, and modest X-ray luminosity, of 1.5x10^43 erg/s. This highlights the importance of being cautious when using PAH features as star formation tracers in the central region of galaxies to evaluate the impact of feedback from active galactic nuclei.


title: Covariance Estimators for the ROOT-SGD Algorithm in Online Learning

abstract: Online learning naturally arises in many statistical and machine learning problems. The most widely used methods in online learning are stochastic first-order algorithms. Among this family of algorithms, there is a recently developed algorithm, Recursive One-Over-T SGD (ROOT-SGD). ROOT-SGD is advantageous in that it converges at a non-asymptotically fast rate, and its estimator further converges to a normal distribution. However, this normal distribution has unknown asymptotic covariance; thus cannot be directly applied to measure the uncertainty. To fill this gap, we develop two estimators for the asymptotic covariance of ROOT-SGD. Our covariance estimators are useful for statistical inference in ROOT-SGD. Our first estimator adopts the idea of plug-in. For each unknown component in the formula of the asymptotic covariance, we substitute it with its empirical counterpart. The plug-in estimator converges at the rate $\mathcal{O}(1/\sqrt{t})$, where $t$ is the sample size. Despite its quick convergence, the plug-in estimator has the limitation that it relies on the Hessian of the loss function, which might be unavailable in some cases. Our second estimator is a Hessian-free estimator that overcomes the aforementioned limitation. The Hessian-free estimator uses the random-scaling technique, and we show that it is an asymptotically consistent estimator of the true covariance.


title: SolarDK: A high-resolution urban solar panel image classification and localization dataset

abstract: The body of research on classification of solar panel arrays from aerial imagery is increasing, yet there are still not many public benchmark datasets. This paper introduces two novel benchmark datasets for classifying and localizing solar panel arrays in Denmark: A human annotated dataset for classification and segmentation, as well as a classification dataset acquired using self-reported data from the Danish national building registry. We explore the performance of prior works on the new benchmark dataset, and present results after fine-tuning models using a similar approach as recent works. Furthermore, we train models of newer architectures and provide benchmark baselines to our datasets in several scenarios. We believe the release of these datasets may improve future research in both local and global geospatial domains for identifying and mapping of solar panel arrays from aerial imagery. The data is accessible at https://osf.io/aj539/.


title: Generative Reasoning Integrated Label Noise Robust Deep Image Representation Learning

abstract: The development of deep learning based image representation learning (IRL) methods has attracted great attention for various image understanding problems. Most of these methods require the availability of a high quantity and quality of annotated training images, which can be time-consuming and costly to gather. To reduce labeling costs, crowdsourced data, automatic labeling procedures or citizen science projects can be considered. However, such approaches increase the risk of including label noise in training data. It may result in overfitting on noisy labels when discriminative reasoning is employed. This leads to sub-optimal learning procedures, and thus inaccurate characterization of images. To address this, we introduce a generative reasoning integrated label noise robust deep representation learning (GRID) approach. Our approach aims to model the complementary characteristics of discriminative and generative reasoning for IRL under noisy labels. To this end, we first integrate generative reasoning into discriminative reasoning through a supervised variational autoencoder. This allows GRID to automatically detect training samples with noisy labels. Then, through our label noise robust hybrid representation learning strategy, GRID adjusts the whole learning procedure for IRL of these samples through generative reasoning and that of other samples through discriminative reasoning. Our approach learns discriminative image representations while preventing interference of noisy labels independently from the IRL method being selected. Thus, unlike the existing methods, GRID does not depend on the type of annotation, neural network architecture, loss function or learning task, and thus can be directly utilized for various problems. Experimental results show its effectiveness compared to state-of-the-art methods. The code of GRID is publicly available at https://github.com/gencersumbul/GRID.