title: Vildehaye: A Family of Versatile, Widely-Applicable, and Field-Proven Lightweight Wildlife Tracking and Sensing Tags

abstract: We describe the design and implementation of Vildehaye, a family of versatile, widely-applicable, and field-proven tags for wildlife sensing and radio tracking. The family includes 6 distinct hardware designs for tags, 3 add-on boards, a programming adapter, and base stations; modular firmware for tags and base stations (both standalone low-power embedded base stations and base stations tethered to a computer running Linux or Windows); and desktop software for programming and configuring tags, monitoring tags, and downloading and processing sensor data. The tags are versatile: they support multiple packet formats, data rates, and frequency bands; they can be configured for minimum mass (down to less than 1g), making them applicable to a wide range of flying and terrestrial animals, or for inclusion of important sensors and large memories; they can transmit packets compatible with time-of-arrival transmitter-localization systems, tag identification and state packets, and they can reliably upload sensor data through their radio link. The system has been designed, upgraded, and maintained as an academic research project, but it has been extensively used by 5 different groups of ecologists in 4 countries over a period of 5 years. More than 7100 tags have been produced and most of these have been deployed. Production used 41 manufacturing runs. The tags have been used in studies that so far resulted in 9 scientific publications in ecology (including in Science). The paper describes innovative design aspects of Vildehaye, field-use experiences, and lessons from the design, implementation, and maintenance of the system. Both the hardware and software of the system are open.


title: RIS-ADMM: A RIS and ADMM-Based Passive and Sparse Sensing Method With Interference Removal

abstract: Reconfigurable Intelligent Surfaces (RIS) emerge as promising technologies in future radar and wireless communication domains. This letter addresses the passive sensing issue utilizing wireless communication signals and RIS amidst interference from wireless access points (APs). We introduce an atomic norm minimization (ANM) approach to leverage spatial domain target sparsity and estimate the direction of arrival (DOA). However, the conventional semidefinite programming (SDP)-based solutions for the ANM problem are complex and lack efficient realization. Consequently, we propose a RIS-ADMM method, an innovative alternating direction method of multipliers (ADMM)-based iterative approach. This method yields closed-form expressions and effectively suppresses interference signals. Simulation outcomes affirm that our RIS-ADMM method surpasses existing techniques in DOA estimation accuracy while maintaining low computational complexity. The code for the proposed method is available online \url{https://github.com/chenpengseu/RIS-ADMM.git}.


title: LiVeR: Lightweight Vehicle Detection and Classification in Real-Time

abstract: Detection and classification of vehicles are very significant components in an Intelligent-Transportation System. Existing solutions not only use heavy-weight and costly equipment, but also largely depend on constant cloud (Internet) connectivity, as well as adequate uninterrupted power-supply. Such dependencies make these solutions fundamentally impractical considering the possible adversities of outdoor environment as well as requirement of correlated wide-area operation. For practical use, apart from being technically sound and accurate, a solution has to be lightweight, cost-effective, easy-to-install, flexible as well as supporting efficient time-correlated coverage over large area. In this work we propose an IoT-assisted strategy to fulfil all these goals together. We adopt a top-down approach where we first introduce a lightweight framework for time-correlated low-cost wide-area measurement and then reuse the concept for developing the individual measurement units. Our extensive outdoor measurement studies and trace-based simulation on the empirical data show about 98% accuracy in vehicle detection and upto 93% of accuracy in classification of the vehicles over moderately busy urban roads.


title: Predicting Corporate Risk by Jointly Modeling Company Networks and Dialogues in Earnings Conference Calls

abstract: Earnings conference calls are significant information events for volatility forecasting, which is essential for financial risk management and asset pricing. Although some recent volatility forecasting models have utilized the textual content of conference calls, the dialogue structures of conference calls and company relationships are almost ignored in extant literature. To bridge this gap, we propose a new model called Temporal Virtual Graph Neural Network (TVGNN) for volatility forecasting by jointly modeling conference call dialogues and company networks. Our model differs from existing models in several important ways. First, we propose to exploit more dialogue structures by encoding position, utterance, speaker role, and Q\&A segments. Second, we propose to encode the market states for volatility forecasting by extending the Gated Recurrent Units (GRU). Third, we propose a new method for constructing temporal company networks in which the messages can only flow from temporally preceding to successive nodes, and extend the Graph Attention Networks (GAT) for modeling company relationships. We collect conference call transcripts of S\&P500 companies from 2008 to 2019, and construct a dataset of conference call dialogues with additional information on dialogue structures and company networks. Empirical results on our dataset demonstrate the superiority of our model over competitive baselines for volatility forecasting. We also conduct supplementary analyses to examine the effectiveness of our model's key components and interpretability.


title: Generation of Patient-specific Structured Hexahedral Mesh of Aortic Aneurysm Wall

abstract: Abdominal Aortic Aneurysm (AAA) is an enlargement in the lower part of the main artery Aorta by 1.5 times its normal diameter. AAA can cause death if rupture occurs. Elective surgeries are recommended to prevent rupture based on geometrical measurements of AAA diameter and diameter growth rate. Reliability of these geometric parameters to predict the AAA rupture risk has been questioned, and biomechanical assessment has been proposed to distinguish between patients with high and low risk of rupture. Stress in aneurysm wall is the main variable of interest in such assessment. Most studies use finite element method to compute AAA stress. This requires discretising patient-specific geometry (aneurysm wall and intraluminal thrombus ILT) into finite elements/meshes. Tetrahedral elements are most commonly used as they can be generated in seemingly automated and effortless way. In practice, however, due to complex aneurysm geometry, the process tends to require time consuming mesh optimisation to ensure sufficiently high quality of tetrahedral elements. Furthermore, ensuring solution convergence requires large number of tetrahedral elements, which leads to long computation times. In this study, we focus on generation of hexahedral meshes as they are known to provide converged solution for smaller number of elements than tetrahedral meshes. Generation of hexahedral meshes for continua with complex/irregular geometry, such as aneurysms, requires analyst interaction. We propose a procedure for generating high quality patient-specific hexahedral discretisation of aneurysm wall using the algorithms available in commercial software package for mesh generation. For aneurysm cases, we demonstrate that the procedure facilitates patient-specific mesh generation within timeframe consistent with clinical workflow constraints while requiring only limited input from the analyst.


title: A candle in the wind: a radio filament in the core of the A3562 galaxy cluster

abstract: Using a MeerKAT observation of the galaxy cluster A3562 (a member of the Shapley Supercluster), we have discovered a narrow, long and straight, very faint radio filament, which branches out at a straight angle from the tail of a radio galaxy located in projection near the core of the cluster. The radio filament spans 200 kpc and aligns with a sloshing cold front seen in the X-rays, staying inside the front in projection. The radio spectral index along the filament appears uniform (within large uncertainties) at $\alpha\simeq -1.5$. We propose that the radio galaxy is located outside the cold front, but dips its tail under the front. The tangential wind that blows there may stretch the radio plasma from the radio galaxy into a filamentary structure. Some reacceleration is needed in this scenario to maintain the radio spectrum uniform. Alternatively, the cosmic ray electrons from that spot in the tail can spread along the cluster magnetic field lines, straightened by that same tangential flow, via anomalously fast diffusion. Our radio filament can provide constraints on this process. We also uncover a compact radio source at the Brightest Cluster Galaxy (BCG) that is 2--3 orders of magnitude less luminous than those in typical cluster central galaxies -- probably an example of a BCG starved of accretion fuel by gas sloshing.


title: Transductive CLIP with Class-Conditional Contrastive Learning

abstract: Inspired by the remarkable zero-shot generalization capacity of vision-language pre-trained model, we seek to leverage the supervision from CLIP model to alleviate the burden of data labeling. However, such supervision inevitably contains the label noise, which significantly degrades the discriminative power of the classification model. In this work, we propose Transductive CLIP, a novel framework for learning a classification network with noisy labels from scratch. Firstly, a class-conditional contrastive learning mechanism is proposed to mitigate the reliance on pseudo labels and boost the tolerance to noisy labels. Secondly, ensemble labels is adopted as a pseudo label updating strategy to stabilize the training of deep neural networks with noisy labels. This framework can reduce the impact of noisy labels from CLIP model effectively by combining both techniques. Experiments on multiple benchmark datasets demonstrate the substantial improvements over other state-of-the-art methods.


title: Efficient recurrent architectures through activity sparsity and sparse back-propagation through time

abstract: Recurrent neural networks (RNNs) are well suited for solving sequence tasks in resource-constrained systems due to their expressivity and low computational requirements. However, there is still a need to bridge the gap between what RNNs are capable of in terms of efficiency and performance and real-world application requirements. The memory and computational requirements arising from propagating the activations of all the neurons at every time step to every connected neuron, together with the sequential dependence of activations, contribute to the inefficiency of training and using RNNs. We propose a solution inspired by biological neuron dynamics that makes the communication between RNN units sparse and discrete. This makes the backward pass with backpropagation through time (BPTT) computationally sparse and efficient as well. We base our model on the gated recurrent unit (GRU), extending it with units that emit discrete events for communication triggered by a threshold so that no information is communicated to other units in the absence of events. We show theoretically that the communication between units, and hence the computation required for both the forward and backward passes, scales with the number of events in the network. Our model achieves efficiency without compromising task performance, demonstrating competitive performance compared to state-of-the-art recurrent network models in real-world tasks, including language modeling. The dynamic activity sparsity mechanism also makes our model well suited for novel energy-efficient neuromorphic hardware. Code is available at https://github.com/KhaleelKhan/EvNN/.


title: Convergence of Simulated Annealing Using Kinetic Langevin Dynamics

abstract: We study the simulated annealing algorithm based on the kinetic Langevin dynamics, in order to find the global minimum of a non-convex potential function. For both the continuous time formulation and a discrete time analogue, we obtain the convergence rate results under technical conditions on the potential function, together with an appropriate choice of the cooling schedule and the time discretization parameters.


title: Exact solution for $SU(2)$-symmetry breaking bosonic mixtures at strong interactions

abstract: We study the equilibrium properties of a one-dimensional mixture of two Tonks-Girardeau gases on a ring geometry in the limit of strongly-repulsive inter-species interactions. We derive the exact many-body wavefunction and compare it to the $SU(2)$ solution where intra- and inter-species interactions are also diverging but equal. We focus on the role of the $SU(2)$-symmetry breaking on the behaviour of the large- and short-distance correlations by studying the zero-momentum occupation number and the Tan's contact from the asymptotic behavior of the momentum distribution. Although the symmetry is only weakly broken, it has important consequences on spin correlations in the system as the reduction by a factor of two of the zero-momentum occupation number with respect to the $SU(2)$ case in the thermodynamic limit and the decrease of the Tan's contact.


title: Improved Parallel Algorithms for Baumslag Groups

abstract: The Baumslag group had been a candidate for a group with an extremely difficult word problem until Myasnikov, Ushakov, and Won succeeded to show that its word problem can be solved in polynomial time. Their result used the newly developed data structure of power circuits allowing for a non-elementary compression of integers. Later this was extended in two directions: Laun showed that the same applies to the Baumslag groups $G_{1, q}$ for $q \geq 2$ and we established that the word problem of the Baumslag group $G_{1, 2}$ can be solved in $\mathsf{TC}^2$. In this work we refine the operations on reduced power circuits to further improve upon both results. We show that the word problem of the Baumslag groups $G_{p, pq}$ with $|p|,|q| \geq 1$ can be solved in $\mathsf{uTC}^1$. Moreover, we prove that the conjugacy problem in $G_{p, pq}$ is strongly generically in $\mathsf{uTC}^1$ (meaning that for "most" inputs it is in $\mathsf{uTC}^1$). Finally, for every fixed $g \in G_{1, q}$ (case $p=1$) conjugacy to $g$ can be decided in $\mathsf{uTC}^1$ for all inputs. We further show that the word problem of the Baumslag-Solitar groups $BS_{p, pq}$ is in $\mathsf{uAC}^0(F_2)$ if the input word is given in a quite compressed form and so give a complexity result for a special case of the power word problem for these groups.


title: AI-based Data Preparation and Data Analytics in Healthcare: The Case of Diabetes

abstract: The Associazione Medici Diabetologi (AMD) collects and manages one of the largest worldwide-available collections of diabetic patient records, also known as the AMD database. This paper presents the initial results of an ongoing project whose focus is the application of Artificial Intelligence and Machine Learning techniques for conceptualizing, cleaning, and analyzing such an important and valuable dataset, with the goal of providing predictive insights to better support diabetologists in their diagnostic and therapeutic choices.


title: Phonon Thermal Hall Conductivity from Scattering with Collective Fluctuations

abstract: Because electrons and ions form a coupled system, it is a priori clear that the dynamics of the lattice should reflect symmetry breaking within the electronic degrees of freedom. This has been recently clearly evidenced for the case of time-reversal and mirror symmetry breakings by observations of a large phononic thermal Hall effect in many strongly correlated electronic materials. The mechanism by which time-reversal breaking and chirality is communicated to the lattice is, however, far from evident. In this paper we discuss how this occurs via many-body scattering of phonons by collective modes: a consequence of non-Gaussian correlations of the latter modes. We derive fundamental new results for such skew (i.e. chiral) scattering and the consequent thermal Hall conductivity. From this we also obtain general formulae for these quantities for ordered antiferromagnets. From the latter we obtain the scaling behavior of the phonon thermal Hall effect in clean antiferromagnets. The calculations show several different regimes and give quantitative estimates of similar order to that seen in recent experiments.


title: AmbiSep: Ambisonic-to-Ambisonic Reverberant Speech Separation Using Transformer Networks

abstract: Consider a multichannel Ambisonic recording containing a mixture of several reverberant speech signals. Retreiving the reverberant Ambisonic signals corresponding to the individual speech sources blindly from the mixture is a challenging task as it requires to estimate multiple signal channels for each source. In this work, we propose AmbiSep, a deep neural network-based plane-wave domain masking approach to solve this task. The masking network uses learned feature representations and transformers in a triple-path processing configuration. We train and evaluate the proposed network architecture on a spatialized WSJ0-2mix dataset, and show that the method achieves a multichannel scale-invariant signal-to-distortion ratio improvement of 17.7 dB on the blind test set, while preserving the spatial characteristics of the separated sounds.


title: $T_{cc}^{+}(3875)$ relevant $DD^*$ scattering from $N_f=2$ lattice QCD

abstract: The $S$-wave $DD^*$ scattering in the isospin $I=0,1$ channels is studied in $N_f=2$ lattice QCD at $m_\pi\approx 350$ MeV. It is observed that the $DD^*$ interaction is repulsive in the $I=1$ channel when the $DD^*$ energy is near the $DD^*$ threshold. In contrast, the $DD^*$ interaction in the $I=0$ channel is definitely attractive in a wide range of the $DD^*$ energy. This is consistent with the isospin assignment $I=0$ for $T_{cc}^+(3875)$. By analyzing the components of the $DD^*$ correlation functions, it turns out that the quark diagram responsible for the different properties of $I=0,1$ $DD^*$ interactions can be understood as the charged $\rho$ meson exchange effect. This observation provides direct information on the internal dynamics of $T_{cc}^+(3875)$.


title: A Note on Quiver Yangians and $\mathcal{R}$-Matrices

abstract: In this note, we study possible $\mathcal{R}$-matrix constructions in the context of quiver Yangians and Yang-Baxter algebras. For generalized conifolds, we also discuss the relations between the quiver Yangians and some other Yangian algebras (and $\mathcal{W}$-algebras) in literature.


title: Entanglement entropies of an interval in the free Schr\"odinger field theory on the half line

abstract: We study the entanglement entropies of an interval adjacent to the boundary of the half line for the free fermionic spinless Schr\"odinger field theory at finite density and zero temperature, with either Neumann or Dirichlet boundary conditions. They are finite functions of the dimensionless parameter given by the product of the Fermi momentum and the length of the interval. The entanglement entropy displays an oscillatory behaviour, differently from the case of the interval on the whole line. This behaviour is related to the Friedel oscillations of the mean particle density on the half line at the entangling point. We find analytic expressions for the expansions of the entanglement entropies in the regimes of small and large values of the dimensionless parameter. They display a remarkable agreement with the curves obtained numerically. The analysis is extended to a family of free fermionic Lifshitz models labelled by their integer Lifshitz exponent, whose parity determines the properties of the entanglement entropies. The cumulants of the local charge operator and the Schatten norms of the underlying kernels are also explored.

categories: hep-th cond-mat.stat-mech math-ph math.MP


title: The Nazarov proof of the non-symmetric Bourgain--Milman inequality

abstract: In 2012, Nazarov used Bergman kernels and Hormander's $L^2$ estimates for the $\bar\partial$-equation to give a new proof of the Bourgain--Milman theorem for symmetric convex bodies and made some suggestions on how his proof should extend to general convex bodies. This article achieves this extension and serves simultaneously as an exposition to Nazarov's work. A key new ingredient is an affine invariant associated to the Bergman kernel of a tube domain. This gives the first `complex' proof of the Bourgain--Milman theorem for general convex bodies, specifically, without using symmetrization.


title: Positive self-similar Markov processes obtained by resurrection

abstract: In this paper we study positive self-similar Markov processes obtained by (partially) resurrecting a strictly $\alpha$-stable process at its first exit time from $(0,\infty)$. We construct those processes by using the Lamperti transform. We explain their long term behavior and give conditions for absorption at 0 in finite time. In case the process is absorbed at 0 in finite time, we give a necessary and sufficient condition for the existence of a recurrent extension. The motivation to study resurrected processes comes from the fact that their jump kernels may explode at zero. We establish sharp two-sided jump kernel estimates for a large class of resurrected stable processes.


title: TransRec: Learning Transferable Recommendation from Mixture-of-Modality Feedback

abstract: Learning large-scale pre-trained models on broad-ranging data and then transfer to a wide range of target tasks has become the de facto paradigm in many machine learning (ML) communities. Such big models are not only strong performers in practice but also offer a promising way to break out of the task-specific modeling restrictions, thereby enabling task-agnostic and unified ML systems. However, such a popular paradigm is mainly unexplored by the recommender systems (RS) community. A critical issue is that standard recommendation models are primarily built on categorical identity features. That is, the users and the interacted items are represented by their unique IDs, which are generally not shareable across different systems or platforms. To pursue the transferable recommendations, we propose studying pre-trained RS models in a novel scenario where a user's interaction feedback involves a mixture-of-modality (MoM) items, e.g., text and images. We then present TransRec, a very simple modification made on the popular ID-based RS framework. TransRec learns directly from the raw features of the MoM items in an end-to-end training manner and thus enables effective transfer learning under various scenarios without relying on overlapped users or items. We empirically study the transferring ability of TransRec across four different real-world recommendation settings. Besides, we look at its effects by scaling source and target data size. Our results suggest that learning neural recommendation models from MoM feedback provides a promising way to realize universal RS.


title: Local existence of smooth solutions for the semigeostrophic equations on curved domains

abstract: We prove local-in-time existence of smooth solutions to the semigeostrophic equations in the general setting of smooth, bounded and simply connected domains of $\mathbb{R}^2$ endowed with an arbitrary conformally flat metric and non-vanishing Coriolis term. We present a construction taking place in Eulerian coordinates, avoiding the classical reformulation in dual variables, used in the flat case with constant Coriolis force, but lacking in this general framework.


title: Toward Zero Oracle Word Error Rate on the Switchboard Benchmark

abstract: The "Switchboard benchmark" is a very well-known test set in automatic speech recognition (ASR) research, establishing record-setting performance for systems that claim human-level transcription accuracy. This work highlights lesser-known practical considerations of this evaluation, demonstrating major improvements in word error rate (WER) by correcting the reference transcriptions and deviating from the official scoring methodology. In this more detailed and reproducible scheme, even commercial ASR systems can score below 5% WER and the established record for a research system is lowered to 2.3%. An alternative metric of transcript precision is proposed, which does not penalize deletions and appears to be more discriminating for human vs. machine performance. While commercial ASR systems are still below this threshold, a research system is shown to clearly surpass the accuracy of commercial human speech recognition. This work also explores using standardized scoring tools to compute oracle WER by selecting the best among a list of alternatives. A phrase alternatives representation is compared to utterance-level N-best lists and word-level data structures; using dense lattices and adding out-of-vocabulary words, this achieves an oracle WER of 0.18%.


title: Differentiable Transient Rendering

abstract: Recent differentiable rendering techniques have become key tools to tackle many inverse problems in graphics and vision. Existing models, however, assume steady-state light transport, i.e., infinite speed of light. While this is a safe assumption for many applications, recent advances in ultrafast imaging leverage the wealth of information that can be extracted from the exact time of flight of light. In this context, physically-based transient rendering allows to efficiently simulate and analyze light transport considering that the speed of light is indeed finite. In this paper, we introduce a novel differentiable transient rendering framework, to help bring the potential of differentiable approaches into the transient regime. To differentiate the transient path integral we need to take into account that scattering events at path vertices are no longer independent; instead, tracking the time of flight of light requires treating such scattering events at path vertices jointly as a multidimensional, evolving manifold. We thus turn to the generalized transport theorem, and introduce a novel correlated importance term, which links the time-integrated contribution of a path to its light throughput, and allows us to handle discontinuities in the light and sensor functions. Last, we present results in several challenging scenarios where the time of flight of light plays an important role such as optimizing indices of refraction, non-line-of-sight tracking with nonplanar relay walls, and non-line-of-sight tracking around two corners.


title: Predicting conditional probability distributions of redshifts of Active Galactic Nuclei using Hierarchical Correlation Reconstruction

abstract: While there is a general focus on prediction of values, real data often only allows to predict conditional probability distributions, with capabilities bounded by conditional entropy $H(Y|X)$. If additionally estimating uncertainty, we can treat a predicted value as the center of Gaussian of Laplace distribution - idealization which can be far from complex conditional distributions of real data. This article applies Hierarchical Correlation Reconstruction (HCR) approach to inexpensively predict quite complex conditional probability distributions (e.g. multimodal): by independent MSE estimation of multiple moment-like parameters, which allow to reconstruct the conditional distribution. Using linear regression for this purpose, we get interpretable models: with coefficients describing contributions of features to conditional moments. This article extends on the original approach especially by using Canonical Correlation Analysis (CCA) for feature optimization and l1 "lasso" regularization, focusing on practical problem of prediction of redshift of Active Galactic Nuclei (AGN) based on Fourth Fermi-LAT Data Release 2 (4LAC) dataset.


title: Projectivity of the moduli space of vector bundles on a curve

abstract: We discuss the projectivity of the moduli space of semistable vector bundles on a curve of genus $g\geq 2$. This is a classical result from the 1960s, obtained using geometric invariant theory. We outline a modern approach that combines the recent machinery of good moduli spaces with determinantal line bundle techniques. The crucial step producing an ample line bundle follows an argument by Faltings with improvements by Esteves-Popa. We hope to promote this approach as a blueprint for other projectivity arguments.


title: Relaxed Bell inequalities as a trade-off relation between measurement dependence and hiddenness

abstract: Quantum correlations that violate the Bell inequality cannot be explained by any (measurement independent) local hidden variable theory. However, the violation only implies incompatibility of the underlying assumptions of reality, locality, and measurement independence, and does not address the extent to which each assumption is violated quantitatively. In contrast, Hall (2010,2011) gave a quantification of each assumption and generalized the Bell-CHSH inequality that gives a trade-off relationship between the underlying assumptions. In this paper, we introduce a quantification of hidden variables (hiddenness) and derive a new trade-off relation between the hiddenness and the measurement dependency that holds for any local hidden variable theory.


title: Typicality of the 2021 Western North America Summer Heatwave

abstract: Elucidating the statistical properties of extreme meteo-climatic events and capturing the physical processes responsible for their occurrence are key steps for improving our understanding of climate variability and climate change and for better evaluating the associated hazards. It has recently become apparent that large deviation theory is very useful for investigating persistent extreme events, and specifically, for flexibly estimating long return periods and for introducing a notion of dynamical typicality. Using a methodological framework based on large deviation theory and taking advantage of long simulations by a state-of-the-art Earth System Model, we investigate the 2021 North America Heatwave. Indeed, our analysis shows that the 2021 event can be seen as an unlikely but possible manifestation of climate variability, whilst its probability of occurrence is greatly amplified by the ongoing climate change. We also clarify the properties of spatial coherence of the 2021 heatwave and elucidate the role played by the Rocky Mountains in modulating hot, dry, and persistent extreme events in the Western Pacific region of North America.

categories: physics.ao-ph cond-mat.stat-mech physics.data-an physics.geo-ph


title: SEPnet: A sustainable model for a collaborative physics network

abstract: The South East Physics network (SEPnet) is a collaboration between nine universities in the South East of England, working together to deliver excellence in physics. By sharing resources, we are able to add much more value to our departments, students, and subject than we could achieve individually. Our core ambitions include ensuring the sustainability of physics in our region, enhancing the employability of our students, delivering advanced training, securing the pipeline of future students, opening up new research opportunities and breaking down barriers to improve the accessibility of physics for everyone. We believe that SEPnet provides a tried and tested model that could be rolled out by others to improve the academic excellence of other disciplines in different regions.


title: How do classroom-turnover times depend on lecture-hall size?

abstract: Academic spaces in colleges and universities span classrooms for 10 students to lecture halls that hold over 600 people. During the break between consecutive classes, students from the first class must leave and the new class must find their desks, regardless of whether the room holds 10 or 600 people. Here we address the question of how the size of large lecture halls affects classroom-turnover times, focusing on non-emergency settings. By adapting the established social-force model, we treat students as individuals who interact and move through classrooms to reach their destinations. We find that social interactions and the separation time between consecutive classes strongly influence how long it takes entering students to reach their desks, and that these effects are more pronounced in larger lecture halls. While the median time that individual students must travel increases with decreased separation time, we find that shorter separation times lead to shorter classroom-turnover times overall. This suggests that the effects of scheduling gaps and lecture-hall size on classroom dynamics depends on the perspective - individual student or whole class - that one chooses to take.


title: Automatic generation of a large dictionary with concreteness/abstractness ratings based on a small human dictionary

abstract: Concrete/abstract words are used in a growing number of psychological and neurophysiological research. For a few languages, large dictionaries have been created manually. This is a very time-consuming and costly process. To generate large high-quality dictionaries of concrete/abstract words automatically one needs extrapolating the expert assessments obtained on smaller samples. The research question that arises is how small such samples should be to do a good enough extrapolation. In this paper, we present a method for automatic ranking concreteness of words and propose an approach to significantly decrease amount of expert assessment. The method has been evaluated on a large test set for English. The quality of the constructed dictionaries is comparable to the expert ones. The correlation between predicted and expert ratings is higher comparing to the state-of-the-art methods.


title: The distribution of loss to future USS pensions due to the UUK cuts of April 2022

abstract: We present the first global analysis of the impact of the April 2022 cuts to the future pensions of members of the Universities Superannuation Scheme. For the 196,000 active members, if Consumer Price Inflation (CPI) remains at its historic average of 2.5%, the distribution of the range of cuts peaks between 30%-35%. This peak increases to 40%-45% cuts if CPI averages 3.0%. The global loss across current USS scheme members, in today's money, is calculated to be 16-18 billion GBP, with most of the 71,000 staff under the age of 40 losing between 100k-200k GBP each, for CPI averaging 2.5%-3.0%. A repeated claim made during the formal consultation by the body representing university management (Universities UK) that those earning under 40k GBP would receive a "headline" cut of 12% to their future pension is shown to be a serious underestimate for realistic CPI projections.


title: Constraint Guided Gradient Descent: Guided Training with Inequality Constraints

abstract: Deep learning is typically performed by learning a neural network solely from data in the form of input-output pairs ignoring available domain knowledge. In this work, the Constraint Guided Gradient Descent (CGGD) framework is proposed that enables the injection of domain knowledge into the training procedure. The domain knowledge is assumed to be described as a conjunction of hard inequality constraints which appears to be a natural choice for several applications. Compared to other neuro-symbolic approaches, the proposed method converges to a model that satisfies any inequality constraint on the training data and does not require to first transform the constraints into some ad-hoc term that is added to the learning (optimisation) objective. Under certain conditions, it is shown that CGGD can converges to a model that satisfies the constraints on the training set, while prior work does not necessarily converge to such a model. It is empirically shown on two independent and small data sets that CGGD makes training less dependent on the initialisation of the network and improves the constraint satisfiability on all data.


title: Microwave-activated gates between a fluxonium and a transmon qubit

abstract: We propose and analyze two types of microwave-activated gates between a fluxonium and a transmon qubit, namely a cross-resonance (CR) and a CPHASE gate. The large frequency difference between a transmon and a fluxonium makes the realization of a two-qubit gate challenging. For a medium-frequency fluxonium qubit, the transmon-fluxonium system allows for a cross-resonance effect mediated by the higher levels of the fluxonium over a wide range of transmon frequencies. This allows one to realize the cross-resonance gate by driving the fluxonium at the transmon frequency, mitigating typical problems of the cross-resonance gate in transmon-transmon chips related to frequency targeting and residual ZZ coupling. However, when the fundamental frequency of the fluxonium enters the low-frequency regime below 100 MHz, the cross-resonance effect decreases leading to long gate times. For this range of parameters, a fast microwave CPHASE gate can be implemented using the higher levels of the fluxonium. In both cases, we perform numerical simulations of the gate showing that a gate fidelity above 99% can be obtained with gate times between 100 and 300 ns. Next to a detailed gate analysis, we perform a study of chip yield for a surface code lattice of fluxonia and transmons interacting via the proposed cross-resonance gate. We find a much better yield as compared to a transmon-only architecture with the cross-resonance gate as native two-qubit gate.


title: Topics on Fano varieties of K3 type

abstract: This is a survey paper about a selection of recent results on the geometry of a special class of Fano varieties, which are called of K3 type. The focus is mostly Hodge-theoretical, with an eye towards the multiple connections between Fano varieties of K3 type and hyperk\"ahler geometry.


title: Gaia Data Release 3: External calibration of BP/RP low-resolution spectroscopic data

abstract: Context. Gaia Data Release 3 contains astrometry and photometry results for about 1.8 billion sources based on observations collected by the European Space Agency (ESA) Gaia satellite during the first 34 months of its operational phase (the same period covered Gaia early Data Release 3; Gaia EDR3). Low-resolution spectra for 220 million sources are one of the important new data products included in this release. Aims. In this paper, we focus on the external calibration of low-resolution spectroscopic content, describing the input data, algorithms, data processing, and the validation of the results. Particular attention is given to the quality of the data and to a number of features that users may need to take into account to make the best use of the catalogue. Methods. We calibrated an instrument model to relate mean Gaia spectra to the corresponding spectral energy distributions using an extended set of calibrators: this includes modelling of the instrument dispersion relation, transmission, and line spread functions. Optimisation of the model is achieved through total least-squares regression, accounting for errors in Gaia and external spectra. Results. The resulting instrument model can be used for forward modelling of Gaia spectra or for inverse modelling of externally calibrated spectra in absolute flux units. Conclusions. The absolute calibration derived in this paper provides an essential ingredient for users of BP/RP spectra. It allows users to connect BP/RP spectra to absolute fluxes and physical wavelengths.


title: Projective characterization of higher-order quantum transformations

abstract: Transformations of transformations, also called higher-order transformations, is a natural concept in information processing, which has recently attracted significant interest in the study of quantum causal relations. In this work, a framework for characterizing higher-order quantum transformations which relies on the use of superoperator projectors is presented. More precisely, working with projectors in the Choi-Jamiolkowski picture is shown to provide a handy way of defining the characterization constraints on any class of higher-order transformations. The algebraic properties of these projectors are furthermore identified as a model of multiplicative additive linear logic (MALL). The main novelty of this work is the introduction in the algebra of the 'prec' connector. It is used for the characterization of maps that are no signaling from input to output or the other way around. This allows to assess the possible signaling structure of any maps characterized within the projective framework. The properties of the prec are moreover shown to yield a canonical form for projective expressions. This provides an unambiguous way to compare different higher-order theories.


title: Gaia Data Release 3: Mapping the asymmetric disc of the Milky Way

abstract: With the most recent Gaia data release the number of sources with complete 6D phase space information (position and velocity) has increased to well over 33 million stars, while stellar astrophysical parameters are provided for more than 470 million sources, in addition to the identification of over 11 million variable stars. Using the astrophysical parameters and variability classifications provided in Gaia DR3, we select various stellar populations to explore and identify non-axisymmetric features in the disc of the Milky Way in both configuration and velocity space. Using more about 580 thousand sources identified as hot OB stars, together with 988 known open clusters younger than 100 million years, we map the spiral structure associated with star formation 4-5 kpc from the Sun. We select over 2800 Classical Cepheids younger than 200 million years, which show spiral features extending as far as 10 kpc from the Sun in the outer disc. We also identify more than 8.7 million sources on the red giant branch (RGB), of which 5.7 million have line-of-sight velocities, allowing the velocity field of the Milky Way to be mapped as far as 8 kpc from the Sun, including the inner disc. The spiral structure revealed by the young populations is consistent with recent results using Gaia EDR3 astrometry and source lists based on near infrared photometry, showing the Local (Orion) arm to be at least 8 kpc long, and an outer arm consistent with what is seen in HI surveys, which seems to be a continuation of the Perseus arm into the third quadrant. Meanwhile, the subset of RGB stars with velocities clearly reveals the large scale kinematic signature of the bar in the inner disc, as well as evidence of streaming motions in the outer disc that might be associated with spiral arms or bar resonances. (abridged)


title: Automated Evaluation of Standardized Dementia Screening Tests

abstract: For dementia screening and monitoring, standardized tests play a key role in clinical routine since they aim at minimizing subjectivity by measuring performance on a variety of cognitive tasks. In this paper, we report on a study that consists of a semi-standardized history taking followed by two standardized neuropsychological tests, namely the SKT and the CERAD-NB. The tests include basic tasks such as naming objects, learning word lists, but also widely used tools such as the MMSE. Most of the tasks are performed verbally and should thus be suitable for automated scoring based on transcripts. For the first batch of 30 patients, we analyze the correlation between expert manual evaluations and automatic evaluations based on manual and automatic transcriptions. For both SKT and CERAD-NB, we observe high to perfect correlations using manual transcripts; for certain tasks with lower correlation, the automatic scoring is stricter than the human reference since it is limited to the audio. Using automatic transcriptions, correlations drop as expected and are related to recognition accuracy; however, we still observe high correlations of up to 0.98 (SKT) and 0.85 (CERAD-NB). We show that using word alternatives helps to mitigate recognition errors and subsequently improves correlation with expert scores.


title: Non-optimal levels of some reducible mod $p$ modular representations

abstract: Let $p \geq 5$ be a prime, $N$ be an integer not divisible by $p$, $\bar\rho_0$ be a reducible, odd and semi-simple representation of $G_{\mathbb{Q},Np}$ of dimension $2$ and $\{\ell_1,\cdots,\ell_r\}$ be a set of primes not dividing $Np$. After assuming that a certain Selmer group has dimension at most $1$, we find sufficient conditions for the existence of a cuspidal eigenform $f$ of level $N\prod_{i=1}^{r}\ell_i$ and appropriate weight lifting $\bar\rho_0$ such that $f$ is new at every $\ell_i$. Moreover, suppose $p \mid \ell_{i_0}+1$ for some $1 \leq i_0 \leq r$. Then, after assuming that a certain Selmer group vanishes, we find sufficient conditions for the existence of a cuspidal eigenform of level $N\ell_{i_0}^2 \prod_{j \neq i_0} \ell_j$ and appropriate weight which is new at every $\ell_i$ and which lifts $\bar\rho_0$. As a consequence, we prove a conjecture of Billerey--Menares in many cases.


title: Sync or Fork: Node-Level Synchronization Analysis of Blockchain

abstract: As the cornerstone of blockchain, block synchronization plays a vital role in maintaining the security. Without full blockchain synchronization, unexpected forks will emerge and thus providing a breeding ground for various malicious attacks. The state-of-the-art works mainly study the relationship between the propagation time and blockchain security at the systematic level, neglecting the fine-grained impact of peering nodes in blockchain networks. To conduct a node-level synchronization analysis, we take advantage of the large deviation theory and game theory to study the pull-based propagation from a microscopic perspective. We examine the blockchain synchronization in a bidirectional manner via investigating the impact of full nodes as responders and that of partial nodes as requesters. Based on that, we further reveal the most efficient path to speed up synchronization from full nodes and design the best synchronization request scheme based on the concept of correlated equilibrium for partial nodes. Extensive experimental results demonstrate the effectiveness of our analysis.


title: Dark Matter in a Singlet Extended Inert Higgs Doublet Model

abstract: In this work, we consider an extension of the Standard Model (SM) with an inert Higgs doublet and a real scalar singlet, in order to address problems around the origin of dark matter (DM). In this model, the lightest among the CP-odd and CP-even neutral inert components plays the role of a DM candidate, where the model parameters are subject to many theoretical and experimental constraints. These constraints include vacuum stability, perturbativity, LEP negative searches, electroweak precision tests, Higgs di-photon, Higgs invisible and Higgs undetermined decays, DM relic density and DM direct detection bounds. Using these constraints, we find that the allowed parameter space for these models is quite sizeable and could be explored in upcoming collider and astrophysical searches.


title: Gaia DR3: Specific processing and validation of all-sky RR Lyrae and Cepheid stars -- The Cepheid sample

abstract: Context. Cepheids are pulsating stars that play a crucial role in several astrophysical contexts. Among the different types, the Classical Cepheids are fundamental tools for the calibration of the extragalactic distance ladder. They are also powerful stellar population tracers in the context of Galactic studies. The Gaia Third Data Release (DR3) publishes improved data on Cepheids collected during the initial 34 months of operations. Aims. We present the Gaia DR3 catalogue of Cepheids of all types, obtained through the analysis carried out with the Specific Object Study (SOS) Cep&RRL pipeline. Methods. We discuss the procedures adopted to clean the Cepheid sample from spurious objects, to validate the results, and to re-classify sources with a wrong outcome from the SOS Cep&RRL pipeline. Results. The Gaia DR3 includes multi-band time-series photometry and characterisation by the SOS Cep&RRL pipeline for a sample of 15,006 Cepheids of all types. The sample includes 4,663, 4,616, 321 and 185 pulsators, distributed in the LMC, SMC, M31 and M33, respectively, as well as 5 221 objects in the remaining All Sky sub-region which includes stars in the MW field/clusters and in a number of small satellites of our Galaxy. Among this sample, 327 objects were known as variable stars in the literature but with a different classification, while, to the best of our knowledge, 474 stars have not been reported before to be variable stars and therefore they likely are new Cepheids discovered by Gaia.


title: Symbolic Regression for Space Applications: Differentiable Cartesian Genetic Programming Powered by Multi-objective Memetic Algorithms

abstract: Interpretable regression models are important for many application domains, as they allow experts to understand relations between variables from sparse data. Symbolic regression addresses this issue by searching the space of all possible free form equations that can be constructed from elementary algebraic functions. While explicit mathematical functions can be rediscovered this way, the determination of unknown numerical constants during search has been an often neglected issue. We propose a new multi-objective memetic algorithm that exploits a differentiable Cartesian Genetic Programming encoding to learn constants during evolutionary loops. We show that this approach is competitive or outperforms machine learned black box regression models or hand-engineered fits for two applications from space: the Mars express thermal power estimation and the determination of the age of stars by gyrochronology.


title: Real-World Light Field Image Super-Resolution via Degradation Modulation

abstract: Recent years have witnessed the great advances of deep neural networks (DNNs) in light field (LF) image super-resolution (SR). However, existing DNN-based LF image SR methods are developed on a single fixed degradation (e.g., bicubic downsampling), and thus cannot be applied to super-resolve real LF images with diverse degradation. In this paper, we propose a simple yet effective method for real-world LF image SR. In our method, a practical LF degradation model is developed to formulate the degradation process of real LF images. Then, a convolutional neural network is designed to incorporate the degradation prior into the SR process. By training on LF images using our formulated degradation, our network can learn to modulate different degradation while incorporating both spatial and angular information in LF images. Extensive experiments on both synthetically degraded and real-world LF images demonstrate the effectiveness of our method. Compared with existing state-of-the-art single and LF image SR methods, our method achieves superior SR performance under a wide range of degradation, and generalizes better to real LF images. Codes and models are available at https://yingqianwang.github.io/LF-DMnet/.


title: Gaia Data Release 3: The Galaxy in your preferred colours. Synthetic photometry from Gaia low-resolution spectra

abstract: Gaia Data Release 3 provides novel flux-calibrated low-resolution spectrophotometry for about 220 million sources in the wavelength range 330nm - 1050nm (XP spectra). Synthetic photometry directly tied to a flux in physical units can be obtained from these spectra for any passband fully enclosed in this wavelength range. We describe how synthetic photometry can be obtained from XP spectra, illustrating the performance that can be achieved under a range of different conditions - for example passband width and wavelength range - as well as the limits and the problems affecting it. Existing top-quality photometry can be reproduced within a few per cent over a wide range of magnitudes and colour, for wide and medium bands, and with up to millimag accuracy when synthetic photometry is standardised with respect to these external sources. Some examples of potential scientific application are presented, including the detection of multiple populations in globular clusters, the estimation of metallicity extended to the very metal-poor regime, and the classification of white dwarfs. A catalogue providing standardised photometry for ~220 million sources in several wide bands of widely used photometric systems is provided (Gaia Synthetic Photometry Catalogue; GSPC) as well as a catalogue of $\simeq 10^5$ white dwarfs with DA/non-DA classification obtained with a Random Forest algorithm (Gaia Synthetic Photometry Catalogue for White Dwarfs; GSPC-WD).


title: ${\rm f}_{0}(980)$ production in inelastic pp collisions at $\sqrt{s} = 5.02$ TeV

abstract: The measurement of the production of ${\rm f}_{0}(980)$ in inelastic pp collisions at $\sqrt{s} = 5.02$ TeV is presented. This is the first reported measurement of inclusive ${\rm f}_{0}(980)$ yield at LHC energies. The production is measured at midrapidity, $|y| < 0.5$, in a wide transverse momentum range, $0 < p_{\rm T} < 16$ GeV/$c$, by reconstructing the resonance in the ${\rm f}_{0}(980) \rightarrow \pi^{+}\pi^{-}$ hadronic decay channel using the ALICE detector. The $p_{\rm T}$-differential yields are compared to those of pions, protons and $\phi$ mesons as well as to predictions from the HERWIG 7.2 QCD-inspired Monte Carlo event generator and calculations from a coalescence model that uses the AMPT model as an input. The ratio of the $p_{\rm T}$-integrated yield of ${\rm f}_{0}(980)$ relative to pions is compared to measurements in ${\rm e}^{+}{\rm e}^{-}$ and pp collisions at lower energies and predictions from statistical hadronisation models and HERWIG 7.2. A mild collision energy dependence of the ${\rm f}_{0}(980)$ to pion production is observed in pp collisions from SPS to LHC energies. All considered models underpredict the $p_{\rm T}$-integrated $2{\rm f}_{0}(980)/(\pi^{+}+\pi^{-})$ ratio. The prediction from the canonical statistical hadronisation model assuming a zero total strangeness content of ${\rm f}_{0}(980)$ is consistent with the data within 1.9$\sigma$ and is the closest to the data. The results provide an essential reference for future measurements of the particle yield and nuclear modification in p$-$Pb and Pb$-$Pb collisions, which have been proposed to be instrumental to probe the elusive nature and quark composition of the ${\rm f}_{0}(980)$ scalar meson.


title: Towards an Approximation-Aware Computational Workflow Framework for Accelerating Large-Scale Discovery Tasks

abstract: The use of approximation is fundamental in computational science. Almost all computational methods adopt approximations in some form in order to obtain a favourable cost/accuracy trade-off and there are usually many approximations that could be used. As a result, when a researcher wishes to measure a property of a system with a computational technique, they are faced with an array of options. Current computational workflow frameworks focus on helping researchers automate a sequence of steps on a particular platform. The aim is often to obtain a computational measurement of a property. However these frameworks are unaware that there may be a large number of ways to do so. As such, they cannot support researchers in making these choices during development or at execution-time. We argue that computational workflow frameworks should be designed to be \textit{approximation-aware} - that is, support the fact that a given workflow description represents a task that \textit{could} be performed in different ways. This is key to unlocking the potential of computational workflows to accelerate discovery tasks, particularly those involving searches of large entity spaces. It will enable efficiently obtaining measurements of entity properties, given a set of constraints, by directly leveraging the space of choices available. In this paper we describe the basic functions that an approximation-aware workflow framework should provide, how those functions can be realized in practice, and illustrate some of the powerful capabilities it would enable, including approximate memoization, surrogate model support, and automated workflow composition.


title: A proof of Frankl-Kupavskii's conjecture on edge-union condition

abstract: A 3-graph $\mathcal{F}$ is \emph{$U(s, 2s+1)$} if for any $s$ edges $e_1,...,e_s\in E(\mathcal{F})$, $|e_1\cup...\cup e_s|\leq 2s+1$. Frankl and Kupavskii (2020) proposed the following conjecture: For any $3$-graph $\mathcal{F}$ with $n$ vertices, if $\mathcal{F}$ is $U(s, 2s+1)$, then $$e(\mathcal{F})\leq \max\left\{{n-1\choose 2}, (n-s-1){s+1\choose 2}+{s+1\choose 3}, {2s+1\choose 3}\right\}.$$ In this paper, we confirm Frankl and Kupavskii's conjecture.


title: Making Sense of Dependence: Efficient Black-box Explanations Using Dependence Measure

abstract: This paper presents a new efficient black-box attribution method based on Hilbert-Schmidt Independence Criterion (HSIC), a dependence measure based on Reproducing Kernel Hilbert Spaces (RKHS). HSIC measures the dependence between regions of an input image and the output of a model based on kernel embeddings of distributions. It thus provides explanations enriched by RKHS representation capabilities. HSIC can be estimated very efficiently, significantly reducing the computational cost compared to other black-box attribution methods. Our experiments show that HSIC is up to 8 times faster than the previous best black-box attribution methods while being as faithful. Indeed, we improve or match the state-of-the-art of both black-box and white-box attribution methods for several fidelity metrics on Imagenet with various recent model architectures. Importantly, we show that these advances can be transposed to efficiently and faithfully explain object detection models such as YOLOv4. Finally, we extend the traditional attribution methods by proposing a new kernel enabling an ANOVA-like orthogonal decomposition of importance scores based on HSIC, allowing us to evaluate not only the importance of each image patch but also the importance of their pairwise interactions. Our implementation is available at https://github.com/paulnovello/HSIC-Attribution-Method.


title: ZFC without power set II: Reflection strikes back

abstract: The theory ZFC implies the scheme that for every cardinal $\delta$ we can make $\delta$ many dependent choices over any definable relation without terminal nodes. Friedman, the first author, and Kanovei constructed a model of ZFC$^-$ (ZFC without power set) with largest cardinal $\omega$ in which this principle fails for $\omega$ many choices. In this article we study failures of dependent choice principles over ZFC$^-$ by considering the notion of big proper classes. A proper class is said to be big if it surjects onto every non-zero ordinal. We shall see that if one assumes the scheme of dependent choices of any arbitrary set length then every proper class is indeed big. However, by building on work of Zarach, we provide a general framework for separating dependent choice schemes of various lengths by producing models of ZFC$^-$ with proper classes that are not big. Using a similar idea, we then extend the earlier result by producing a model of ZFC$^-$ in which there are unboundedly many cardinals but the scheme of dependent choices of length $\omega$ still fails. Finally, the second author has proven that a model of ZFC$^-$ cannot have a non-trivial, cofinal, elementary self-embedding for which the von-Neumann hierarchy exists up to its critical point. We answer a related question posed by the second author by showing that the existence of such an embedding need not imply the existence of any non-trivial fragment of the von-Neumann hierarchy. In particular, that in such a situation $\mathcal{P}(\omega)$ can be a proper class.


title: A Unified Approach for Dynamic Analysis of Tensegrity Structures with Arbitrary Rigid Bodies and Rigid Bars

abstract: This paper proposes a unified approach for dynamic modeling and simulations of general tensegrity structures with rigid bars and rigid bodies of arbitrary shapes. The natural coordinates are adopted as a non-minimal description in terms of different combinations of basic points and base vectors to resolve the heterogeneity between rigid bodies and rigid bars in three-dimensional space. This leads to a set of differential-algebraic equations with a constant mass matrix and free from trigonometric functions. Formulations for linearized dynamics are derived to enable modal analysis around static equilibrium. For numerical analysis of nonlinear dynamics, we derive a modified symplectic integration scheme which yields realistic results for long-time simulations, and accommodates non-conservative forces as well as boundary conditions. Numerical examples demonstrate the efficacy of the proposed approach for dynamic simulations of Class-1-to-$k$ general tensegrity structures under complex situations, including dynamic external loads, cable-based deployments, and moving boundaries. The novel tensegrity structures also exemplify new ways to create multi-functional structures.


title: Elucidating dislocation core structures in titanium nitride through high-resolution imaging and atomistic simulations

abstract: Although titanium nitride (TiN) is among the most extensively studied and thoroughly characterized thin-film ceramic materials, detailed knowledge of relevant dislocation core structures is lacking. By high-resolution scanning transmission electron microscopy (STEM) of epitaxial single crystal (001)-oriented TiN films, we identify different dislocation types and their core structures. These include, besides the expected primary full a/2{110}<1$\bar{1}$0> dislocation, Shockley partial dislocations a/6{111}<11$\bar{2}$> and sessile Lomer edge dislocations a/2{100}<011>. Density-functional theory and classical interatomic potential simulations complement STEM observations by recovering the atomic structure of the different dislocation types, estimating Peierls stresses, and providing insights on the chemical bonding nature at the core. The generated models of the dislocation cores suggest locally enhanced metal-metal bonding, weakened Ti-N bonds, and N vacancy-pinning that effectively reduces the mobilities of {110}<1$\bar{1}$0> and {111}<11$\bar{2}$> dislocations. Our findings underscore that the presence of different dislocation types and their effects on chemical bonding should be considered in the design and interpretations of nanoscale and macroscopic properties of TiN.


title: Pursuing More Effective Graph Spectral Sparsifiers via Approximate Trace Reduction

abstract: Spectral graph sparsification aims to find ultra-sparse subgraphs which can preserve spectral properties of original graphs. In this paper, a new spectral criticality metric based on trace reduction is first introduced for identifying spectrally important off-subgraph edges. Then, a physics-inspired truncation strategy and an approach using approximate inverse of Cholesky factor are proposed to compute the approximate trace reduction efficiently. Combining them with the iterative densification scheme in \cite{feng2019grass} and the strategy of excluding spectrally similar off-subgraph edges in \cite{fegrass}, we develop a highly effective graph sparsification algorithm. The proposed method has been validated with various kinds of graphs. Experimental results show that it always produces sparsifiers with remarkably better quality than the state-of-the-art GRASS \cite{feng2019grass} in same computational cost, enabling more than 40% time reduction for preconditioned iterative equation solver on average. In the applications of power grid transient analysis and spectral graph partitioning, the derived iterative solver shows 3.3X or more advantages on runtime and memory cost, over the approach based on direct sparse solver.


title: Reactive control of 2 nd Mack mode in a supersonic boundary layer with freestream velocity/density variations

abstract: We consider closed-loop control of a two-dimensional supersonic boundary layer at M = 4.5 that aims at reducing the linear growth of second Mack mode instabilities. These instabilities are first characterized with local spatial and global resolvent analyses, which allow to refine the control strategy and to select appropriate actuators and sensors. After linear input-output reduced order models have been identified, multi-criteria structured mixed $H_{2}/H_{\infty}$ synthesis allows to fix beforehand the controller structure and to minimize appropriate norms of various transfer functions: the $H_{2}$ norm to guarantee performance (reduction of perturbation amplification in nominal condition) and the $H_{\infty}$ norm to maintain performance robustness (with respect to sensor noise) and stability robustness (with respect to uncertain free-stream velocity/density variations). Both feedforward and feedback setups, i.e. with estimation sensor placed respectively upstream/downstream of the actuator, allow to maintain the local perturbation energy below a given threshold over a significant distance downstream of the actuator, even in the case of noisy estimation sensors or free-stream density variations. However, the feedforward setup becomes completely ineffective when convective time-delays are altered by free-stream velocity variations of $\pm 5\%$, which highlights the strong relevance of the feedback setup for performance robustness in convectively unstable flows.


title: Human lumbar spine injury risk in dynamic combined compression and flexion loading

abstract: Anticipating changes to vehicle interiors with future automated driving systems, the automobile industry recently has focused attention on crash response in relaxed postures with increased seatback recline. Prior research found that this posture may result in greater risk of lumbar spine injury in the event of a frontal crash. This study developed a lumbar spine injury risk function that estimated injury risk as a function of simultaneously applied compression force and flexion moment. Force and moment failure data from 40 compression-flexion tests were utilized in a Weibull survival model, including appropriate data censoring. A mechanics-based injury metric was formulated, where lumbar spine compression force and flexion moment were normalized to specimen geometry. Subject age was incorporated as a covariate to further improve model fit. A weighting factor was included to adjust the influence of force and moment, and parameter optimization yielded a value of 0.11. Thus, the normalized compression force component had a greater effect on injury risk than the normalized flexion moment component. Additionally, as force was nominally increased, less moment was required to produce injury for a given age and specimen geometry. The resulting injury risk function can be utilized to improve occupant safety in the field.


title: Parallel Domain Decomposition method for the fully-mixed Stokes-dual-permeability fluid flow model with Beavers-Joseph interface conditions

abstract: In this paper, a parallel domain decomposition method is proposed for solving the fully-mixed Stokes-dual-permeability fluid flow model with Beavers-Joseph (BJ) interface conditions. Three Robin-type boundary conditions and a modified weak formulation are constructed to completely decouple the original problem, not only for the free flow and dual-permeability regions but also for the matrix and microfractures in the dual-porosity media. We derive the equivalence between the original problem and the decoupled systems with some suitable compatibility conditions, and also demonstrate the equivalence of two weak formulations in different Sobolev spaces. Based on the completely decoupled modified weak formulation, the convergence of the iterative parallel algorithm is proved rigorously. To carry out the convergence analysis of our proposed algorithm, we propose an important but general convergence lemma for the steady-state problems. Furthermore, with some suitable choice of parameters, the new algorithm is proved to achieve the geometric convergence rate. Finally, several numerical experiments are presented to illustrate and validate the performance and exclusive features of our proposed algorithm.


title: Convergence for score-based generative modeling with polynomial complexity

abstract: Score-based generative modeling (SGM) is a highly successful approach for learning a probability distribution from data and generating further samples. We prove the first polynomial convergence guarantees for the core mechanic behind SGM: drawing samples from a probability density $p$ given a score estimate (an estimate of $\nabla \ln p$) that is accurate in $L^2(p)$. Compared to previous works, we do not incur error that grows exponentially in time or that suffers from a curse of dimensionality. Our guarantee works for any smooth distribution and depends polynomially on its log-Sobolev constant. Using our guarantee, we give a theoretical analysis of score-based generative modeling, which transforms white-noise input into samples from a learned data distribution given score estimates at different noise scales. Our analysis gives theoretical grounding to the observation that an annealed procedure is required in practice to generate good samples, as our proof depends essentially on using annealing to obtain a warm start at each step. Moreover, we show that a predictor-corrector algorithm gives better convergence than using either portion alone.


title: New Identifications and Multi-wavelength Properties of Extragalactic Fermi Gamma-Ray Sources in the SPT-SZ Survey Field

abstract: The fourth Fermi Large Area Telescope (LAT) catalog (4FGL) contains 5064 $\gamma$-ray sources detected at high significance, but 26% of them still lack associations at other wavelengths. The SPT-SZ survey, conducted between 2008 and 2011 with the South Pole Telescope (SPT), covers 2500 $\mathrm{deg^2}$ of the Southern sky in three millimeter-wavelength (mm) bands and was used to construct a catalog of nearly 5000 emissive sources. In this study, we introduce a new cross-matching scheme to search for multi-wavelength counterparts of extragalactic $\gamma$-ray sources using a mm catalog. We apply a Poissonian probability to evaluate the rate of spurious false associations and compare the multi-wavelength associations from the radio, mm, near-infrared, and X-ray with 4FGL $\gamma$-ray sources. In the SPT-SZ survey field, 85% of 4FGL sources are associated with mm counterparts. These mm sources include 94% of previously associated 4FGL sources and 56% of previously unassociated 4FGL sources. The latter group contains 40 4FGL sources for which SPT has provided the first identified counterparts. Nearly all of the SPT-associated 4FGL sources can be described as flat-spectrum radio quasars or blazars. We find that the mm band is the most efficient wavelength for detecting $\gamma$-ray blazars when considering both completeness and purity. We also demonstrate that the mm band correlates better to the $\gamma$-ray band than the radio or X-ray bands. With the next generation of CMB experiments, this technique can be extended to greater sensitivities and more sky area to further complete the identifications of the remaining unknown $\gamma$-ray blazars.


title: Transition-based Abstract Meaning Representation Parsing with Contextual Embeddings

abstract: The ability to understand and generate languages sets human cognition apart from other known life forms'. We study a way of combing two of the most successful routes to meaning of language--statistical language models and symbolic semantics formalisms--in the task of semantic parsing. Building on a transition-based, Abstract Meaning Representation (AMR) parser, AmrEager, we explore the utility of incorporating pretrained context-aware word embeddings--such as BERT and RoBERTa--in the problem of AMR parsing, contributing a new parser we dub as AmrBerger. Experiments find these rich lexical features alone are not particularly helpful in improving the parser's overall performance as measured by the SMATCH score when compared to the non-contextual counterpart, while additional concept information empowers the system to outperform the baselines. Through lesion study, we found the use of contextual embeddings helps to make the system more robust against the removal of explicit syntactical features. These findings expose the strength and weakness of the contextual embeddings and the language models in the current form, and motivate deeper understanding thereof.


title: Symmetric projected entangled-pair states analysis of a phase transition in coupled spin-1/2 ladders

abstract: Infinite projected entangled-pair states (iPEPS) have been introduced to accurately describe many-body wave functions on two-dimensional lattices. In this context, two aspects are crucial: the systematic improvement of the {\it Ansatz} by the optimization of its building blocks, i.e., tensors characterized by bond dimension $D$, and the extrapolation scheme to reach the "thermodynamic" limit $D \to \infty$. Recent advances in variational optimization and scaling based on correlation lengths demonstrated the ability of iPEPS to capture the spontaneous breaking of a continuous symmetry in phases such as the antiferromagnetic (N\'eel) phase with high fidelity, in addition to valence-bond solids which are already well described by finite-$D$ iPEPS. In contrast, systems in the vicinity of continuous quantum phase transitions still present a challenge for iPEPS, especially when non-abelian symmetries are involved. Here, we consider the iPEPS Ansatz to describe the continuous transition between the (gapless) antiferromagnet and the (gapped) paramagnet that exists in the $S=1/2$ Heisenberg model on coupled two-leg ladders. In particular, we show how accurate iPEPS results can be obtained down to a narrow interval around criticality and analyze the scaling of the order parameter in the N\'eel phase in a spatially anisotropic situation.


title: Charge and spin correlations in insulating and incoherent metal states of twisted bilayer graphene

abstract: We study electronic, charge, and magnetic properties of twisted bilayer graphene with fillings $2\leq n\leq 6$ per moire unit cell within the recently introduced formulation of extended dynamical mean-field theory (E-DMFT) for two-sublattice systems. We use previously obtained hopping parameters between the states, described by Wannier functions, centered at the lattice spots of AB and BA stacking, and the long-range Coulomb interaction, obtained within cRPA analysis. We show that account of spin exchange between AB and BA nearest neighbour spots is crucial to introduce charge and spin correlations between these spots. Account of this exchange yields preferable concentration of electrons in the same valley, with the tendency of parallel spin alignment of electrons in AB and BA spots, in agreement with earlier results of the strong coupling analysis, suggested SU(2)$\times$SU(2) emergent spin-valley symmetry. The local spectral functions show almost gapped state at the fillings $n=2,4,6$, and incoherent metal state for the other fillings. We find that in both cases the local states of electrons have rather long lifetime. At the same time, the non-local charge- and spin susceptibilities, obtained within the ladder approximation, are peaked at incommensurate wave vectors, which implies that the above discussed ordering tendencies are characterised by an incommensurate pattern.


title: Towards Understanding Sharpness-Aware Minimization

abstract: Sharpness-Aware Minimization (SAM) is a recent training method that relies on worst-case weight perturbations which significantly improves generalization in various settings. We argue that the existing justifications for the success of SAM which are based on a PAC-Bayes generalization bound and the idea of convergence to flat minima are incomplete. Moreover, there are no explanations for the success of using $m$-sharpness in SAM which has been shown as essential for generalization. To better understand this aspect of SAM, we theoretically analyze its implicit bias for diagonal linear networks. We prove that SAM always chooses a solution that enjoys better generalization properties than standard gradient descent for a certain class of problems, and this effect is amplified by using $m$-sharpness. We further study the properties of the implicit bias on non-linear networks empirically, where we show that fine-tuning a standard model with SAM can lead to significant generalization improvements. Finally, we provide convergence results of SAM for non-convex objectives when used with stochastic gradients. We illustrate these results empirically for deep networks and discuss their relation to the generalization behavior of SAM. The code of our experiments is available at https://github.com/tml-epfl/understanding-sam.


title: QED approach to valence-hole excitation in closed shell systems

abstract: An ab initio QED approach to treat a valence-hole excitation in closed shell systems is developed in the framework of the two-time-Green function method. The derivation considers a redefinition of the vacuum state and its excitation as a valence-hole pair. The proper two-time Green function, whose spectral representation confirms the poles at valence-hole excitation energies is proposed. An contour integral formula which connects the energy corrections and the Green function is also presented. First-order corrections to the valence-hole excitation energy involving self-energy, vacuum polarization, and one-photon-exchange terms are explicitly derived in the redefined vacuum picture. Reduction to the usual vacuum electron propagators is given that agrees in the Breit approximation with the many-body perturbation theory expressions for the valence-hole excitation energy.


title: Evaluating Graph Generative Models with Contrastively Learned Features

abstract: A wide range of models have been proposed for Graph Generative Models, necessitating effective methods to evaluate their quality. So far, most techniques use either traditional metrics based on subgraph counting, or the representations of randomly initialized Graph Neural Networks (GNNs). We propose using representations from contrastively trained GNNs, rather than random GNNs, and show this gives more reliable evaluation metrics. Neither traditional approaches nor GNN-based approaches dominate the other, however: we give examples of graphs that each approach is unable to distinguish. We demonstrate that Graph Substructure Networks (GSNs), which in a way combine both approaches, are better at distinguishing the distances between graph datasets.


title: Prostate Cancer Malignancy Detection and localization from mpMRI using auto-Deep Learning: One Step Closer to Clinical Utilization

abstract: Automatic diagnosis of malignant prostate cancer patients from mpMRI has been studied heavily in the past years. Model interpretation and domain drift have been the main road blocks for clinical utilization. As an extension from our previous work where we trained a customized convolutional neural network on a public cohort with 201 patients and the cropped 2D patches around the region of interest were used as the input, the cropped 2.5D slices of the prostate glands were used as the input, and the optimal model were searched in the model space using autoKeras. Something different was peripheral zone (PZ) and central gland (CG) were trained and tested separately, the PZ detector and CG detector were demonstrated effectively in highlighting the most suspicious slices out of a sequence, hopefully to greatly ease the workload for the physicians.


title: Study of atmospheres in the solar system, from stellar occultation or planetary transit

abstract: Stellar occultations and transits occur when a planetary body passes in front of a star (including our Sun). For objects with an atmosphere, refraction plays an essential role to explain the drops of flux and the aureoles observed during these events. This can be used to derived key parameters of the atmospheres, such as their density, pressure and temperature profiles, as well as the presence of atmospheric gravity waves and zonal winds. Here we derive from basic principles the equations that rule the ray propagation in planetary atmospheres, and we show how they can be used to derive the physical parameters of these atmospheres.


title: A Versatile Pseudo-Rigid Body Modeling Method

abstract: A novel semi-analytical method is proposed to develop the pseudo-rigid-body~(PRB) model of robots made of highly flexible members (HFM), such as flexures and continuum robots, with no limit on the degrees of freedom of the PRB model. The proposed method has a simple formulation yet high precision. Furthermore, it can describe HFMs with variable curvature and stiffness along their length. The method offers a semi-analytical solution for the highly coupled nonlinear constrained optimization problem of PRB modeling and can be extended to variable-length robots comprised of HFM, such as catheter and concentric tube robots. We also show that this method can obtain a PRB model of uniformly stiff HFMs, with only three parameters. The versatility of the method is investigated in various applications of HFM in continuum robots. Simulations demonstrate substantial improvement in the precision of the PRB model in general and a reduction in the complexity of the formulation.


title: Indian Legal Text Summarization: A Text Normalisation-based Approach

abstract: In the Indian court system, pending cases have long been a problem. There are more than 4 crore cases outstanding. Manually summarising hundreds of documents is a time-consuming and tedious task for legal stakeholders. Many state-of-the-art models for text summarization have emerged as machine learning has progressed. Domain-independent models don't do well with legal texts, and fine-tuning those models for the Indian Legal System is problematic due to a lack of publicly available datasets. To improve the performance of domain-independent models, the authors have proposed a methodology for normalising legal texts in the Indian context. The authors experimented with two state-of-the-art domain-independent models for legal text summarization, namely BART and PEGASUS. BART and PEGASUS are put through their paces in terms of extractive and abstractive summarization to understand the effectiveness of the text normalisation approach. Summarised texts are evaluated by domain experts on multiple parameters and using ROUGE metrics. It shows the proposed text normalisation approach is effective in legal texts with domain-independent models.


title: On the bulk block expansion for a monodromy defect

abstract: For a free--field flat monodromy defect, a formula for the finite part of the correlator is obtained as a double power series in $(1-x)$ and $(1-\ol x)$ where $x$ and $\ol x$ are lightcone coordinates. It takes the particular form of a series in $(1-x)$ with coefficients finite sums of hypergeometric functions of $1-\ol x$ and is identified with a bulk block expansion. A simple expression for the coefficient of the $(1-x)^n(1-\ol x)^m$ term is thereby found as an explicit function of the flux and dimension. Some typical examples are presented.A transformation allows the bulk block expansion to be written as an Appell $F_3$ function which has simplifying consequences.


title: Vanadium in Silicon Carbide: Telecom-ready spin centres with long relaxation lifetimes and hyperfine-resolved optical transitions

abstract: Vanadium in silicon carbide (SiC) is emerging as an important candidate system for quantum technology due to its optical transitions in the telecom wavelength range. However, several key characteristics of this defect family including their spin relaxation lifetime (T1), charge state dynamics, and level structure are not fully understood. In this work, we determine the T1 of an ensemble of vanadium defects, demonstrating that it can be greatly enhanced at low temperature. We observe a large spin contrast exceeding 90% and long spin-relaxation times of up to 25s at 100mK, and of order 1s at 1.3K. These measurements are complemented by a characterization of the ensemble charge state dynamics. The stable electron spin furthermore enables high-resolution characterization of the systems' hyperfine level structure via two-photon magneto-spectroscopy. The acquired insights point towards high-performance spin-photon interfaces based on vanadium in SiC.


title: Optimal routing algorithm for trips involving thousands of ev-charging stations using Kinetica-Graph

abstract: This paper discusses a graph based route solving algorithm to find the optimal path for an electric vehicle picking the best charging locations among thousands to minimize the total cumulative driving distance between the end points of the trip. To this end, we have devised a combinatorial optimization algorithm and a fixed storage graph topology construction for the graph road network of the continental USA. We have also re-purposed our existing Dijkstra solver to reduce the computational cost of many shortest path solves involved in the algorithm. An adaptive and light weight spatial search structure is also devised for finding a set of prospective stations at each charging location using uniform bins and double link associations. The entire algorithm is implemented as yet another multi-threaded at-scale graph solver within the suite of Kinetica-Graph analytics, exposed as a restful API endpoint and operable within SQL. Several example trips are solved and the results are demonstrated within the context.


title: Inverse problems for Jacobi operators with finitely supported perturbations

abstract: We solve the inverse problem for Jacobi operators on the half lattice with finitely supported perturbations, in particular, in terms of resonances. Our proof is based on the results for the inverse eigenvalue problem for specific finite Jacobi matrices and theory of polynomials. We determine forbidden domains for resonances and maximal possible multiplicities of real and complex resonances.


title: Contrastive Learning for Unsupervised Domain Adaptation of Time Series

abstract: Unsupervised domain adaptation (UDA) aims at learning a machine learning model using a labeled source domain that performs well on a similar yet different, unlabeled target domain. UDA is important in many applications such as medicine, where it is used to adapt risk scores across different patient cohorts. In this paper, we develop a novel framework for UDA of time series data, called CLUDA. Specifically, we propose a contrastive learning framework to learn contextual representations in multivariate time series, so that these preserve label information for the prediction task. In our framework, we further capture the variation in the contextual representations between source and target domain via a custom nearest-neighbor contrastive learning. To the best of our knowledge, ours is the first framework to learn domain-invariant, contextual representation for UDA of time series data. We evaluate our framework using a wide range of time series datasets to demonstrate its effectiveness and show that it achieves state-of-the-art performance for time series UDA.


title: Benefits and Limitations of Simplified Transient Gas Flow Formulations

abstract: Although intensively studied in recent years, the optimization of the transient (time-dependent) control of large real-world gas networks is still out of reach for current state-of-the-art approaches. For this reason, we present further simplifications of the commonly used model, which lead to a linear description of the gas flow on pipelines. In an empirical analysis of real-world data, we investigate the properties of the involved quantities and evaluate the errors made by our simplification.


title: Upper bounds on key rates in device-independent quantum key distribution based on convex-combination attacks

abstract: The device-independent framework constitutes the most pragmatic approach to quantum protocols that does not put any trust in their implementations. It requires all claims, about e.g. security, to be made at the level of the final classical data in hands of the end-users. This imposes a great challenge for determining attainable key rates in device-independent quantum key distribution (DIQKD), but also opens the door for consideration of eavesdropping attacks that stem from the possibility of a given data being just generated by a malicious third-party. In this work, we explore this path and present the convex-combination attack as an efficient, easy-to-use technique for upper-bounding DIQKD key rates. It allows verifying the accuracy of lower bounds on key rates for state-of-the-art protocols, whether involving one-way or two-way communication. In particular, we demonstrate with its help that the currently predicted constraints on the robustness of DIQKD protocols to experimental imperfections, such as the finite visibility or detection efficiency, are already very close to the ultimate tolerable thresholds.


title: A Modular Continuum Manipulator for Aerial Manipulation and Perching

abstract: Most aerial manipulators use serial rigid-link designs, which results in large forces when initiating contacts during manipulation and could cause flight stability difficulty. This limitation could potentially be improved by the compliance of continuum manipulators. To achieve this goal, we present the novel design of a compact, lightweight, and modular cable-driven continuum manipulator for aerial drones. We then derive a complete modeling framework for its kinematics, statics, and stiffness (compliance). The framework is essential for integrating the manipulator to aerial drones. Finally, we report preliminary experimental validations of the hardware prototype, providing insights on its manipulation feasibility. Future work includes the integration and test of the proposed continuum manipulator with aerial drones.


title: Leveraging Structured Pruning of Convolutional Neural Networks

abstract: Structured pruning is a popular method to reduce the cost of convolutional neural networks, that are the state of the art in many computer vision tasks. However, depending on the architecture, pruning introduces dimensional discrepancies which prevent the actual reduction of pruned networks. To tackle this problem, we propose a method that is able to take any structured pruning mask and generate a network that does not encounter any of these problems and can be leveraged efficiently. We provide an accurate description of our solution and show results of gains, in energy consumption and inference time on embedded hardware, of pruned convolutional neural networks.


title: An efficient material search for room temperature topological magnons

abstract: Topologically protected magnon surface states are highly desirable as an ideal platform to engineer low-dissipation spintronics devices. However, theoretical prediction of topological magnons in strongly correlated materials proves to be challenging because the ab initio density functional theory calculations fail to reliably predict magnetic interactions in correlated materials. Here, we present a symmetry-based approach, which predicts topological magnons in magnetically ordered crystals, upon applying external perturbations such as magnetic/electric fields and/or mechanical strains. We apply this approach to carry out an efficient search for magnetic materials in the Bilbao Crystallographic Server, where, among 198 compounds with an over 300-K transition temperature, we identify 12 magnetic insulators that support room-temperature topological magnons. They feature Weyl magnons with surface magnon arcs and magnon axion insulators with either chiral surface or hinge magnon modes, offering a route to realize energy-efficient devices based on protected surface magnons.


title: High-pressure inelastic neutron scattering study of the anisotropic $S=1$ spin chain [Ni(HF$_2$)(3-Clpyradine)$_4$]BF$_4$

abstract: [Ni(HF$_2$)(3-Clpyradine)$_4$]BF$_4$ (NBCT) is a one-dimensional (1-D), $S=1$ spin chain material that shows no long-range magnetic order down to thermometer temperatures of 0.1 K. Previous ambient pressure inelastic neutron scattering experiments identified NBCT to be in the large-$D$ quantum paramagnetic phase of the $D/J$ phase diagram, where $D$ is the axial single-ion anisotropy and $J$ is the intrachain superexchange. Here, we extend the previous experiments to be at a hydrostatic pressure of 0.9 GPa. By comparing to density matrix renormalization group calculations, we find $D/J$ increases from 1.5 to 3.2 as pressure increases from 0 GPa to 0.9 GPa, which pushes the system further into the large-$D$ phase.


title: Van Der Waals Heteroepitaxy of GaSe and InSe, Quantum Wells and Superlattices

abstract: Bandgap engineering and quantum confinement in semiconductor heterostructures provide the means to fine-tune material response to electromagnetic fields and light in a wide range of the spectrum. Nonetheless, forming semiconductor heterostructures on lattice-mismatched substrates has been a challenge for several decades, leading to restrictions for device integration and the lack of efficient devices in important wavelength bands. Here, we show that the van der Waals epitaxy of two-dimensional (2D) GaSe and InSe heterostructures occur on substrates with substantially different lattice parameters, namely silicon and sapphire. The GaSe/InSe heterostructures were applied in the growth of quantum wells and superlattices presenting photoluminescence and absorption related to interband transitions. Moreover, we demonstrate a self-powered photodetector based on this heterostructure on Si that works in the visible-NIR wavelength range. Fabricated at wafer-scale, these results pave the way for an easy integration of optoelectronics based on these layered 2D materials in current Si technology.


title: A Methodology and Software Architecture to Support Explainability-by-Design

abstract: Algorithms play a crucial role in many technological systems that control or affect various aspects of our lives. As a result, providing explanations for their decisions to address the needs of users and organisations is increasingly expected by laws, regulations, codes of conduct, and the public. However, as laws and regulations do not prescribe how to meet such expectations, organisations are often left to devise their own approaches to explainability, inevitably increasing the cost of compliance and good governance. Hence, we envision Explainability-by-Design, a holistic methodology characterised by proactive measures to include explanation capability in the design of decision-making systems. The methodology consists of three phases: (A) Explanation Requirement Analysis, (B) Explanation Technical Design, and (C) Explanation Validation. This paper describes phase (B), a technical workflow to implement explanation capability from requirements elicited by domain experts for a specific application context. Outputs of this phase are a set of configurations, allowing a reusable explanation service to exploit logs provided by the target application to create provenance traces of the application's decisions. The provenance then can be queried to extract relevant data points, which can be used in explanation plans to construct explanations personalised to their consumers. Following the workflow, organisations can design their decision-making systems to produce explanations that meet the specified requirements. To facilitate the process, we present a software architecture with reusable components to incorporate the resulting explanation capability into an application. Finally, we applied the workflow to two application scenarios and measured the associated development costs. It was shown that the approach is tractable in terms of development time, which can be as low as two hours per sentence.


title: Transformer Lesion Tracker

abstract: Evaluating lesion progression and treatment response via longitudinal lesion tracking plays a critical role in clinical practice. Automated approaches for this task are motivated by prohibitive labor costs and time consumption when lesion matching is done manually. Previous methods typically lack the integration of local and global information. In this work, we propose a transformer-based approach, termed Transformer Lesion Tracker (TLT). Specifically, we design a Cross Attention-based Transformer (CAT) to capture and combine both global and local information to enhance feature extraction. We also develop a Registration-based Anatomical Attention Module (RAAM) to introduce anatomical information to CAT so that it can focus on useful feature knowledge. A Sparse Selection Strategy (SSS) is presented for selecting features and reducing memory footprint in Transformer training. In addition, we use a global regression to further improve model performance. We conduct experiments on a public dataset to show the superiority of our method and find that our model performance has improved the average Euclidean center error by at least 14.3% (6mm vs. 7mm) compared with the state-of-the-art (SOTA). Code is available at https://github.com/TangWen920812/TLT.