title: Adaptive Stochastic Gradient Descent for Fast and Communication-Efficient Distributed Learning

abstract: We consider the setting where a master wants to run a distributed stochastic gradient descent (SGD) algorithm on $n$ workers, each having a subset of the data. Distributed SGD may suffer from the effect of stragglers, i.e., slow or unresponsive workers who cause delays. One solution studied in the literature is to wait at each iteration for the responses of the fastest $k<n$ workers before updating the model, where $k$ is a fixed parameter. The choice of the value of $k$ presents a trade-off between the runtime (i.e., convergence rate) of SGD and the error of the model. Towards optimizing the error-runtime trade-off, we investigate distributed SGD with adaptive~$k$, i.e., varying $k$ throughout the runtime of the algorithm. We first design an adaptive policy for varying $k$ that optimizes this trade-off based on an upper bound on the error as a function of the wall-clock time that we derive. Then, we propose and implement an algorithm for adaptive distributed SGD that is based on a statistical heuristic. Our results show that the adaptive version of distributed SGD can reach lower error values in less time compared to non-adaptive implementations. Moreover, the results also show that the adaptive version is communication-efficient, where the amount of communication required between the master and the workers is less than that of non-adaptive versions.


title: Modeling Price Elasticity for Occupancy Prediction in Hotel Dynamic Pricing

abstract: Demand estimation plays an important role in dynamic pricing where the optimal price can be obtained via maximizing the revenue based on the demand curve. In online hotel booking platform, the demand or occupancy of rooms varies across room-types and changes over time, and thus it is challenging to get an accurate occupancy estimate. In this paper, we propose a novel hotel demand function that explicitly models the price elasticity of demand for occupancy prediction, and design a price elasticity prediction model to learn the dynamic price elasticity coefficient from a variety of affecting factors. Our model is composed of carefully designed elasticity learning modules to alleviate the endogeneity problem, and trained in a multi-task framework to tackle the data sparseness. We conduct comprehensive experiments on real-world datasets and validate the superiority of our method over the state-of-the-art baselines for both occupancy prediction and dynamic pricing.


title: A Method for Deriving Technical Requirements of Digital Twins as Industrial Product-Service System Enablers

abstract: Industrial Product-Service Systems (IPSS) are increasingly dominant in several sectors. Predominant value-adding services provided for industrial assets such as production systems, electric power plants, and car fleets are remote asset maintenance, monitoring, control, and reconfiguration. IPSS designers lack methods and tools supporting them in systematically deriving technical design requirements for the underlying Cyber-Physical System (CPS) IPSS services. At the same time, the use of Digital Twins (DTs) as digital representations of CPS as-sets is becoming increasingly feasible thanks to powerful, networked information technology (IT) and operation technology (OT) infrastructures and the ubiquity of sensors and data. This paper proposes a method for guiding IPSS designers in the specification and implementation of DT instances to serve as the key enablers of IPSS services. The systematic mapping of the continuous IT design-build-deployment cycle concept to the OT domain of CPS is at the heart of the applied methodology, which is complemented by a stakeholder-driven requirements elicitation. The key contribution is a structured method for deriving technical design requirements for DT instances as IPSS. This method is validated on real-world use cases in an evaluation environment for distributed CPS IPSS.


title: Microwave QR Code: An IRS-Based Solution

abstract: This letter proposes to employ intelligent reflecting surface (IRS) as an information media to display a microwave quick response (QR) code for Internet-of-Things applications. To be specific, an IRS is used to form a dynamic bitmap image thanks to its tunable elements. With a QR code shown on the IRS, the transmitting and receiving antenna arrays are jointly designed to scan it by radiating electromagnetic wave as well as receiving and detecting the reflected signal. Based on such an idea, an IRS enabled information and communication system is modelled. Accordingly, some fundamental systematic operating mechanisms are investigated, involving derivation of average bit error probability for signal modulation, QR code implementation on an IRS, transmission design, detection, etc. The simulations are performed to show the achievable communication performance of system and confirm the feasibility of IRS-based microwave QR code.


title: Human Saliency-Driven Patch-based Matching for Interpretable Post-mortem Iris Recognition

abstract: Forensic iris recognition, as opposed to live iris recognition, is an emerging research area that leverages the discriminative power of iris biometrics to aid human examiners in their efforts to identify deceased persons. As a machine learning-based technique in a predominantly human-controlled task, forensic recognition serves as "back-up" to human expertise in the task of post-mortem identification. As such, the machine learning model must be (a) interpretable, and (b) post-mortem-specific, to account for changes in decaying eye tissue. In this work, we propose a method that satisfies both requirements, and that approaches the creation of a post-mortem-specific feature extractor in a novel way employing human perception. We first train a deep learning-based feature detector on post-mortem iris images, using annotations of image regions highlighted by humans as salient for their decision making. In effect, the method learns interpretable features directly from humans, rather than purely data-driven features. Second, regional iris codes (again, with human-driven filtering kernels) are used to pair detected iris patches, which are translated into pairwise, patch-based comparison scores. In this way, our method presents human examiners with human-understandable visual cues in order to justify the identification decision and corresponding confidence score. When tested on a dataset of post-mortem iris images collected from 259 deceased subjects, the proposed method places among the three best iris matchers, demonstrating better results than the commercial (non-human-interpretable) VeriEye approach. We propose a unique post-mortem iris recognition method trained with human saliency to give fully-interpretable comparison outcomes for use in the context of forensic examination, achieving state-of-the-art recognition performance.


title: Machine Learning and Bioinformatics for Diagnosis Analysis of Obesity Spectrum Disorders

abstract: Globally, the number of obese patients has doubled due to sedentary lifestyles and improper dieting. The tremendous increase altered human genetics, and health. According to the world health organization, Life expectancy dropped from 80 to 75 years, as obese people struggle with different chronic diseases. This report will address the problems of obesity in children and adults using ML datasets to feature, predict, and analyze the causes of obesity. By engaging neural ML networks, we will explore neural control using diffusion tensor imaging to consider body fats, BMI, waist \& hip ratio circumference of obese patients. To predict the present and future causes of obesity with ML, we will discuss ML techniques like decision trees, SVM, RF, GBM, LASSO, BN, and ANN and use datasets implement the stated algorithms. Different theoretical literature from experts ML \& Bioinformatics experiments will be outlined in this report while making recommendations on how to advance ML for predicting obesity and other chronic diseases.


title: Direct measurement of quantum Fisher information

abstract: In the adiabatic perturbation theory, Berry curvature is related to the generalized force, and the quantum metric tensor is linked with energy fluctuation. While the former is tested with numerous numerical results and experimental realizations, the latter is less considered. Quantum Fisher information, key to quantum precision measurement, is four times quantum metric tensor. It is difficult to relate the quantum Fisher information with some physical observable. One interesting candidate is square of the symmetric logarithmic derivative, which is usually tough to obtain both theoretically and experimentally. The adiabatic perturbation theory enlightens us to measure the energy fluctuation to directly extract the quantum Fisher information. In this article, we first adopt an alternative way to derive the link of energy fluctuation to the quantum Fisher information. Then we numerically testify the direct extraction of the quantum Fisher information based on adiabatic perturbation in two-level systems and simulate the experimental realization in nitrogen-vacancy center with experimentally practical parameters. Statistical models such as transverse field Ising model and Heisenberg spin chains are also discussed to compare with the analytical result and show the level crossing respectively. Our discussion will provide a new practical scheme to measure the quantum Fisher information, and will also benefit the quantum precision measurement and the understand of the quantum Fisher information.


title: TransPillars: Coarse-to-Fine Aggregation for Multi-Frame 3D Object Detection

abstract: 3D object detection using point clouds has attracted increasing attention due to its wide applications in autonomous driving and robotics. However, most existing studies focus on single point cloud frames without harnessing the temporal information in point cloud sequences. In this paper, we design TransPillars, a novel transformer-based feature aggregation technique that exploits temporal features of consecutive point cloud frames for multi-frame 3D object detection. TransPillars aggregates spatial-temporal point cloud features from two perspectives. First, it fuses voxel-level features directly from multi-frame feature maps instead of pooled instance features to preserve instance details with contextual information that are essential to accurate object localization. Second, it introduces a hierarchical coarse-to-fine strategy to fuse multi-scale features progressively to effectively capture the motion of moving objects and guide the aggregation of fine features. Besides, a variant of deformable transformer is introduced to improve the effectiveness of cross-frame feature matching. Extensive experiments show that our proposed TransPillars achieves state-of-art performance as compared to existing multi-frame detection approaches. Code will be released.


title: BoxShrink: From Bounding Boxes to Segmentation Masks

abstract: One of the core challenges facing the medical image computing community is fast and efficient data sample labeling. Obtaining fine-grained labels for segmentation is particularly demanding since it is expensive, time-consuming, and requires sophisticated tools. On the contrary, applying bounding boxes is fast and takes significantly less time than fine-grained labeling, but does not produce detailed results. In response, we propose a novel framework for weakly-supervised tasks with the rapid and robust transformation of bounding boxes into segmentation masks without training any machine learning model, coined BoxShrink. The proposed framework comes in two variants - rapid-BoxShrink for fast label transformations, and robust-BoxShrink for more precise label transformations. An average of four percent improvement in IoU is found across several models when being trained using BoxShrink in a weakly-supervised setting, compared to using only bounding box annotations as inputs on a colonoscopy image data set. We open-sourced the code for the proposed framework and published it online.


title: Deep Learning and Health Informatics for Smart Monitoring and Diagnosis

abstract: The connection between the design and delivery of health care services using information technology is known as health informatics. It involves data usage, validation, and transfer of an integrated medical analysis using neural networks of multi-layer deep learning techniques to analyze complex data. For instance, Google incorporated ''DeepMind'' health mobile tool that integrates \& leverage medical data needed to enhance professional healthcare delivery to patients. Moorfield Eye Hospital London introduced DeepMind Research Algorithms with dozens of retinal scans attributes while DeepMind UCL handled the identification of cancerous tissues using CT \& MRI Scan tools. Atomise analyzed drugs and chemicals with Deep Learning Neural Networks to identify accurate pre-clinical prescriptions. Health informatics makes medical care intelligent, interactive, cost-effective, and accessible; especially with DL application tools for detecting the actual cause of diseases. The extensive use of neural network tools leads to the expansion of different medical disciplines which mitigates data complexity and enhances 3-4D overlap images using target point label data detectors that support data augmentation, un-semi-supervised learning, multi-modality and transfer learning architecture. Health science over the years focused on artificial intelligence tools for care delivery, chronic care management, prevention/wellness, clinical supports, and diagnosis. The outcome of their research leads to cardiac arrest diagnosis through Heart Signal Computer-Aided Diagnostic tool (CADX) and other multifunctional deep learning techniques that offer care, diagnosis \& treatment. Health informatics provides monitored outcomes of human body organs through medical images that classify interstitial lung disease, detects image nodules for reconstruction \& tumor segmentation. The emergent medical research applications gave rise to clinical-pathological human-level performing tools for handling Radiological, Ophthalmological, and Dental diagnosis. This research will evaluate methodologies, Deep learning architectures, approaches, bio-informatics, specified function requirements, monitoring tools, ANN (artificial neural network), data labeling \& annotation algorithms that control data validation, modeling, and diagnosis of different diseases using smart monitoring health informatics applications.


title: A Novel Architecture for room temperature microwave optomechanical experiments

abstract: We have developed a novel architecture for room temperature microwave cavity optomechanics, which is based on the coupling of a 3D microwave reentrant cavity to a compliant membrane. Devices parameters have enabled resolving the thermomechanical motion of the membrane, and observing optomechanically induced transparency/absorption in the linear regime, for the first time in a microwave optomechanical system operated at room temperature. We have extracted the single photon coupling rate (g0) using four independent measurement techniques, and hence obtain a full characterization of the proposed cavity optomechanical system.


title: Length-independent quantum transport through topological band states of graphene nanoribbons

abstract: Atomically precise graphene nanoribbons (GNRs) have emerged as promising candidates for nanoelectronic applications due to their widely tunable energy band gaps resulting from lateral quantum confinement and edge effects. Here we report on the electronic transport characterization of an edge-modified GNR suspended between the tip of a scanning tunneling microscope (STM) and a Au(111) substrate. Differential conductance measurements on this metal-GNR-metal junction reveal loss-less transport properties (inverse decay length $\beta < 0.001 /\overset{\circ}{\mathrm{A}}$) with high conductance ($\sim 0.1$ G$_0$) at low voltages (50 meV) over long distances ($z > 10$ nm). The transport behavior is sensitive to the coupling between ribbon and electrodes, an effect that is rationalized using tight-binding and density functional theory simulations. From extensive modelling we infer that the length-independent transport is a manifestation of band transport through topological valence states, which originate from the zigzag segments on the GNR edges.


title: Scale-friendly In-network Coordination

abstract: The programmability of modern network devices has led to innovative research in the area of in-network computing, i.e., offloading certain computations to the programmable data plane. Key-value stores, which offer coordination services for many large-scale data centres, benefited from this technological advancement. Previous research reduced the response latency of key-value requests by half through deploying the store in the programmable data plane. In this work, we identify previous design decisions that have led to increased traffic generation and latency for in-network coordination services. We have developed a new in-network key-value store platform that maintains strong consistency and fault-tolerance, while improving performance and scalability over the state-of-the-art. We have designed and implemented the platform in P4, and analysed the optimisations that unlock these performance improvements. Our evaluation shows a reduction of up to orders of magnitude in latency and significant improvements in throughput. We obtain up to nine times higher throughput for scenarios with multiple participating nodes, indicative of the superior scalability the platform can offer.


title: From microscopic droplets to macroscopic crowds: Crossing the scales in models of short-range respiratory disease transmission, with application to COVID-19

abstract: Short-range exposure to airborne virus-laden respiratory droplets is now acknowledged as an effective transmission route of respiratory diseases, as exemplified by COVID-19. In order to assess the risks associated with this pathway in daily-life settings involving tens to hundreds of individuals, the chasm needs to be bridged between fluid dynamical simulations of droplet propagation and population-scale epidemiological models. We achieve this by coarse-graining microscopic droplet trajectories (simulated in various ambient flows) into spatio-temporal maps of viral concentration around the emitter and coupling these maps to field-data about pedestrian crowds in different scenarios (streets, train stations, markets, queues, and street caf{\'e}s). At the scale of an individual pedestrian, our results highlight the paramount importance of the velocity of the ambient air flow relative to the emitter's motion. This aerodynamic effect, which disperses infectious aerosols and thus mitigates short-range transmission risks, prevails over all other environmental variables. At the crowd's scale, the method yields a ranking of the scenarios by the risks of new infections that they present, dominated by the street caf{\'e}s and then the outdoor market. While the effect of light winds on the qualitative ranking is fairly marginal, even the most modest ambient air flows dramatically lower the quantitative rates of new infections. The proposed framework was here applied with SARS-CoV-2 in mind, but its generalization to other airborne pathogens and to other (real or hypothetical) crowd arrangements is straightforward.


title: Quantum critical spin-liquid-like behavior in S = 1/2 quasikagome lattice CeRh1-xPdxSn investigated using muon spin relaxation and neutron scattering

abstract: We present the results of muon spin relaxation ($\mu$SR) and neutron scattering on the Ce-based quasikagome lattice CeRh$_{1-x}$Pd$_{x}$Sn ($x=0.1$ to 0.75). Our ZF-$\mu$SR results reveal the absence of static long-range magnetic order down to 0.05~K in $x = 0.1$ single crystals. The weak temperature-dependent plateaus of the dynamic spin fluctuations below 0.2~K in ZF-$\mu$SR together with its longitudinal-field (LF) dependence between 0 and 3~kG indicate the presence of dynamic spin fluctuations persisting even at $T$ = 0.05~K without static magnetic order. On the other hand, $C_{\text{4f}}$/$T$ increases as --log $T$ on cooling below 0.9~K, passes through a broad maximum at 0.13~K and slightly decreases on further cooling. The ac-susceptibility also exhibits a frequency independent broad peak at 0.16~K, which is prominent with an applied field $H$ along $c$-direction. We, therefore, argue that such a behavior for $x=0.1$ (namely, a plateau in spin relaxation rate ($\lambda$) below 0.2~K and a linear $T$ dependence in $C_{\text{4f}}$ below 0.13~K) can be attributed to a metallic spin-liquid (SL) ground state near the quantum critical point in the frustrated Kondo lattice. The LF-$\mu$SR study suggests that the out of kagome plane spin fluctuations are responsible for the SL behavior. Low energy inelastic neutron scattering (INS) of $x$ = 0.1 reveals gapless magnetic excitations, which are also supported by the behavior of $C_{\text{4f}}$ proportional to $T^{1.1}$ down to 0.06~K.


title: Asymptotically consistent and computationally efficient modeling of short-ranged molecular interactions between curved slender fibers undergoing large 3D deformations

abstract: This article proposes a novel computational modeling approach for short-ranged molecular interactions between curved slender fibers undergoing large 3D deformations, and gives a detailed overview how it fits into the framework of existing fiber or beam interaction models, either considering microscale molecular or macroscale contact effects. The direct evaluation of a molecular interaction potential between two general bodies in 3D space would require to integrate molecule densities over two 3D volumes, leading to a sixfold integral to be solved numerically. By exploiting the short-range nature of the considered class of interaction potentials as well as the fundamental kinematic assumption of undeformable fiber cross-sections, as typically applied in mechanical beam theories, a recently derived, closed-form analytical solution is applied for the interaction potential between a given section of the first fiber (slave beam) and the entire second fiber (master beam). This novel approach based on a pre-defined section-beam interaction potential (SBIP) requires only one single integration step along the slave beam length to be performed numerically. In terms of accuracy, the total beam-beam interaction potential resulting from this approach is shown to exhibit an asymptotically consistent angular and distance scaling behavior. In addition to elementary two-fiber systems, carefully chosen to verify accuracy and asymptotic consistence of the proposed SBIP approach, a potential practical application in form of adhesive nanofiber-grafted surfaces is studied. Involving a large number of helicoidal fibers undergoing large 3D deformations, arbitrary mutual fiber orientations as well as frequent local fiber pull-off and snap-into-contact events, this example demonstrates the robustness and computational efficiency of the new approach.


title: Protein Folding: From Classical Issues to a New Perspective

abstract: The Levinthal paradox exposes many critical questions on the protein folding problem, among which we could point out why proteins can reach their native state in a biologically reasonable time. A proper answer to this question is of foremost importance for evolutive biology since it enables us to understand life as we know it. Preliminary results, based on the upper bound protein marginal-stability limit, together with transition state theory arguments, lead us to show that two-state proteins must reach their native state in, at most, seconds rather than ($\sim 10^{27}$) years -- as indicated by a naive solution of the Levinthal paradox. This outcome -- added to the amide hydrogen-exchange protection factors analysis -- makes it possible for us to suggest how a protein point mutations and/or post-translational modifications impact its folding time scales but not its upper bound limit that obeys the physics ruling the process. Noteworthy for almost 50 years, the protein folding problem --mas the Levinthal paradox -- has been a topic of passionate debate because Anfinsen's challenge -- how a sequence encodes its folding -- remains unsolved despite the smashing success of accurately predicting the protein tridimensional structures by state-of-the-art numerical-methods. Aimed to unlock this long-standing challenge, we propose a new perspective of protein folding, specifically, as a problem that should be devised as an 'analytic whole' -- a Leibniz & Kant's notion. This viewpoint might help us decode Anfinsen's challenge and, thus, open new avenues for future research in the protein folding field.


title: $C\!P$ violation in $B$ mesons

abstract: This proceeding reports a selection of recent experimental results concerning $C\!P$ violation in the sectors of $B^0$ and $B^\pm$ mesons. They were published within the last two years by the Belle, Belle II and LHCb collaborations. The first set of measurements is related to the determination of the angles of the Unitarity Triangle. The second is connected to another crucial test of the SM: the isospin sum rule of $B \to K\pi$ decays. Thirdly, studies of $C\!P$ violation in the decays charged $B$ mesons to charmless three-body final states are presented. Finally, prospects for the future experimental upgrades of this sector are summarised.


title: The reverse mathematics of Carlson's theorem for located words

abstract: In this article, we give two proofs of Carlson's theorem for located words in~$\mathsf{ACA}^+_0$. The first proof is purely combinatorial, in the style of Towsner's proof of Hindman's theorem. The second uses topological dynamics to show that an iterated version of Hindman's theorem for bounded sums implies Carlson's theorem for located words.


title: Warm dark matter from a gravitational freeze-in in extra dimensions

abstract: We study the freeze-in of gravitationally interacting dark matter in extra dimensions. Focusing on a minimal dark matter candidate that only interacts with the SM via gravity in a five-dimensional model we find that a large range of dark matter and Kaluza-Klein graviton masses can lead to the observed relic density. The preferred values of the masses and the strength of the interaction make this scenario very hard to test in terrestrial experiments. However, significant parts of the parameter space lead to warm dark matter and can be tested by cosmological and astrophysical observations.


title: Wave equation of massless particles of arbitrary helicity

abstract: In this work, we derive from first principles the relativistic wave equation of massless particles of arbitrary helicity. We start from unitary projective irreducible representations of the restricted Poincar\'e group. We define a weaker notion of localization and find, in particular, a position operator for any massless particle of arbitrary helicity. Therefore, having the position representation for these particles, we obtain the wave equations in this representation. We compare our results with previous findings in the literature.


title: Kendall's tau estimator for bivariate zero-inflated count data

abstract: In this paper, we extend the work of Pimentel et al. (2015) and propose an adjusted estimator of Kendall's $\tau$ for bivariate zero-inflated count data. We provide achievable lower and upper bounds of our proposed estimator and show its relationship with current literature. In addition, we also suggest an estimator of the achievable bounds, thereby helping practitioners interpret the results while working with real data. The performance of the proposed estimator for Kendall's $\tau$ is unbiased with smaller mean squared errors compared to the unadjusted estimator of Pimentel et al. (2015). Our results also show that the bound estimator can be used when knowledge of the marginal distributions is lacking.


title: 63 Years of the MacDowell-Specker Theorem

abstract: In September of 1959, at the conference on Infinitistic Methods in Warsaw, Ernst Specker presented a joint paper with Robert MacDowell in which the authors proved that every model of Peano Arithmetic has an elementary extension such that all new elements are larger than all elements of the model. Until now, the theorem has been a constant source of new results and generalizations, and there are still open problems related to it. This paper is a survey of all those developments.


title: A Gaussian-process approximation to a spatial SIR process using moment closures and emulators

abstract: The dynamics that govern disease spread are hard to model because infections are functions of both the underlying pathogen as well as human or animal behavior. This challenge is increased when modeling how diseases spread between different spatial locations. Many proposed spatial epidemiological models require trade-offs to fit, either by abstracting away theoretical spread dynamics, fitting a deterministic model, or by requiring large computational resources for many simulations. We propose an approach that approximates the complex spatial spread dynamics with a Gaussian process. We first propose a flexible spatial extension to the well-known SIR stochastic process, and then we derive a moment-closure approximation to this stochastic process. This moment-closure approximation yields ordinary differential equations for the evolution of the means and covariances of the susceptibles and infectious through time. Because these ODEs are a bottleneck to fitting our model by MCMC, we approximate them using a low-rank emulator. This approximation serves as the basis for our hierarchical model for noisy, underreported counts of new infections by spatial location and time. We demonstrate using our model to conduct inference on simulated infections from the underlying, true spatial SIR jump process. We then apply our method to model counts of new Zika infections in Brazil from late 2015 through early 2016.


title: Local Detour Centrality: A Novel Local Centrality Measure for Weighted Networks

abstract: Centrality, in some sense, captures the extent to which a vertex controls the flow of information in a network. Here, we propose Local Detour Centrality as a novel centrality-based betweenness measure that captures the extent to which a vertex shortens paths between neighboring vertices as compared to alternative paths. After presenting our measure, we demonstrate empirically that it differs from other leading central measures, such as betweenness, degree, closeness, and the number of triangles. Through an empirical case study, we provide a possible interpretation for Local Detour Centrality as a measure that captures the extent to which a word is characterized by contextual diversity within a semantic network. We then examine the relationship between our measure and the accessibility to knowledge stored in memory. To do so, we show that words that occur in several different and distinct contexts are significantly more effective in facilitating the retrieval of subsequent words than are words that lack this contextual diversity.


title: Dipole modes of a trapped bosonic mixture: Fate of the sum-rule approach

abstract: We present a general discussion of the dipole modes of a heteronuclear bosonic mixture in a harmonic trap by comparing the prediction of the sum-rule approach with full Gross-Pitaevskii (GP) calculations. Yet in the range of interaction in which the mixture is miscible and stable at the mean field level, $g_{12}^2<g_{11}g_{22}$, we find that there are regimes where the sum rules displays significant deviations from the GP solution. We provide an interpretation for this behavior in terms of the Ehrenfest approach, which we show to be equivalent to the sum-rule approach for dipole excitations.


title: Almost-Orthogonal Layers for Efficient General-Purpose Lipschitz Networks

abstract: It is a highly desirable property for deep networks to be robust against small input changes. One popular way to achieve this property is by designing networks with a small Lipschitz constant. In this work, we propose a new technique for constructing such Lipschitz networks that has a number of desirable properties: it can be applied to any linear network layer (fully-connected or convolutional), it provides formal guarantees on the Lipschitz constant, it is easy to implement and efficient to run, and it can be combined with any training objective and optimization method. In fact, our technique is the first one in the literature that achieves all of these properties simultaneously. Our main contribution is a rescaling-based weight matrix parametrization that guarantees each network layer to have a Lipschitz constant of at most 1 and results in the learned weight matrices to be close to orthogonal. Hence we call such layers almost-orthogonal Lipschitz (AOL). Experiments and ablation studies in the context of image classification with certified robust accuracy confirm that AOL layers achieve results that are on par with most existing methods. Yet, they are simpler to implement and more broadly applicable, because they do not require computationally expensive matrix orthogonalization or inversion steps as part of the network architecture. We provide code at https://github.com/berndprach/AOL.


title: Adversarial Robustness of MR Image Reconstruction under Realistic Perturbations

abstract: Deep Learning (DL) methods have shown promising results for solving ill-posed inverse problems such as MR image reconstruction from undersampled $k$-space data. However, these approaches currently have no guarantees for reconstruction quality and the reliability of such algorithms is only poorly understood. Adversarial attacks offer a valuable tool to understand possible failure modes and worst case performance of DL-based reconstruction algorithms. In this paper we describe adversarial attacks on multi-coil $k$-space measurements and evaluate them on the recently proposed E2E-VarNet and a simpler UNet-based model. In contrast to prior work, the attacks are targeted to specifically alter diagnostically relevant regions. Using two realistic attack models (adversarial $k$-space noise and adversarial rotations) we are able to show that current state-of-the-art DL-based reconstruction algorithms are indeed sensitive to such perturbations to a degree where relevant diagnostic information may be lost. Surprisingly, in our experiments the UNet and the more sophisticated E2E-VarNet were similarly sensitive to such attacks. Our findings add further to the evidence that caution must be exercised as DL-based methods move closer to clinical practice.


title: Robust Acoustic Domain Identification with its Application to Speaker Diarization

abstract: With the rise in multimedia content over the years, more variety is observed in the recording environments of audio. An audio processing system might benefit when it has a module to identify the acoustic domain at its front-end. In this paper, we demonstrate the idea of \emph{acoustic domain identification} (ADI) for \emph{speaker diarization}. For this, we first present a detailed study of the various domains of the third DIHARD challenge highlighting the factors that differentiated them from each other. Our main contribution is to develop a simple and efficient solution for ADI. In the present work, we explore speaker embeddings for this task. Next, we integrate the ADI module with the speaker diarization framework of the DIHARD III challenge. The performance substantially improved over that of the baseline when the thresholds for agglomerative hierarchical clustering were optimized according to the respective domains. We achieved a relative improvement of more than $5\%$ and $8\%$ in DER for core and full conditions, respectively, on Track 1 of the DIHARD III evaluation set.


title: Discover the Mysteries of the Maya: Selected Contributions from the Machine Learning Challenge & The Discovery Challenge Workshop at ECML PKDD 2021

abstract: The volume contains selected contributions from the Machine Learning Challenge "Discover the Mysteries of the Maya", presented at the Discovery Challenge Track of The European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML PKDD 2021). Remote sensing has greatly accelerated traditional archaeological landscape surveys in the forested regions of the ancient Maya. Typical exploration and discovery attempts, beside focusing on whole ancient cities, focus also on individual buildings and structures. Recently, there have been several successful attempts of utilizing machine learning for identifying ancient Maya settlements. These attempts, while relevant, focus on narrow areas and rely on high-quality aerial laser scanning (ALS) data which covers only a fraction of the region where ancient Maya were once settled. Satellite image data, on the other hand, produced by the European Space Agency's (ESA) Sentinel missions, is abundant and, more importantly, publicly available. The "Discover the Mysteries of the Maya" challenge aimed at locating and identifying ancient Maya architectures (buildings, aguadas, and platforms) by performing integrated image segmentation of different types of satellite imagery (from Sentinel-1 and Sentinel-2) data and ALS (lidar) data.


title: Estimation of Historical volatility and Allocation strategies using Variance Swaps

abstract: In this memorie de fin d'etudes, we review some techniques to estimate historical volatility and to price Variance Swaps


title: Discover the GellMann-Okubo formula with machine learning

abstract: Machine learning is a novel and powerful technology and has been widely used in various science topics. We demonstrate a machine-learning based approach built by a set of general metrics and rules inspired by physics. Taking advantages of physical constraints, such as dimension identity, symmetry and generalization, we succeed to rediscover the GellMann Okubo formula using a technique of symbolic regression. This approach can effectively find explicit solutions among user-defined observable, and easily extend to study on exotic hadron spectrum.


title: Dust Temperature Profiles in Dense Cores Associated With Massive Star-Forming Regions

abstract: Using the APEX-12m telescope, continuum maps at 350~$\mu$m of eight gas-dust clouds from the southern hemisphere are obtained. Clouds are associated with the regions of massive star and star cluster formation and have dense cores. Core sizes estimated at the half maximum level are $\sim 0.1-0.2$~pc, core masses and mean gas densities lie in the ranges: $\sim 20-1000~M_{\odot}$ and $\sim (0.3-7.3)\times 10^6$~cm$^{-3}$, respectively. Comparison of the 350~$\mu$m data with the data of observations at 1.2~mm has been performed. From the ratios of intensities at two wavelengths convolved to the same angular resolution, spatial distributions of dust temperatures averaged over the line of sight are calculated. Dust temperature maps for most objects correlate with spatial distributions of intensities at 350~$\mu$m. A decrease in dust temperature with a distance from the center is detected in the cores. Dust temperature profiles in most cases are close to linear ones. Using a simple spherically-symmetric cloud model it is shown that temperature profiles similar to the observed ones can be obtained in a model with internal source by varying density profile parameters and setting $\beta$, a power-law index of the dust emissivity dependence on frequency, constant. It is shown that the dust temperatures estimates strongly depend on the accepted value of $\beta$. It is considered how possible variations of $\beta$ in a cloud can affect the results obtained.


title: Disentangling 3D Attributes from a Single 2D Image: Human Pose, Shape and Garment

abstract: For visual manipulation tasks, we aim to represent image content with semantically meaningful features. However, learning implicit representations from images often lacks interpretability, especially when attributes are intertwined. We focus on the challenging task of extracting disentangled 3D attributes only from 2D image data. Specifically, we focus on human appearance and learn implicit pose, shape and garment representations of dressed humans from RGB images. Our method learns an embedding with disentangled latent representations of these three image properties and enables meaningful re-assembling of features and property control through a 2D-to-3D encoder-decoder structure. The 3D model is inferred solely from the feature map in the learned embedding space. To the best of our knowledge, our method is the first to achieve cross-domain disentanglement for this highly under-constrained problem. We qualitatively and quantitatively demonstrate our framework's ability to transfer pose, shape, and garments in 3D reconstruction on virtual data and show how an implicit shape loss can benefit the model's ability to recover fine-grained reconstruction details.


title: A refinement of bounded cohomology

abstract: We introduce a refinement of bounded cohomology and prove that the suitable comparison homomorphisms vanish for an amenable group. We investigate in this context Thompson's group F and provide further evidence towards its amenability. We provide a source of nontrivial 1-bounded classes and show that the space of 1-bounded classes in degree 2 is huge.


title: FBI: Fingerprinting models with Benign Inputs

abstract: Recent advances in the fingerprinting of deep neural networks detect instances of models, placed in a black-box interaction scheme. Inputs used by the fingerprinting protocols are specifically crafted for each precise model to be checked for. While efficient in such a scenario, this nevertheless results in a lack of guarantee after a mere modification (like retraining, quantization) of a model. This paper tackles the challenges to propose i) fingerprinting schemes that are resilient to significant modifications of the models, by generalizing to the notion of model families and their variants, ii) an extension of the fingerprinting task encompassing scenarios where one wants to fingerprint not only a precise model (previously referred to as a detection task) but also to identify which model family is in the black-box (identification task). We achieve both goals by demonstrating that benign inputs, that are unmodified images, for instance, are sufficient material for both tasks. We leverage an information-theoretic scheme for the identification task. We devise a greedy discrimination algorithm for the detection task. Both approaches are experimentally validated over an unprecedented set of more than 1,000 networks.


title: Scattering of gravitational waves off spinning compact objects with an effective worldline theory

abstract: We study the process, within classical general relativity, in which an incident gravitational plane wave, of weak amplitude and long wavelength, scatters off a massive spinning compact object, such as a black hole or neutron star. The amplitude of the asymptotic scattered wave, considered here at linear order in Newton's constant $G$ while at higher orders in the object's multipole expansion, is a valuable characterization of the response of the object to external gravitational fields. This amplitude coincides with a classical ($\hbar\to0$) limit of a quantum 4-point (object and graviton in, object and graviton out) gravitational Compton amplitude, at the tree (linear-in-$G$) level. Such tree-level Compton amplitudes are key building blocks in generalized-unitary-based approaches to the post-Minkowskian dynamics of binaries of spinning compact objects. In this paper, we compute the classical amplitude using an effective worldline theory to describe the compact object, determined by an action functional for translational and rotational degrees of freedom, including couplings of spin-induced higher multipole moments to spacetime curvature. We work here up to the levels of quadratic-in-spin quadrupole and cubic-in-spin octupole couplings, respectively involving Wilson coefficients $C_2$ and $C_3$. For the special case $C_2=C_3=1$ corresponding to a black hole, we find agreement through cubic-in-spin order between our classical amplitude and previous conjectures arising from considerations of quantum scattering amplitudes. We also present new results for general $C_2$ and $C_3$, anticipating instructive comparisons with results from effective quantum theories.


title: Exploring the bouncing cosmological models in symmetric teleparallel gravity

abstract: In this study, cosmological models with perfect fluid and a gravitational framework f(Q) will be examined. In this modified theory of gravity, the gravitational force has the form f(Q), where Q stands for the non-metricity scalar. I create two bouncing cosmological models, one in which the Lagrangian f(Q) is assumed to have a linear dependence on Q and the other in which it has a polynomial functional form. It has been discovered that the parameters of the individual models largely determine how they will behave. The resulting models' equation of state (EoS) parameter captures the universe's ironic behavior. It should be highlighted that the built-in cosmological models go against the energy requirements. The models' kinematical and physical characteristics are discussed.


title: Dynamics of a massive superfluid vortex in $r^k$ confining potentials

abstract: We study the motion of a superfluid vortex in condensates having different background density profiles, ranging from parabolic to uniform. The resulting effective point-vortex model for a generic power-law potential $\propto r^k$ can be experimentally realized with recent advances in optical-trapping techniques. Our analysis encompasses both empty-core and filled-core vortices. In the latter case, the vortex acquires a mass due to the presence of distinguishable atoms located in its core. The axisymmetry allows us to reduce the coupled dynamical equations of motion to a single radial equation with an effective potential $V_{\rm eff}$. In many cases, $V_{\rm eff}$ has a single minimum, where the vortex precesses uniformly. The dynamics of the vortex and the localized massive core arises from the dependence of the energy on the radial position of the vortex and from the $r^k$ trap potential. We find that a positive vortex with small mass orbits in the positive direction, but the sense of precession can reverse as the core mass increases. Early experiments and theoretical studies on two-component vortices found some qualitatively similar behavior.


title: Partial compactification of stability manifolds by massless semistable objects

abstract: We introduce two partial compactifications of the space of Bridgeland stability conditions of a triangulated category. First we consider lax stability conditions where semistable objects are allowed to have mass zero but still have a phase. The subcategory of massless objects is thick and there is an induced classical stability on the quotient category. We study deformations of lax stability conditions. Second we consider the space arising by identifying lax stability conditions which are deformation-equivalent with fixed charge. This second space is stratified by stability spaces of Verdier quotients of the triangulated category by thick subcategories of massless objects. We illustrate our results through examples in which the Grothendieck group has rank 2. For these, our partial compactification can be explicitly described and related to the wall-and-chamber structure of the stability space.


title: Beyond DMFT: Spin Fluctuations, Pseudogaps and Superconductivity

abstract: This Chapter of the J\"ulich Summer School 2022 provides for a first reading on diagrammatic extensions of dynamical-mean-field theory and their application to spin fluctuations, pseudogap physics and supercondcutivtiy. The contents is as follows: 1 Introduction 2 Dynamical vertex approximation 3 Ladder dynamical vertex approximation 4 Hubbard model, cuprates and nickelates 5 Spin fluctuations 6 Pseudogap 7 Superconductivity 8 Conclusion and outlook


title: MEDLEY: Intent-based Recommendations to Support Dashboard Composition

abstract: Despite the ever-growing popularity of dashboards across a wide range of domains, their authoring still remains a tedious and complex process. Current tools offer considerable support for creating individual visualizations but provide limited support for discovering groups of visualizations that can be collectively useful for composing analytic dashboards. To address this problem, we present MEDLEY, a mixed-initiative interface that assists in dashboard composition by recommending dashboard collections (i.e., a logically grouped set of views and filtering widgets) that map to specific analytical intents. Users can specify dashboard intents (namely, measure analysis, change analysis, category analysis, or distribution analysis) explicitly through an input panel in the interface or implicitly by selecting data attributes and views of interest. The system recommends collections based on these analytic intents, and views and widgets can be selected to compose a variety of dashboards. MEDLEY also provides a lightweight direct manipulation interface to configure interactions between views in a dashboard. Based on a study with 13 participants performing both targeted and open-ended tasks, we discuss how MEDLEY's recommendations guide dashboard composition and facilitate different user workflows. Observations from the study identify potential directions for future work, including combining manual view specification with dashboard recommendations and designing natural language interfaces for dashboard authoring.


title: Extragalactic Observatory Science with the ASTRI Mini-Array at the Observatorio del Teide

abstract: The ASTRI Mini-Array is a next-generation system of nine imaging atmospheric Cherenkov telescopes that is going to be built at the Observatorio del Teide site. After a first phase, in which the instrument will be operated as an experiment prioritizing a schedule of primary science cases, an observatory phase is foreseen in which other significant targets will be pointed. We focus on the observational feasibility of extragalactic sources and on astrophysical processes that best complement and expand the ASTRI Mini-Array core science, presenting the most relevant examples that are at reach of detection over long-term time scales and whose observation can provide breakthrough achievements in the very-high energy extragalactic science. Such examples cover a wide range of $\gamma$-ray emitters, including the study of AGN low states in the multi-TeV energy range, the possible detection of Seyfert galaxies with long exposures and the searches of dark matter lines above 10 TeV. Simulations of the presented objects show that the instrument performance will be competitive at multi-TeV energies with respect to current arrays of Cherenkov telescopes.


title: ASTRI Mini-Array Core Science at the Observatorio del Teide

abstract: The ASTRI (Astrofisica con Specchi a Tecnologia Replicante Italiana) Project led by the Italian National Institute for Astrophysics (INAF) is developing and will deploy at the Observatorio del Teide a mini-array (ASTRI Mini-Array) composed of nine telescopes similar to the small-size dual-mirror Schwarzschild-Couder telescope (ASTRI-Horn) currently operating on the slopes of Mt. Etna in Sicily. The ASTRI Mini-Array will surpass the current Cherenkov telescope array differential sensitivity above a few tera-electronvolt (TeV), extending the energy band well above hundreds of TeV. This will allow us to explore a new window of the electromagnetic spectrum, by convolving the sensitivity performance with excellent angular and energy resolution figures. In this paper we describe the Core Science that we will address during the first four years of operation, providing examples of the breakthrough results that we will obtain when dealing with current open questions, such as the acceleration of cosmic rays, cosmology and fundamental physics and the new window, for the TeV energy band, of the time-domain astrophysics.


title: Bubble-particle collisions in turbulence: insights from point-particle simulations

abstract: Bubble-particle collisions in turbulence are central to a variety of processes such as froth flotation. Despite their importance, details of the collision process have not received much attention yet. This is compounded by the sometimes counter-intuitive behaviour of bubbles and particles in turbulence, as exemplified by the fact that they segregate in space. Although bubble-particle relative behaviour is fundamentally different from that of identical particles, the existing theoretical models are nearly all extensions of theories for particle-particle collisions in turbulence. The adequacy of these theories has yet to be assessed as appropriate data remain scarce to date. In this investigation, we study the geometric collision rate by means of direct numerical simulations of bubble-particle collisions in homogeneous isotropic turbulence using the point-particle approach over a range of the relevant parameters, including the Stokes and Reynolds numbers. We analyse the spatial distribution of bubble and particles, and quantify to what extent their segregation reduces the collision rate. This effect is countered by increased approach velocities for bubble-particle compared to monodisperse pairs, which we relate to the difference in how bubbles and particles respond to fluid accelerations. We found that in the investigated parameter range, these collision statistics are not altered significantly by the inclusion of a lift force or different drag parametrisations, or when assuming infinite particle density. Furthermore, we critically examine existing models and discuss inconsistencies therein that contribute to the discrepancy.


title: Robust Interaction-Enhanced Sensing via Antisymmetric Rabi Spectroscopy

abstract: Atomic spectroscopy, an essential tool for frequency estimation, is widely used in quantum sensing. Atom-atom interaction can be used to generate entanglement for achieving quantum enhanced sensing. However, atom-atom interaction always induces collision shift, which brings systematic error in determining the resonance frequency. Contradiction between utilizing atom-atom interaction and suppressing collision shift generally exists in atomic spectroscopy. Here, we propose an antisymmetric Rabi spectroscopy protocol without collision shift in the presence of atom-atom interactions. We analytically find that the antisymmetric point can be used for determining the resonance frequency. For small Rabi frequency, our antisymmetric Rabi spectroscopy with slight atom-atom interaction can provide better measurement precision than the conventional Rabi spectroscopy. With stronger atom-atom interaction and Rabi frequency, the spectrum resolution can be dramatically improved and the measurement precision may even beat the standard quantum limit. Moreover, unlike the quantum-enhanced Ramsey interferometry via spin squeezing, our scheme is robust against detection noises. Our antisymmetric Rabi spectroscopy protocol has promising applications in various practical quantum sensors such as atomic clocks and atomic magnetometers.


title: The soundproof model of an acoustic--internal waves system with low stratification

abstract: This work is devoted to investigating a compressible fluid system with low stratification, which is driven by fast acoustic waves and internal waves. The approximation using a soundproof model is justified. More precisely, the soundproof model captures the dynamics of both the non-oscillating mean flows and the oscillating internal waves, while filters out the fast acoustic waves, of the compressible system with or without initial acoustic waves. Moreover, the fast-slow oscillation structure is investigated.


title: Galactic Observatory Science with the ASTRI Mini-Array at the Observatorio del Teide

abstract: The ASTRI (Astrofisica con Specchi a Tecnologia Replicante Italiana) Mini-Array will be composed of nine imaging atmospheric Cherenkov telescopes at the Observatorio del Teide site. The array will be best suited for astrophysical observations in the 0.3-200 TeV range with an angular resolution of few arc-minutes and an energy resolution of 10-15\%. A core-science programme in the first four years will be devoted to a limited number of key targets, addressing the most important open scientific questions in the very-high energy domain. At the same time, thanks to a wide field of view of about 10 degrees, ASTRI Mini-Array will observe many additional field sources, which will constitute the basis for the long-term observatory programme that will eventually cover all the accessible sky. In this paper, we review different astrophysical Galactic environments, e.g. pulsar wind nebulae, supernova remnants, and gamma-ray binaries, and show the results from a set of ASTRI Mini-Array simulations of some of these field sources made to highlight the expected performance of the array (even at large offset angles) and the important additional observatory science that will complement the core-science program.


title: Inferring global dynamics from local structure in liquid electrolytes

abstract: Ion transport in concentrated electrolytes plays a fundamental role in electrochemical systems such as lithium ion batteries. Nonetheless, the mechanism of transport amid strong ion-ion interactions remains enigmatic. A key question is whether the dynamics of ion transport can be predicted by the local static structure alone, and if so what are the key structural motifs that determine transport. In this paper, we show that machine learning can successfully decompose global conductivity into the spatio-temporal average of local, instantaneous ionic contributions, and relate this ``local molar conductivity" field to the local ionic environment. Our machine learning model accurately predicts the molar conductivity of electrolyte systems that were not part of the training set, suggesting that the dynamics of ion transport is predictable from local static structure. Further, through analysing this machine-learned local conductivity field, we observe that fluctuations in local conductivity at high concentration are negatively correlated with total molar conductivity. Surprisingly, these fluctuations arise due to a long tail distribution of low conductivity ions, rather than distinct ion pairs, and are spatially correlated through both like- and unlike-charge interactions. More broadly, our approach shows how machine learning can aid the understanding of complex soft matter systems, by learning a function that attributes global collective properties to local, atomistic contributions.


title: Deepest Sensitivity to Wavelike Dark Photon Dark Matter with SRF Cavities

abstract: Wavelike, bosonic dark matter candidates like axions and dark photons can be detected using microwave cavities commonly referred to as haloscopes. Traditionally, haloscopes consist of tunable copper cavities operating in the TM$_{010}$ mode, but ohmic losses have limited their performance. In contrast, superconducting radio frequency (SRF) cavities can achieve quality factors of $\sim 10^{10}$, perhaps five orders of magnitude better than copper cavities, which would lead to more sensitive dark matter detectors. In this paper, we first derive that the scan rate of a haloscope experiment is proportional to the loaded quality factor $Q_L$, even if the cavity bandwidth is much narrower than the dark matter halo lineshape. We then present a proof-of-concept search for dark photon dark matter using a nontunable ultrahigh quality SRF cavity. We exclude dark photon dark matter with kinetic mixing strengths of $\chi > 1.8\times 10^{-16}$ for a dark photon mass of $m_{A^{\prime}} = 5.37\mu$eV, achieving the deepest exclusion to wavelike dark photons by almost an order of magnitude.


title: Notes on planar semimodular lattices. VI. On the structure theorem of planar semimodular lattices

abstract: In a recent paper, G. Cz\'edli and E.\,T. Schmidt present a structure theorem for planar semimodular lattices. In this note, we present an alternative proof.


title: Catoni-style Confidence Sequences under Infinite Variance

abstract: In this paper, we provide an extension of confidence sequences for settings where the variance of the data-generating distribution does not exist or is infinite. Confidence sequences furnish confidence intervals that are valid at arbitrary data-dependent stopping times, naturally having a wide range of applications. We first establish a lower bound for the width of the Catoni-style confidence sequences for the finite variance case to highlight the looseness of the existing results. Next, we derive tight Catoni-style confidence sequences for data distributions having a relaxed bounded~$p^{th}-$moment, where~$p \in (1,2]$, and strengthen the results for the finite variance case of~$p =2$. The derived results are shown to better than confidence sequences obtained using Dubins-Savage inequality.


title: Gluon gravitational form factors of protons from charmonium photoproduction

abstract: Inspired by the recent near-threshold $J/\psi$ photoproduction measurements, we discuss gluon gravitational form factors (GFFs) and internal properties of the proton. This work presents a complete analysis of the proton gluon GFFs connecting the gluon part of the energy-momentum tensor and the heavy quarkonium photoproduction. In particular, a global fitting of the $J/\psi$ differential and total cross section experimental data is used to determine the gluon GFFs as functions of the squared momentum transfer $t$. Combined with the quark contributions to the $D$-term form factor extracted from the deeply virtual Compton scattering experiment, the total $D$-term is obtained to investigate their applications in describing the proton mechanical properties. These studies provide a unique perspective on investigating the proton gluon GFFs and important information for enhancing QCD constraints on the gluon GFFs.


title: External field and critical exponents in controlling dynamics on complex networks

abstract: Dynamical processes on complex networks, ranging from biological, technological and social systems, show phase transitions between distinct global states of the system. Often, such transitions rely upon the interplay between the structure and dynamics that takes place on it, such that weak connectivity, either sparse network or frail interactions, might lead to global activity collapse, while strong connectivity leads to high activity. Here, we show that controlling dynamics of a fraction of the nodes in such systems acts as an external field in a continuous phase transition. As such, it defines corresponding critical exponents, both at equilibrium and of the transient time. We find the critical exponents for a general class of dynamics using the leading orders of the dynamic functions. By applying this framework to three examples, we reveal distinct universality classes.


title: BlenderBot 3: a deployed conversational agent that continually learns to responsibly engage

abstract: We present BlenderBot 3, a 175B parameter dialogue model capable of open-domain conversation with access to the internet and a long-term memory, and having been trained on a large number of user defined tasks. We release both the model weights and code, and have also deployed the model on a public web page to interact with organic users. This technical report describes how the model was built (architecture, model and training scheme), and details of its deployment, including safety mechanisms. Human evaluations show its superiority to existing open-domain dialogue agents, including its predecessors (Roller et al., 2021; Komeili et al., 2022). Finally, we detail our plan for continual learning using the data collected from deployment, which will also be publicly released. The goal of this research program is thus to enable the community to study ever-improving responsible agents that learn through interaction.


title: Quantification of electron correlation for approximate quantum calculations

abstract: State-of-the-art many-body wave function techniques rely on heuristics to achieve high accuracy at an attainable cost to solve the many-body Schr\"odinger equation. By far the most common property used to assess accuracy has been the total energy; however, total energies do not give a complete picture of electron correlation. In this work, the authors assess the von Neumann entropy of the one-particle reduced density matrix (1-RDM) to compare selected configuration interaction (CI), coupled cluster, variational Monte Carlo, and fixed-node diffusion Monte Carlo for benchmark hydrogen chains. A new algorithm, the circle reject method is presented which improves the efficiency of the evaluation of the von Neumann entropy using quantum Monte Carlo by several orders of magnitude. The von Neumann entropy of the 1-RDM and the eigenvalues of the 1-RDM are shown to distinguish between the dynamic correlation introduced by the Jastrow and static correlation introduced by determinants with large weights, confirming some of the lore in the field concerning the difference between the selected CI and Slater-Jastrow wave functions.


title: Reduced-order modeling for stochastic large-scale and time-dependent problems using deep spatial and temporal convolutional autoencoders

abstract: A non-intrusive reduced order model based on convolutional autoencoders (NIROM-CAEs) is proposed as a data-driven tool to build an efficient nonlinear reduced-order model for stochastic spatio-temporal large-scale physical problems. The method uses two 1d-convolutional autoencoders (CAEs) to reduce the spatial and temporal dimensions from a set of high-fidelity snapshots collected from the high-fidelity numerical solver. The encoded latent vectors, generated from two compression levels, are then mapped to the input parameters using a regression-based multilayer perceptron (MLP). The accuracy of the proposed approach is compared to that of the linear reduced-order technique-based artificial neural network (POD-ANN) through two benchmark tests (the one-dimensional Burgers and Stoker's solutions) and a hypothetical dam-break flow problem, with an unstructured mesh and over a complex bathymetry river. The numerical results show that the proposed nonlinear framework presents strong predictive abilities to accurately approximate the statistical moments of the outputs for complex stochastic large-scale and time-dependent problems, with low computational cost during the predictive online stage.


title: Discrete time translation symmetry breaking in a Josephson junction laser

abstract: A Josephson junction laser is realised when a microwave cavity is driven by a voltage-biased Josephson junction. Through the ac Josephson effect, a dc voltage generates a periodic drive that acts on the cavity and generates interactions between its modes. A sufficiently strong drive enables processes that down-convert a drive resonant with a high harmonic into photons at the cavity fundamental frequency, breaking the discrete time translation symmetry set by the Josephson frequency. Using a classical model, we determine when and how this transition occurs as a function of the bias voltage and the number of cavity modes. We find that certain combinations of mode number and voltage tend to facilitate the transition which emerges via an instability within a subset of the modes. Despite the complexity of the system, there are cases in which the critical drive strength can be obtained analytically.


title: Hardless: A Generalized Serverless Compute Architecture for Hardware Processing Accelerators

abstract: The increasing use of hardware processing accelerators tailored for specific applications, such as the Vision Processing Unit (VPU) for image recognition, further increases developers' configuration, development, and management overhead. Developers have successfully used fully automated elastic cloud services such as serverless computing to counter these additional efforts and shorten development cycles for applications running on CPUs. Unfortunately, current cloud solutions do not yet provide these simplifications for applications that require hardware acceleration. However, as the development of specialized hardware acceleration continues to provide performance and cost improvements, it will become increasingly important to enable ease of use in the cloud. In this paper, we present an initial design and implementation of Hardless, an extensible and generalized serverless computing architecture that can support workloads for arbitrary hardware accelerators. We show how Hardless can scale across different commodity hardware accelerators and support a variety of workloads using the same execution and programming model common in serverless computing today.


title: Did Maxwell dream of electrical bacteria?

abstract: We propose a model for bacterial Quorum Sensing based on an auxiliary electrostatic-like interac-tion originating from a fictitious electrical charge that represents bacteria activity. A cooperative mechanism for charge/activity exchange is introduced to implement chemotaxis and replication. The bacteria system is thus represented by means of a complex resistor network where link re-sistances take into account the allowed activity-flow among individuals. By explicit spatial sto-chastic simulations, we show that the model exhibits different quasi-realistic behaviors from colo-ny formation to biofilm aggregation. The electrical signal associated with Quorum Sensing is ana-lyzed in space and time and provides useful information about the colony dynamics. In particular, we analyze the transition between the planktonic and the colony phases as the intensity of Quorum Sensing is varied.


title: Basic Elements of Logical Graphs

abstract: We considers how a particular kind of graph corresponds to multiplicative intuitionistic linear logic formula. The main feature of the graphical notation is that it absorbs certain symmetries between conjunction and implication. We look at the basic definitions and present details of an implementation in the functional programming language Standard ML. This provides a functional approach to graph traversal and demonstrates how graph isomorphism be implemented in just a few lines of readable code. This works takes the initial steps towards a graphical language and toolkit for working with logic formula and derivations.


title: Hamiltonian variational formulation of three-dimensional, rotational free-surface flows, with a moving seabed, in the Eulerian description

abstract: Hamiltonian variational principles provided, since 60s, the means of developing very successful wave theories for nonlinear free-surface flows, under the assumption of irrotationality. This success, in conjunction with the recognition that almost all flows in the sea are not irrotational, raises the question of extending Hamilton Principle to rotational free-surface flows. The equations governing the fluid motion within the fluid domain, in the Eulerian description, have been derived by means of Hamilton Principle since late 50s. Nevertheless, a complete variational formulation of the problem, including the derivation of boundary conditions, seems to be lacking up to now. Such a formulation is given in the present work. The differential equations governing the fluid motion are derived as usually, starting from the typical Lagrangian, constrained with the conservation of mass and the conservation of fluid parcels identity. To obtain the boundary conditions, generic differential-variational constraints are introduced in the boundary variational equation, leading to a reformulation which permits us to derive both kinematic and dynamic conditions on all boundaries of the fluid, including the free surface. An interesting feature, appearing in the present variational derivation of kinematic boundary conditions, is a dual possibility of obtaining either the usual kinematic condition (the same as in irrotational flow) or a condition of different type, corresponding to zero tangential velocity on the boundary. The deeper meaning and the significance of these findings seem to deserve further analysis.


title: COPER: Continuous Patient State Perceiver

abstract: In electronic health records (EHRs), irregular time-series (ITS) occur naturally due to patient health dynamics, reflected by irregular hospital visits, diseases/conditions and the necessity to measure different vitals signs at each visit etc. ITS present challenges in training machine learning algorithms which mostly are built on assumption of coherent fixed dimensional feature space. In this paper, we propose a novel COntinuous patient state PERceiver model, called COPER, to cope with ITS in EHRs. COPER uses Perceiver model and the concept of neural ordinary differential equations (ODEs) to learn the continuous time dynamics of patient state, i.e., continuity of input space and continuity of output space. The neural ODEs help COPER to generate regular time-series to feed to Perceiver model which has the capability to handle multi-modality large-scale inputs. To evaluate the performance of the proposed model, we use in-hospital mortality prediction task on MIMIC-III dataset and carefully design experiments to study irregularity. The results are compared with the baselines which prove the efficacy of the proposed model.


title: Low-Resource Dense Retrieval for Open-Domain Question Answering: A Comprehensive Survey

abstract: Dense retrieval (DR) approaches based on powerful pre-trained language models (PLMs) achieved significant advances and have become a key component for modern open-domain question-answering systems. However, they require large amounts of manual annotations to perform competitively, which is infeasible to scale. To address this, a growing body of research works have recently focused on improving DR performance under low-resource scenarios. These works differ in what resources they require for training and employ a diverse set of techniques. Understanding such differences is crucial for choosing the right technique under a specific low-resource scenario. To facilitate this understanding, we provide a thorough structured overview of mainstream techniques for low-resource DR. Based on their required resources, we divide the techniques into three main categories: (1) only documents are needed; (2) documents and questions are needed; and (3) documents and question-answer pairs are needed. For every technique, we introduce its general-form algorithm, highlight the open issues and pros and cons. Promising directions are outlined for future research.


title: Novel magnetic excitations beyond the single- and double-magnons

abstract: Conventional wisdom suggests that one photon that carries one unit of angular momentum can change the spin angular momentum of a magnetic system with one unit (delta Ms = +-1) at most. This would imply that a two-photon scattering process can manipulate the spin angular momentum of the magnetic system with a maximum of two units. Here we examine the fundamental limit of the photon-driven transport of angular momentum by studying the magnon spectrum of {\alpha}-Fe2O3 using resonant inelastic x-ray scattering. We discovered a cascade of higher-rank magnons carrying double, triple, quadruple, and quintuple the spin angular momentum of a single-magnon. Guided by theoretical calculations, we reveal how a two-photons scattering process can create exotic higher-rank magnons and the relevance of these quasiparticles for magnon-based applications.


title: Moduli spaces for PT-regularized solitons

abstract: We construct and analyse the moduli space (collective coordinates) for a classical field theory in 1 + 1 dimensions that possesses complex stable multi-soliton solutions with real energies when PT-regularized. For the integrable Bullough-Dodd model we show, by comparing with the exact solutions, that a one-dimensional moduli space captures well the main feature of the centre of mass motion of the one and two-soliton solutions. We demonstrate that even the time-delay and spatial displacements occurring for the one-soliton constituents in a multi-soliton scattering process can be extracted from a moduli space analysis. We propose a two dimensional moduli space to describe the newly found triple bouncing scattering amongst the constituents of a dark two double peakon scattering.


title: Studying a precessing jet of a massive young stellar object within a chemically rich region

abstract: In addition to the large surveys and catalogs of massive young stellar objects and outflows, dedicated studies of particular sources, in which high-angular observations (mainly at near-IR and mm) are analyzed in depth, are needed to shed light on the processes involved in the formation of massive stars. The galactic source G079.1272+02.2782 (G79), a MYSO at about 1.4 kpc, is an ideal source to carry out this kind of studies. Near-IR integral field spectroscopic observations were carried out using NIFS at Gemini-North. The spectral and angular resolutions, allow us to perform a detailed study of the source and its southern jet, resolving structures with sizes between 200 and 300 au. As a complement, millimeter data retrieved from the JCMT and the IRAM 30m telescope databases were analyzed to study the molecular gas at a larger spatial scale. The analysis of a jet extending southwards shows cork-screw like structures at 2.2 um continuum, strongly suggesting that the jet is precessing. The jet velocity is estimated in 30-43 km/s and it is coming to us along the line of sight. We suggest that the precession may be produced by the gravitational tidal effects generated in a probable binary system, and we estimate a jet precession period of about 10^3 yr, indicating a slow-precessing jet, which is in agreement with the observed helical features. An analysis of H2 lines along the jet allows us to investigate in detail a bow-shock produced by this jet. We find that this bow-shock is indeed generated by a C-type shock and it is observed coming to us, with some inclination angle, along the line of sight. This is confirmed by the analysis of molecular outflows at a larger spatial scale. A brief analysis of several molecular species at millimeter wavelengths indicates a complex chemistry developing at the external layers of the molecular clump in which MYSO G79 is embedded.


title: Primordial lepton asymmetries in the precision cosmology era: Current status and future sensitivities from BBN and the CMB

abstract: Using a new sample of extremely metal poor systems, the EMPRESS survey has recently reported a primordial helium abundance that is $3\sigma$ smaller than the prediction from the standard big bang nucleosynthesis (BBN) scenario. This measurement could be interpreted as a hint for a primordial lepton asymmetry in the electron neutrino flavor. Motivated by the EMPRESS results, we present a comprehensive analysis of the lepton asymmetry using measurements of the abundances of primordial elements, along with cosmic microwave background (CMB) data from Planck. Assuming that there is no dark radiation in our Universe, we find an electron neutrino chemical potential $\xi_{\nu_e} = 0.043 \pm 0.015$, which deviates from zero by $2.9\sigma$. If no assumption is made on the abundance of dark radiation in the Universe, the chemical potential is $\xi_{\nu_e} = 0.046 \pm 0.021$, which deviates from zero by $2.2\sigma$. We also find that this result is rather insensitive to the choice of nuclear reaction rates. If the true helium abundance corresponds to the EMPRESS central value, future CMB observations from the Simons Observatory and CMB-S4 will increase the significance for a nonzero lepton asymmetry to $4\sigma$ and $5\sigma$ respectively, assuming no dark radiation, or to $3\sigma$ when no assumption is made on the abundance of dark radiation.


title: The rank of the semigroup of order-, fence-, and parity-preserving partial injections on a finite set

abstract: The monoid of all partial injections on a finite set (the symmetric inverse semigroup) is of particular interest because of the well-known Wagner-Preston Theorem. In this article, we step forward the study of a submonoid of the symmetric inverse semigroup. We explore the monoid of all order-, fence-, and parity-preserving transformations on an $n$-element chain. We also characterize the transformations in that monoid and show that it has a rank $3n-6$. In particular, we provide a generating set $A_n$ of minimal size and exhibit concrete normal forms for the transformations generated by $A_n$.


title: Brain Lesion Synthesis via Progressive Adversarial Variational Auto-Encoder

abstract: Laser interstitial thermal therapy (LITT) is a novel minimally invasive treatment that is used to ablate intracranial structures to treat mesial temporal lobe epilepsy (MTLE). Region of interest (ROI) segmentation before and after LITT would enable automated lesion quantification to objectively assess treatment efficacy. Deep learning techniques, such as convolutional neural networks (CNNs) are state-of-the-art solutions for ROI segmentation, but require large amounts of annotated data during the training. However, collecting large datasets from emerging treatments such as LITT is impractical. In this paper, we propose a progressive brain lesion synthesis framework (PAVAE) to expand both the quantity and diversity of the training dataset. Concretely, our framework consists of two sequential networks: a mask synthesis network and a mask-guided lesion synthesis network. To better employ extrinsic information to provide additional supervision during network training, we design a condition embedding block (CEB) and a mask embedding block (MEB) to encode inherent conditions of masks to the feature space. Finally, a segmentation network is trained using raw and synthetic lesion images to evaluate the effectiveness of the proposed framework. Experimental results show that our method can achieve realistic synthetic results and boost the performance of down-stream segmentation tasks above traditional data augmentation techniques.


title: Voevodsky motives of stacks of coherent sheaves on a curve

abstract: We prove formulae for the motives of stacks of coherent sheaves of fixed rank and degree over a smooth projective curve in Voevodsky's triangulated category of mixed motives with rational coefficients.


title: Reassessing thermodynamic advantage from indefinite causal order

abstract: Indefinite causal order is a key feature involved in the study of quantum higher order transformations. Recently, intense research has been focused on possible advantages related to the lack of definite causal order of quantum processes. Quite often the quantum switch is claimed to provide advantages in information-theoretic and thermodynamic tasks. We address here the question whether indefinite causal order is a resource for quantum thermodynamics. Inspired by previous results in the literature, we show that indefinite causal order is not necessary for the reported increase in free energy and ergotropy. More specifically, we show that a simple causally ordered process, which replaces the system's state with a new one before the final measurement, outperforms the quantum switch in all thermodynamic tasks considered so far. We further show that a similar advantage can be also achieved without completely discarding system, if we allow for non-Markovian interactions between the system and an environment. We extend the analysis to more extreme examples of indefinite causal order, showing that they do not provide an advantage either. Finally, we discuss a possible way to study the advantages that may arise from indefinite causal order in a general scenario.


title: Task-agnostic Continual Hippocampus Segmentation for Smooth Population Shifts

abstract: Most continual learning methods are validated in settings where task boundaries are clearly defined and task identity information is available during training and testing. We explore how such methods perform in a task-agnostic setting that more closely resembles dynamic clinical environments with gradual population shifts. We propose ODEx, a holistic solution that combines out-of-distribution detection with continual learning techniques. Validation on two scenarios of hippocampus segmentation shows that our proposed method reliably maintains performance on earlier tasks without losing plasticity.


title: Neighborhood Collective Estimation for Noisy Label Identification and Correction

abstract: Learning with noisy labels (LNL) aims at designing strategies to improve model performance and generalization by mitigating the effects of model overfitting to noisy labels. The key success of LNL lies in identifying as many clean samples as possible from massive noisy data, while rectifying the wrongly assigned noisy labels. Recent advances employ the predicted label distributions of individual samples to perform noise verification and noisy label correction, easily giving rise to confirmation bias. To mitigate this issue, we propose Neighborhood Collective Estimation, in which the predictive reliability of a candidate sample is re-estimated by contrasting it against its feature-space nearest neighbors. Specifically, our method is divided into two steps: 1) Neighborhood Collective Noise Verification to separate all training samples into a clean or noisy subset, 2) Neighborhood Collective Label Correction to relabel noisy samples, and then auxiliary techniques are used to assist further model optimization. Extensive experiments on four commonly used benchmark datasets, i.e., CIFAR-10, CIFAR-100, Clothing-1M and Webvision-1.0, demonstrate that our proposed method considerably outperforms state-of-the-art methods.


title: On holomorphic isometries into blow-ups of $\mathbb C^n$

abstract: We study the K\"ahler-Einstein manifolds which admits a holomorphic isometry into either the generalized Burns-Simanca manifold $(\tilde {\mathbb C}^n, g_S)$ or the Eguchi-Hanson manifold $(\tilde {\mathbb C}^2, g_{EH})$. Moreover, we prove that $(\tilde {\mathbb C}^n, g_S)$ and $(\tilde {\mathbb C}^2, g_{EH})$ are not relatives to any homogeneous bounded domain.


title: Bias and Fairness in Computer Vision Applications of the Criminal Justice System

abstract: Discriminatory practices involving AI-driven police work have been the subject of much controversies in the past few years, with algorithms such as COMPAS, PredPol and ShotSpotter being accused of unfairly impacting minority groups. At the same time, the issues of fairness in machine learning, and in particular in computer vision, have been the subject of a growing number of academic works. In this paper, we examine how these area intersect. We provide information on how these practices have come to exist and the difficulties in alleviating them. We then examine three applications currently in development to understand what risks they pose to fairness and how those risks can be mitigated.


title: Instanton sheaves on Fano threefolds

abstract: Generalizing the definitions originally presented by Kuznetsov and Faenzi, we study (possibly non locally free) instanton sheaves of arbitrary rank on Fano threefolds. We classify rank 1 instanton sheaves and describe all curves whose structure sheaves are rank 0 instanton sheaves. In addition, we show that every rank 2 instanton sheaf is an elementary transformation of a locally free instanton sheaf along a rank 0 instanton sheaf. To complete the paper, we describe the moduli space of rank 2 instanton sheaves of charge 2 on a quadric threefold $X$, and show that the full moduli space of rank 2 semistable sheaves on $X$ with Chern classes $(c_1,c_2,c_3)=(-1,2,0)$ is connected and contains, besides the instanton component, just one other irreducible component which is also fully described.


title: Why do networks have inhibitory/negative connections?

abstract: Why do brains have inhibitory connections? Why do deep networks have negative weights? We propose an answer from the perspective of representation capacity. We believe representing functions is the primary role of both (i) the brain in natural intelligence, and (ii) deep networks in artificial intelligence. Our answer to why there are inhibitory/negative weights is: to learn more functions. We prove that, in the absence of negative weights, neural networks with non-decreasing activation functions are not universal approximators. While this may be an intuitive result to some, to the best of our knowledge, there is no formal theory, in either machine learning or neuroscience, that demonstrates why negative weights are crucial in the context of representation capacity. Further, we provide insights on the geometric properties of the representation space that non-negative deep networks cannot represent. We expect these insights will yield a deeper understanding of more sophisticated inductive priors imposed on the distribution of weights that lead to more efficient biological and machine learning.


title: Quadratic Symmetric Polynomials and an analogue of the Davenport Constant

abstract: In this paper, we define the constant $D(\varphi, p)$, an analogue for the Davenport constant, for sequences on the finite field $\mathbb{F}_p$, defined via quadratic symmetric polynomials. Next, we state a series of results presenting either the exact value of $D(\varphi, p)$, or lower and upper bounds for this constant.


title: A Proper Concordance Index for Time-Varying Risk

abstract: Harrel's concordance index is a commonly used discrimination metric for survival models, particularly for models where the relative ordering of the risk of individuals is time-independent, such as the proportional hazards model. There are several suggestions, but no consensus, on how it could be extended to models where relative risk can vary over time, e.g.\ in case of crossing hazard rates. We show that these concordance indices are not proper, in the sense that they are maximised in the limit by the true data generating model. Furthermore, we show that a concordance index is proper if and only if the risk score used is concordant with the hazard rate at the first event time for each comparable pair of events. Thus, we suggest using the hazard rate as the time-varying risk score when calculating concordance. Through simulations, we demonstrate situations in which other concordance indices can lead to incorrect models being selected over a true model, justifying the use of our suggested risk prediction in both model selection and in loss functions in, e.g., deep learning models.


title: Rogue wave patterns associated with Okamoto polynomial hierarchies

abstract: We show that new types of rogue wave patterns exist in integrable systems, and these rogue patterns are described by root structures of Okamoto polynomial hierarchies. These rogue patterns arise when the $\tau$ functions of rogue wave solutions are determinants of Schur polynomials with index jumps of three, and an internal free parameter in these rogue waves gets large. We demonstrate these new rogue patterns in the Manakov system and the three-wave resonant interaction system. For each system, we derive asymptotic predictions of its rogue patterns under a large internal parameter through Okamoto polynomial hierarchies. Unlike the previously reported rogue patterns associated with the Yablonskii-Vorob'ev hierarchy, a new feature in the present rogue patterns is that, the mapping from the root structure of Okamoto-hierarchy polynomials to the shape of the rogue pattern is linear only to the leading order, but becomes nonlinear to the next order. As a consequence, the current rogue patterns are often deformed, sometimes strongly deformed, from Okamoto root structures, unless the underlying free parameter is very large. Our analytical predictions of rogue patterns are compared to true solutions, and excellent agreement is observed, even when rogue patterns are strongly deformed from Okamoto root structures.


title: Hierarchical Bayesian data selection

abstract: There are many issues that can cause problems when attempting to infer model parameters from data. Data and models are both imperfect, and as such there are multiple scenarios in which standard methods of inference will lead to misleading conclusions; corrupted data, models which are only representative of subsets of the data, or multiple regions in which the model is best fit using different parameters. Methods exist for the exclusion of some anomalous types of data, but in practice, data cleaning is often undertaken by hand before attempting to fit models to data. In this work, we will employ hierarchical Bayesian data selection; the simultaneous inference of both model parameters, and parameters which represent our belief that each observation within the data should be included in the inference. The aim, within a Bayesian setting, is to find the regions of observation space for which the model can well-represent the data, and to find the corresponding model parameters for those regions. A number of approaches will be explored, and applied to test problems in linear regression, and to the problem of fitting an ODE model, approximated by a finite difference method. The approaches are simple to implement, can aid mixing of Markov chains designed to sample from the arising densities, and are broadly applicable to many inferential problems.


title: The Sun's Mean Line-of-Sight Field

abstract: We regard the Sun-as-a-star magnetic field (i.e. the mean field) as a filter for the spherical harmonic components of the photospheric field, and calculate the transmission coefficients of this filter. The coefficients for each harmonic, $Y_{l}^{m}$, are listed in three tables according to their dependence on $B_{0}$, the observer's latitude in the star's polar coordinate system. These coefficients are used to interpret the 46-yr sequence of daily mean-field measurements at the Wilcox Solar Observatory. We find that the non-axisymmetric part of the field originates in the $Y_{1}^{1}$, $Y_{2}^{2}$, and a combination of the $Y_{3}^{3}$ and $Y_{3}^{1}$ harmonic components. The axisymmetric part of the field originates in $Y_{2}^{0}$ plus a $B_{0}$-dependent combination of the $Y_{1}^{0}$ and $Y_{3}^{0}$ components. The power spectrum of the field has peaks at frequencies corresponding to the ~27-day synodic equatorial rotation period and its second and third harmonics. Each of these peaks has fine structure on its low-frequency side, indicating magnetic patterns that rotate slowly under the influence of differential rotation and meridional flow. The sidebands of the fundamental mode resolve into peaks corresponding to periods of ~28.5 and ~30 days, which tend to occur at the start of sunspot maximum, whereas the ~27-day period tends to occur toward the end of sunspot maximum. We expect similar rotational sidebands to occur in magnetic observations of other Sun-like stars and to be a useful complement to asteroseismology studies of convection and magnetic fields in those stars.


title: Distance-based detection of out-of-distribution silent failures for Covid-19 lung lesion segmentation

abstract: Automatic segmentation of ground glass opacities and consolidations in chest computer tomography (CT) scans can potentially ease the burden of radiologists during times of high resource utilisation. However, deep learning models are not trusted in the clinical routine due to failing silently on out-of-distribution (OOD) data. We propose a lightweight OOD detection method that leverages the Mahalanobis distance in the feature space and seamlessly integrates into state-of-the-art segmentation pipelines. The simple approach can even augment pre-trained models with clinically relevant uncertainty quantification. We validate our method across four chest CT distribution shifts and two magnetic resonance imaging applications, namely segmentation of the hippocampus and the prostate. Our results show that the proposed method effectively detects far- and near-OOD samples across all explored scenarios.


title: RadTex: Learning Efficient Radiograph Representations from Text Reports

abstract: Automated analysis of chest radiography using deep learning has tremendous potential to enhance the clinical diagnosis of diseases in patients. However, deep learning models typically require large amounts of annotated data to achieve high performance -- often an obstacle to medical domain adaptation. In this paper, we build a data-efficient learning framework that utilizes radiology reports to improve medical image classification performance with limited labeled data (fewer than 1000 examples). Specifically, we examine image-captioning pretraining to learn high-quality medical image representations that train on fewer examples. Following joint pretraining of a convolutional encoder and transformer decoder, we transfer the learned encoder to various classification tasks. Averaged over 9 pathologies, we find that our model achieves higher classification performance than ImageNet-supervised and in-domain supervised pretraining when labeled training data is limited.


title: Construction of English Resume Corpus and Test with Pre-trained Language Models

abstract: Information extraction(IE) has always been one of the essential tasks of NLP. Moreover, one of the most critical application scenarios of information extraction is the information extraction of resumes. Constructed text is obtained by classifying each part of the resume. It is convenient to store these texts for later search and analysis. Furthermore, the constructed resume data can also be used in the AI resume screening system. Significantly reduce the labor cost of HR. This study aims to transform the information extraction task of resumes into a simple sentence classification task. Based on the English resume dataset produced by the prior study. The classification rules are improved to create a larger and more fine-grained classification dataset of resumes. This corpus is also used to test some current mainstream Pre-training language models (PLMs) performance.Furthermore, in order to explore the relationship between the number of training samples and the correctness rate of the resume dataset, we also performed comparison experiments with training sets of different train set sizes.The final multiple experimental results show that the resume dataset with improved annotation rules and increased sample size of the dataset improves the accuracy of the original resume dataset.