title: Federated Continual Learning for Text Classification via Selective Inter-client Transfer

abstract: In this work, we combine the two paradigms: Federated Learning (FL) and Continual Learning (CL) for text classification task in cloud-edge continuum. The objective of Federated Continual Learning (FCL) is to improve deep learning models over life time at each client by (relevant and efficient) knowledge transfer without sharing data. Here, we address challenges in minimizing inter-client interference while knowledge sharing due to heterogeneous tasks across clients in FCL setup. In doing so, we propose a novel framework, Federated Selective Inter-client Transfer (FedSeIT) which selectively combines model parameters of foreign clients. To further maximize knowledge transfer, we assess domain overlap and select informative tasks from the sequence of historical tasks at each foreign client while preserving privacy. Evaluating against the baselines, we show improved performance, a gain of (average) 12.4\% in text classification over a sequence of tasks using five datasets from diverse domains. To the best of our knowledge, this is the first work that applies FCL to NLP.


title: Bifurcating-Paths: the relation between preferential flow bifurcations, void, and tortuosity on the Darcy scale

abstract: In recent years, Darcy scale transport in porous media was characterized to be Fickian or non-Fickian due to the homogeneity or heterogeneity of the porous medium conductivity layout. Yet, evidence shows that preferential flows that funnel the transport occur in heterogeneous and homogenous cases. We model the Darcy scale transport using a 2D conductivity field ranging from homogenous to heterogeneous and find that these preferential flows bifurcate, leaving voids where particles do not invade while forming a tortuous path. The fraction of bifurcations decreases downflow and reaches an asymptotical value, which scales as a power-law with the heterogeneity level. We show that the same power-law scaling of the bifurcations to heterogeneity level appears for the void fraction, tortuosity, and fractal dimension analysis with the same heterogeneity level. We conclude that the scaling with the heterogeneity is the dominant feature in the preferential flow geometry, which will lead to variations in weighting times for the transport and eventually to anomalous transport.


title: Real-time adaptive estimation of decoherence timescales for a single qubit

abstract: Characterising the time over which quantum coherence survives is critical for any implementation of quantum bits, memories and sensors. The usual method for determining a quantum system's decoherence rate involves a suite of experiments probing the entire expected range of this parameter, and extracting the resulting estimation in post-processing. Here we present an adaptive multi-parameter Bayesian approach, based on a simple analytical update rule, to estimate the key decoherence timescales ($T_1$, $T_2^*$ and $T_2$) and the corresponding decay exponent of a quantum system in real time, using information gained in preceding experiments. This approach reduces the time required to reach a given uncertainty by a factor up to an order of magnitude, depending on the specific experiment, compared to the standard protocol of curve fitting. A further speed-up of a factor $\sim 2$ can be realised by performing our optimisation with respect to sensitivity as opposed to variance.


title: EduQG: A Multi-format Multiple Choice Dataset for the Educational Domain

abstract: We introduce a high-quality dataset that contains 3,397 samples comprising (i) multiple choice questions, (ii) answers (including distractors), and (iii) their source documents, from the educational domain. Each question is phrased in two forms, normal and close. Correct answers are linked to source documents with sentence-level annotations. Thus, our versatile dataset can be used for both question and distractor generation, as well as to explore new challenges such as question format conversion. Furthermore, 903 questions are accompanied by their cognitive complexity level as per Bloom's taxonomy. All questions have been generated by educational experts rather than crowd workers to ensure they are maintaining educational and learning standards. Our analysis and experiments suggest distinguishable differences between our dataset and commonly used ones for question generation for educational purposes. We believe this new dataset can serve as a valuable resource for research and evaluation in the educational domain. The dataset and baselines will be released to support further research in question generation.


title: SpecRNet: Towards Faster and More Accessible Audio DeepFake Detection

abstract: Audio DeepFakes are utterances generated with the use of deep neural networks. They are highly misleading and pose a threat due to use in fake news, impersonation, or extortion. In this work, we focus on increasing accessibility to the audio DeepFake detection methods by providing SpecRNet, a neural network architecture characterized by a quick inference time and low computational requirements. Our benchmark shows that SpecRNet, requiring up to about 40% less time to process an audio sample, provides performance comparable to LCNN architecture - one of the best audio DeepFake detection models. Such a method can not only be used by online multimedia services to verify a large bulk of content uploaded daily but also, thanks to its low requirements, by average citizens to evaluate materials on their devices. In addition, we provide benchmarks in three unique settings that confirm the correctness of our model. They reflect scenarios of low-resource datasets, detection on short utterances and limited attacks benchmark in which we take a closer look at the influence of particular attacks on given architectures.


title: DiPA: Probabilistic Multi-Modal Interactive Prediction for Autonomous Driving

abstract: Accurate prediction is important for operating an autonomous vehicle in interactive scenarios. Prediction must be fast, to support multiple requests from a planner exploring a range of possible futures. The generated predictions must accurately represent the probabilities of predicted trajectories, while also capturing different modes of behaviour (such as turning left vs continuing straight at a junction). To this end, we present DiPA, an interactive predictor that addresses these challenging requirements. Previous interactive prediction methods use an encoding of k-mode-samples, which under-represents the full distribution. Other methods optimise closest-mode evaluations, which test whether one of the predictions is similar to the ground-truth, but allow additional unlikely predictions to occur, over-representing unlikely predictions. DiPA addresses these limitations by using a Gaussian-Mixture-Model to encode the full distribution, and optimising predictions using both probabilistic and closest-mode measures. These objectives respectively optimise probabilistic accuracy and the ability to capture distinct behaviours, and there is a challenging trade-off between them. We are able to solve both together using a novel training regime. DiPA achieves new state-of-the-art performance on the INTERACTION and NGSIM datasets, and improves over the baseline (MFP) when both closest-mode and probabilistic evaluations are used. This demonstrates effective prediction for supporting a planner on interactive scenarios.


title: Vulnerabilities of Single-Round Incentive Compatibility in Auto-bidding: Theory and Evidence from ROI-Constrained Online Advertising Markets

abstract: Most of the work in the auction design literature assumes that bidders behave rationally based on the information available for every individual auction, and the revelation principle enables designers to restrict their efforts to incentive compatible (IC) mechanisms. However, in today's online advertising markets, one of the most important real-life applications of auction design, the data and computational power required to bid optimally are only available to the platform, and an advertiser can only participate by setting performance objectives and constraints for its proxy auto-bidder provided by the platform. The prevalence of auto-bidding necessitates a review of auction theory. In this paper, we examine the markets through the lens of ROI-constrained value-maximizing campaigns. We show that second price auction exhibits many undesirable properties (computational hardness, non-monotonicity, instability of bidders' utilities, and interference in A/B testing) and loses its dominant theoretical advantages in single-item scenarios. In addition, we make it clear how IC and its runner-up-winner interdependence contribute to each property. We hope that our work could bring new perspectives to the community and benefit practitioners to attain a better grasp of real-world markets.


title: Reconstructing Personalized Semantic Facial NeRF Models From Monocular Video

abstract: We present a novel semantic model for human head defined with neural radiance field. The 3D-consistent head model consist of a set of disentangled and interpretable bases, and can be driven by low-dimensional expression coefficients. Thanks to the powerful representation ability of neural radiance field, the constructed model can represent complex facial attributes including hair, wearings, which can not be represented by traditional mesh blendshape. To construct the personalized semantic facial model, we propose to define the bases as several multi-level voxel fields. With a short monocular RGB video as input, our method can construct the subject's semantic facial NeRF model with only ten to twenty minutes, and can render a photo-realistic human head image in tens of miliseconds with a given expression coefficient and view direction. With this novel representation, we apply it to many tasks like facial retargeting and expression editing. Experimental results demonstrate its strong representation ability and training/inference speed. Demo videos and released code are provided in our project page: https://ustc3dv.github.io/NeRFBlendShape/


title: CATCH: Chasing All Transients Constellation Hunters Space Mission

abstract: In time-domain astronomy, a substantial number of transients will be discovered by multi-wavelength and multi-messenger observatories, posing a great challenge for follow-up capabilities. We have thus proposed an intelligent X-ray constellation, the Chasing All Transients Constellation Hunters (CATCH) space mission. Consisting of 126 micro-satellites in three types, CATCH will have the capability to perform follow-up observations for a large number of different types of transients simultaneously. Each satellite in the constellation will carry lightweight X-ray optics and use a deployable mast to increase the focal length. The combination of different optics and detector systems enables different types of satellites to have multiform observation capabilities, including timing, spectroscopy, imaging, and polarization. Controlled by the intelligent system, different satellites can cooperate to perform uninterrupted monitoring, all-sky follow-up observations, and scanning observations with a flexible field of view (FOV) and multi-dimensional observations. Therefore, CATCH will be a powerful mission to study the dynamic universe. Here, we present the current design of the spacecraft, optics, detector system, constellation configuration and observing modes, as well as the development plan.


title: Uplift and Upsample: Efficient 3D Human Pose Estimation with Uplifting Transformers

abstract: The state-of-the-art for monocular 3D human pose estimation in videos is dominated by the paradigm of 2D-to-3D pose uplifting. While the uplifting methods themselves are rather efficient, the true computational complexity depends on the per-frame 2D pose estimation. In this paper, we present a Transformer-based pose uplifting scheme that can operate on temporally sparse 2D pose sequences but still produce temporally dense 3D pose estimates. We show how masked token modeling can be utilized for temporal upsampling within Transformer blocks. This allows to decouple the sampling rate of input 2D poses and the target frame rate of the video and drastically decreases the total computational complexity. Additionally, we explore the option of pre-training on large motion capture archives, which has been largely neglected so far. We evaluate our method on two popular benchmark datasets: Human3.6M and MPI-INF-3DHP. With an MPJPE of 45.0 mm and 46.9 mm, respectively, our proposed method can compete with the state-of-the-art while reducing inference time by a factor of 12. This enables real-time throughput with variable consumer hardware in stationary and mobile applications. We release our code and models at https://github.com/goldbricklemon/uplift-upsample-3dhpe


title: THUEE system description for NIST 2020 SRE CTS challenge

abstract: This paper presents the system description of the THUEE team for the NIST 2020 Speaker Recognition Evaluation (SRE) conversational telephone speech (CTS) challenge. The subsystems including ResNet74, ResNet152, and RepVGG-B2 are developed as speaker embedding extractors in this evaluation. We used combined AM-Softmax and AAM-Softmax based loss functions, namely CM-Softmax. We adopted a two-staged training strategy to further improve system performance. We fused all individual systems as our final submission. Our approach leads to excellent performance and ranks 1st in the challenge.


title: Fast Bayesian Updates for Deep Learning with a Use Case in Active Learning

abstract: Retraining deep neural networks when new data arrives is typically computationally expensive. Moreover, certain applications do not allow such costly retraining due to time or computational constraints. Fast Bayesian updates are a possible solution to this issue. Therefore, we propose a Bayesian update based on Monte-Carlo samples and a last-layer Laplace approximation for different Bayesian neural network types, i.e., Dropout, Ensemble, and Spectral Normalized Neural Gaussian Process (SNGP). In a large-scale evaluation study, we show that our updates combined with SNGP represent a fast and competitive alternative to costly retraining. As a use case, we combine the Bayesian updates for SNGP with different sequential query strategies to exemplarily demonstrate their improved selection performance in active learning.


title: Timestamp tokens: a better coordination primitive for data-processing systems

abstract: Distributed data processing systems have advanced through models that expose more and more opportunities for concurrency within a computation. The scheduling of these increasingly sophisticated models has become the bottleneck for improved throughput and reduced latency. We present a new coordination primitive for dataflow systems, the timestamp token, which minimizes the volume of information shared between the computation and host system, without surrendering precision about concurrency. Several projects have now used timestamp tokens, and were able to explore computational idioms that could not be expressed easily, if at all, in other platforms. Importantly, these projects did not need to design and implement whole systems to support their research.


title: Nucleon-nucleon correlations inside atomic nuclei: synergies, observations and theoretical models

abstract: While the main features of atomic nuclei are well described by nuclear mean-field models, there is a large and growing body of evidence which indicates an important additional role played by spatially-correlated nucleon-nucleon structures. The role of nucleonic structures was first suggested by Heidmann in 1950 to explain pick-up reactions of energetic nucleons. Since then a steady flux of new experimental evidence has confirmed the presence of similar structures inside atomic nuclei, dominated by correlations between pairs of nucleons. The role of these internal nucleon-nucleon correlations has been established using various energetic probes like photons, pions, leptons and hadrons. These correlated structures are essential for understanding the interaction of particles with nuclei and their presence provides an explanation of many specific nuclear phenomena including backscattered protons, copious deuteron production, sub-threshold particle production, neutrino interactions with nuclei and the EMC effect. On the theoretical side, these measurements have stimulated a large number of phenomenological models specifically devised to address these enigmatic observations. While reviews exist for specific interactions, there is currently no published commentary which systematically encompasses the wide range of experimental signatures and theoretical frameworks developed thus far. The present review draws together the synergies between a wide range of different experimental and theoretical studies, summarises progress in this area and highlights outstanding issues for further study.


title: Traffic disruption modelling with mode shift in multi-modal networks

abstract: A multi-modal transport system is acknowledged to have robust failure tolerance and can effectively relieve urban congestion issues. However, estimating the impact of disruptions across multi-transport modes is a challenging problem due to a dis-aggregated modelling approach applied to only individual modes at a time. To fill this gap, this paper proposes a new integrated modelling framework for a multi-modal traffic state estimation and evaluation of the disruption impact across all modes under various traffic conditions. First, we propose an iterative trip assignment model to elucidate the association between travel demand and travel behaviour, including a multi-modal origin-to-destination estimation for private and public transport. Secondly, we provide a practical multi-modal travel demand re-adjustment that takes the mode shift of the affected travellers into consideration. The pros and cons of the mode shift strategy are showcased via several scenario-based transport simulating experiments. The results show that a well-balanced mode shift with flexible routing and early announcements of detours so that travellers can plan ahead can significantly benefit all travellers by a delay time reduction of 46%, while a stable route assignment maintains a higher average traffic flow and the inactive mode-route choice help relief density under the traffic disruptions.


title: Self-stabilization and byzantine tolerance for maximal independent

abstract: We analyze the impact of transient and Byzantine faults on the construction of a maximal independent set in a general network. We adapt the self-stabilizing algorithm presented by Turau `for computing such a vertex set. Our algorithm is self-stabilizing and also works under the more difficult context of arbitrary Byzantine faults. Byzantine nodes can prevent nodes close to them from taking part in the independent set for an arbitrarily long time. We give boundaries to their impact by focusing on the set of all nodes excluding nodes at distance 1 or less of Byzantine nodes, and excluding some of the nodes at distance 2. As far as we know, we present the first algorithm tolerating both transient and Byzantine faults under the fair distributed daemon. We prove that this algorithm converges in $ \mathcal O(\Delta n)$ rounds w.h.p., where $n$ and $\Delta$ are the size and the maximum degree of the network, resp. Additionally, we present a modified version of this algorithm for anonymous systems under the adversarial distributed daemon that converges in $ \mathcal O(n^{2})$ expected number of steps.


title: Decaying Dark Matter and Lyman-$\alpha$ forest constraints

abstract: Decaying Cold Dark Matter (DCDM) is a model that is currently under investigation regarding primarily the $S_8$ tension between cosmic microwave background (CMB) and certain large-scale structure measurements. The decay into one massive and one (or more) massless daughter particle(s) leads to a suppression of the power spectrum in the late universe that depends on the relative mass splitting $\epsilon=(1-m^2/M^2)/2$ between the mother and massive daughter particle as well as the lifetime $\tau$. In this work we investigate the impact of the BOSS DR14 one-dimensional Lyman-$\alpha$ forest flux power spectrum on the DCDM model using a conservative effective model approach to account for astrophysical uncertainties. Since the suppression of the power spectrum due to decay builds up at low redshift, we find that regions in parameter space that address the $S_8$ tension can be well compatible with the Lyman-$\alpha$ forest. Nevertheless, for values of the degeneracy parameter $\epsilon\sim 0.1-0.5\%$, for which the power suppression occurs within the scales probed by BOSS Lyman-$\alpha$ data, we find improved constraints compared to previous CMB and galaxy clustering analyses, obtaining $\tau\gtrsim 18$ Gyrs for small mass splitting. Furthermore, our analysis of the BOSS Lyman-$\alpha$ flux power spectrum allows for values $\tau\sim 10^2$ Gyrs, $\epsilon\sim 1\%$, that have been found to be preferred by a combination of Planck and galaxy clustering data with a KiDS prior on $S_8$, and we even find a marginal preference within this regime.


title: Towards Mining Creative Thinking Patterns from Educational Data

abstract: Creativity, i.e., the process of generating and developing fresh and original ideas or products that are useful or effective, is a valuable skill in a variety of domains. Creativity is called an essential 21st-century skill that should be taught in schools. The use of educational technology to promote creativity is an active study field, as evidenced by several studies linking creativity in the classroom to beneficial learning outcomes. Despite the burgeoning body of research on adaptive technology for education, mining creative thinking patterns from educational data remains a challenging task. In this paper, to address this challenge, we put the first step towards formalizing educational knowledge by constructing a domain-specific Knowledge Base to identify essential concepts, facts, and assumptions in identifying creative patterns. We then introduce a pipeline to contextualize the raw educational data, such as assessments and class activities. Finally, we present a rule-based approach to learning from the Knowledge Base, and facilitate mining creative thinking patterns from contextualized data and knowledge. We evaluate our approach with real-world datasets and highlight how the proposed pipeline can help instructors understand creative thinking patterns from students' activities and assessment tasks.


title: The smallest bimolecular mass-action system with a vertical Andronov-Hopf bifurcation

abstract: We present a three-dimensional differential equation, which robustly displays a degenerate Andronov-Hopf bifurcation of infinite codimension, leading to a center, i.e., an invariant two-dimensional surface that is filled with periodic orbits surrounding an equilibrium. The system arises from a three-species bimolecular chemical reaction network consisting of four reactions. In fact, it is the only such mass-action system that admits a center via an Andronov-Hopf bifurcation.


title: Efficient Gaussian Process Model on Class-Imbalanced Datasets for Generalized Zero-Shot Learning

abstract: Zero-Shot Learning (ZSL) models aim to classify object classes that are not seen during the training process. However, the problem of class imbalance is rarely discussed, despite its presence in several ZSL datasets. In this paper, we propose a Neural Network model that learns a latent feature embedding and a Gaussian Process (GP) regression model that predicts latent feature prototypes of unseen classes. A calibrated classifier is then constructed for ZSL and Generalized ZSL tasks. Our Neural Network model is trained efficiently with a simple training strategy that mitigates the impact of class-imbalanced training data. The model has an average training time of 5 minutes and can achieve state-of-the-art (SOTA) performance on imbalanced ZSL benchmark datasets like AWA2, AWA1 and APY, while having relatively good performance on the SUN and CUB datasets.


title: Specializing Scope Graph Resolution Queries: Extended Edition

abstract: To warrant programmer productivity, type checker results should be correct and available quickly. Correctness can be provided when a type checker implementation corresponds to a declarative type system specification. Statix is a type system specification language which achieves this by automatically deriving type checker implementations from declarative typing rules. A key feature of Statix is that it uses scope graphs for declarative specification of name resolution. However, compared to hand-written type checkers, type checkers derived from Statix specifications have sub-optimal run time performance. In this paper, we identify and resolve a performance bottleneck in the Statix solver, namely part of the name resolution algorithm, using partial evaluation. To this end, we introduce a tailored procedural intermediate query resolution language, and provide a specializer that translates declarative queries to this language. Evaluating this specializer by comparing type checking run time performance on three benchmarks (Apache Commons CSV, IO, and Lang3), shows that our specializer improves query resolution time up to 7.7x, which reduces the total type checking run time by 38 - 48%.


title: Self-action of electromagnetic charge in a wormhole with an infinitely short throat

abstract: The self-force of the electromagnetic charge in the space-time of a wormhole with an infinitely short throat is calculated. It is assumed that the charge is a source of an electromagnetic field that is in non-minimal connection with the curvature of space-time.


title: Backward problem for the 1D ionic Vlasov-Poisson equation

abstract: In this paper, we study the backward problem for the one-dimensional Vlasov-Poisson system with massless electrons, and we show the Landau damping by fixing the asymptotic behaviour of our solution.


title: Elastic buildings: Calibrated district-scale simulation of occupant-flexible campus operation for hybrid work optimization

abstract: Before 2020, the way occupants utilized the built environment had been changing slowly towards scenarios in which occupants have more choice and flexibility in where and how they work. The global COVID-19 pandemic accelerated this phenomenon rapidly through lockdowns and hybrid work arrangements. Many occupants and employers are considering keeping some of these flexibility-based strategies due to their benefits and cost impacts. This paper simulates various scenarios related to the operational technologies and policies of a real-world campus using a district-scale City Energy Analyst (CEA) model that is calibrated with measured energy and occupancy profiles extracted from WiFi data. These scenarios demonstrate the energy impact of ramping building operations up and down more rapidly and effectively to the flex-based work strategies that may solidify. The scenarios show a 4-12% decrease in space cooling demand due to occupant absenteeism if centralized building system operation is in place, but as high as 21-68% if occupancy-driven building controls are implemented. The paper discusses technologies and strategies that are important in this paradigm shift of operations.


title: Return of Harrison-Zeldovich spectrum in light of recent cosmological tensions

abstract: The spectral index $n_s$ of scalar perturbation is the significant initial condition set by inflation theory for our observable Universe. According to Planck results, current constraint is $n_s = 0.965\pm 0.004$, while an exact scale-invaiant Harrison-Zeldovich spectrum, i.e. $n_s=1$, has been ruled out at $8.4\sigma$ significance level. However, it is well-known that the standard $\Lambda$CDM model is suffering from the Hubble tension, which is at $\sim 5\sigma$ significance level. This inconsistency likely indicates that the comoving sound horizon at last scattering surface is actually lower than expected, which so seems to be calling for the return of $n_s=1$. Here, in light of recent observations we find strong evidence for a $n_s=1$ Universe. And we show that if so, it would be confirmed conclusively by CMB-S4 experiment.


title: Regularized Graph Structure Learning with Semantic Knowledge for Multi-variates Time-Series Forecasting

abstract: Multivariate time-series forecasting is a critical task for many applications, and graph time-series network is widely studied due to its capability to capture the spatial-temporal correlation simultaneously. However, most existing works focus more on learning with the explicit prior graph structure, while ignoring potential information from the implicit graph structure, yielding incomplete structure modeling. Some recent works attempt to learn the intrinsic or implicit graph structure directly while lacking a way to combine explicit prior structure with implicit structure together. In this paper, we propose Regularized Graph Structure Learning (RGSL) model to incorporate both explicit prior structure and implicit structure together, and learn the forecasting deep networks along with the graph structure. RGSL consists of two innovative modules. First, we derive an implicit dense similarity matrix through node embedding, and learn the sparse graph structure using the Regularized Graph Generation (RGG) based on the Gumbel Softmax trick. Second, we propose a Laplacian Matrix Mixed-up Module (LM3) to fuse the explicit graph and implicit graph together. We conduct experiments on three real-word datasets. Results show that the proposed RGSL model outperforms existing graph forecasting algorithms with a notable margin, while learning meaningful graph structure simultaneously. Our code and models are made publicly available at https://github.com/alipay/RGSL.git.


title: Motion-resolved fat-fraction mapping with whole-heart free-running multiecho gre and pilot tone

abstract: PURPOSE To develop free-running multi-echo GRE for cardiac- and respiratory-motion-resolved whole-heart fat fraction quantification. METHODS Multi-echo readouts optimized for water-fat separation and quantification were integrated within a non-ECG-triggered free-breathing 3D radial GRE acquisition. Pilot Tone navigation was used to extract cardiac and respiratory motion states. Following a XD-GRASP based image reconstruction of the separate echoes, fat fraction, water fraction, R2star and B0 maps, as well as fat and water images, were generated with a maximum likelihood fitting algorithm using graph cuts. The acquisition, reconstruction and post-processing framework was tested in 10 healthy volunteers at 1.5T and compared to a free-breathing ECG-triggered 5-echo acquisition. RESULTS The acquisition was successfully validated in vivo, with motion compensation achieved over all collected echoes, in both respiratory and cardiac dimensions. Pilot Tone navigation provided respiratory and cardiac signals in good agreement (r=0.954 and r=0.783, respectively) with self-gating signal extraction based on the MR data of the first echo. The framework enabled pericardial fat imaging and quantification across the cardiac cycle, revealing a decrease in apparent FF at systole across volunteers. 3D motion-resolved fat fraction maps showed good correlation with reference ECG-triggered measurements, as well as significant difference in measurements performed with NTE = 4 and NTE = 8 echoes (P < 0.0001 in chest fat and P < 0.01 in pericardial fat). CONCLUSION Volunteer experiments at 1.5T demonstrated the feasibility of a whole-heart free-running fat-fraction mapping technique for cardiac MRI in a 6 min scan time, with a resolution of 2mm3 isotropic.


title: Thermal Casimir effect in the Einstein Universe with a spherical boundary

abstract: In the present paper we investigate thermal fluctuation corrections to the vacuum energy at zero temperature of a conformally coupled massless scalar field whose modes propagate in the Einstein universe with a spherical boundary, characterized by both Dirichlet and Neumann boundary conditions. Thus, we generalize the results found in literature in this scenario, which has considered only the vacuum energy at zero temperature. To do this, we use the generalized zeta function method plus Abel-Plana formula and calculate the renormalized Casimir free energy as well as other thermodynamics quantities, namely, internal energy and entropy. For each one of them we also investigate the limits of high and low temperatures. At high temperatures we found that the renormalized Casimir free energy presents classical contributions, along with a logarithmic term. Also in this limit, the internal energy presents a classical contribution and the entropy a logarithmic term in addition to a classical contribution as well. Conversely, at low temperatures, it is shown that both the renormalized Casimir free energy and internal energy are dominated by the vacuum energy at zero temperature. It is also shown that the entropy obeys the third law of thermodynamics.


title: Observation of Gapped Dirac Cones in a Two-Dimensional Su-Schrieffer-Heeger Lattice

abstract: The Su-Schrieffer-Heeger (SSH) model in a two-dimensional rectangular lattice features gapless or gapped Dirac cones with topological edge states along specific peripheries. While such a simple model has been recently realized in photonic/acoustic lattices and electric circuits, its material realization in condensed matter systems is still lacking. Here, we study the atomic and electronic structure of a rectangular Si lattice on Ag(001) by angle-resolved photoemission spectroscopy and theoretical calculations. We demonstrate that the Si lattice hosts gapped Dirac cones at the Brillouin zone corners. Our tight-binding analysis reveals that the Dirac bands can be described by a 2D SSH model with anisotropic polarizations. The gap of the Dirac cone is driven by alternative hopping amplitudes in one direction and staggered potential energies in the other one and hosts topological edge states. Our results establish an ideal platform to explore the rich physical properties of the 2D SSH model.


title: Weak convergence of the extremes of branching L\'evy processes with regularly varying tails

abstract: In this paper, we study the weak convergence of the extremes of supercritical branching L\'evy processes $\{\mathbb{X}_t, t \ge0\}$ whose spatial motions are L\'evy processes with regularly varying tails. The result is drastically different from the case of branching Brownian motions. We prove that, when properly renormalized, $\mathbb{X}_t$ converges weakly. As a consequence, we obtain a limit theorem for the order statistics of $\mathbb{X}_t$.


title: Limit cycles for dynamic crawling locomotors with periodic prescribed shape

abstract: We study the asymptotic behaviour of a family of dynamic models of crawling locomotion, with the aim of characterizing a gait as a limit property. The locomotors, which might have a discrete or continuous body, move on a line with a periodic prescribed shape change, and might possibly be subject to external forcing (e.g., crawling on a slope). We discuss how their behaviour is affected by different types of friction forces, including also set-valued ones such as dry friction. We show that, under mild natural assumptions, the dynamics always converge to a relative periodic solution. The asymptotic average velocity of the crawler yet might still depend on its initial state, so we provide additional assumption for its uniqueness. In particular, we show that the asymptotic average velocity is unique both for strictly monotone friction forces, and also for dry friction, provided in the latter case that the actuation is sufficiently smooth (for discrete models) or that the friction coefficients are always nonzero (for continuous models). We present several examples and counterexamples illustrating the necessity of our assumptions.


title: Integrating Accessibility in a Mobile App Development Course

abstract: The growing interest in accessible software reflects in computing educators' and education researchers' efforts to include accessibility in core computing education. We integrated accessibility in a junior/senior-level Android app development course at a large private university in India. The course introduced three accessibility-related topics using various interventions: Accessibility Awareness (a guest lecture by a legal expert), Technical Knowledge (lectures on Android accessibility guidelines and testing practices and graded components for implementing accessibility in programming assignments), and Empathy (an activity that required students to blindfold themselves and interact with their phones using a screen-reader). We evaluated their impact on student learning using three instruments: (A) A pre/post-course questionnaire, (B) Reflective questions on each of the four programming assignments, and (C) Midterm and Final exam questions. Our findings demonstrate that: (A) significantly more ($p<.05$) students considered disabilities when designing an app after taking this course, (B) many students developed empathy towards the challenges persons with disabilities face while using inaccessible apps, and (C) all students could correctly identify at least one accessibility issue in the user interface of a real-world app given its screenshot, and 90% of them could provide a correct solution to fix it.


title: Rotational decoherence due to thermal photon scattering

abstract: The use of rotational degrees of freedom of quantum systems in quantum technologies is limited by environmental effects under decoherence mechanism. Here, we study the mechanism of decoherence based on a new formalism of elastic scattering for a nonspherical quantum system prepared in a superposition of rotational degrees of freedom. We show that for a dielectric ellipsoid immersed in an environment composed of thermal photons the rotational decoherence rate depends on the angular differences between the two configurations of the system and the seventh power of the temperature which is different from the translational one. Then we analyze the effect of different values of angular momentum quantum numbers of the environmental spherical harmonics on the rotational decoherence rate.


title: Identity, Crimes, and Law Enforcement in the Metaverse

abstract: With the boom in metaverse-related projects in major areas of the public's life, the safety of users becomes a pressing concern. We believe that an international legal framework should be established to promote collaboration among nations, facilitate crime investigation, and support democratic governance. In this paper, we discuss the legal concerns of identity, crimes that could occur based on incidents in existing virtual worlds, and challenges to unified law enforcement in the metaverse.


title: Spectral properties of locally eventually positive operator semigroups

abstract: This paper considers strongly continuous semigroups of operators on Banach lattices which are locally eventually positive, a property that was first investigated in the context of concrete fourth-order evolution equations. We construct a simple example to show that the typical assumptions on the spectrum of the semigroup generator considered currently in the literature are far from necessary in the more general setting of local eventual positivity. Under minimal additional assumptions, we obtain results on the asymptotic behaviour of orbits, as well as necessary conditions on the peripheral point spectrum of locally eventually positive semigroups.


title: On a class of functional difference equations: explicit solutions, asymptotic behavior and applications

abstract: For $\nu\in[0,1]$ and a complex parameter $\sigma,$ $Re\, \sigma>0,$ we discuss a linear inhomogeneous functional difference equation with variable coefficients on a complex plane $z\in\mathbb{C}$: \[ (a_{1}\sigma+a_{2}\sigma^{\nu})\mathcal{Y}(z+\beta,\sigma)-\Omega(z)\mathcal{Y}(z,\sigma)=\mathbb F(z,\sigma), \quad\beta\in\mathbb{R},\, \beta\neq 0, \] where $\Omega(z)$ and $\mathbb{F}(z)$ are given complex functions, while $a_{1}$ and $a_{2}$ are given real non-negative numbers. Under suitable conditions on the given functions and parameters, we construct explicit solutions of the equation and describe their asymptotic behavior as $|z|\to +\infty$. Some applications to the theory of functional difference equations and to the theory of boundary value problems governed by subdiffusion in nonsmooth domains are then discussed.


title: Nonlinear multi-frequency phonon lasers with active levitated optomechanics

abstract: Phonon lasers, exploiting coherent amplifications of phonons, have been a cornerstone for exploring nonlinear phononics, imaging nanomaterial structures, and operating phononic devices. Very recently, by levitating a nanosphere in an optical tweezer, a single-mode phonon laser governed by dispersive optomechanical coupling has been demonstrated, assisted by alternating mechanical nonlinear cooling and linear heating. Such levitated optomechanical (LOM) devices, with minimal noises in high vacuum, can allow flexible control of large-mass objects without any internal discrete energy levels. However, untill now, it is still elusive to realize phonon lasing with levitated microscale objects, due to much stronger optical scattering losses. Here, by employing a Yb3+-doped active system, we report the first experiment on nonlinear multi-frequency phonon lasers with a micro-size sphere governed instead by dissipative LOM coupling. In this work, active gain plays a key role since not only 3-order enhancement can be achieved for the amplitude of the fundamental-mode phonon lasing, compared with the passive device, but also nonlinear mechanical harmonics can emerge spontaneously above the lasing threshold. Furthermore, for the first time, coherent correlations of phonons are observed for both the fundamental mode and its harmonics. Our work drives the field of LOM technology into a new regime where it becomes promising to engineer collective motional properties of typical micro-size objects, such as atmospheric particulates and living cells, for a wide range of applications in e.g., acoustic sensing, gravimetry, and inertial navigation.


title: Improved Data Augmentation for Translation Suggestion

abstract: Translation suggestion (TS) models are used to automatically provide alternative suggestions for incorrect spans in sentences generated by machine translation. This paper introduces the system used in our submission to the WMT'22 Translation Suggestion shared task. Our system is based on the ensemble of different translation architectures, including Transformer, SA-Transformer, and DynamicConv. We use three strategies to construct synthetic data from parallel corpora to compensate for the lack of supervised data. In addition, we introduce a multi-phase pre-training strategy, adding an additional pre-training phase with in-domain data. We rank second and third on the English-German and English-Chinese bidirectional tasks, respectively.


title: Zero-Knowledge Optimal Monetary Policy under Stochastic Dominance

abstract: Optimal simple rules for the monetary policy of the first stochastically dominant crypto-currency are derived in a Dynamic Stochastic General Equilibrium (DSGE) model, in order to provide optimal responses to changes in inflation, output, and other sources of uncertainty. The optimal monetary policy stochastically dominates all the previous crypto-currencies, thus the efficient portfolio is to go long on the stochastically dominant crypto-currency: a strategy-proof arbitrage featuring a higher Omega ratio with higher expected returns, inducing an investment-efficient Nash equilibrium over the crypto-market. Zero-knowledge proofs of the monetary policy are committed on the blockchain: an implementation is provided.


title: Differentially Private Bootstrap: New Privacy Analysis and Inference Strategies

abstract: Differentially private (DP) mechanisms protect individual-level information by introducing randomness into the statistical analysis procedure. Despite the availability of numerous DP tools, there remains a lack of general techniques for conducting statistical inference under DP. We examine a DP bootstrap procedure that releases multiple private bootstrap estimates to infer the sampling distribution and construct confidence intervals (CIs). Our privacy analysis presents new results on the privacy cost of a single DP bootstrap estimate, applicable to any DP mechanisms, and identifies some misapplications of the bootstrap in the existing literature. Using the Gaussian-DP (GDP) framework (Dong et al.,2022), we show that the release of $B$ DP bootstrap estimates from mechanisms satisfying $(\mu/\sqrt{(2-2/\mathrm{e})B})$-GDP asymptotically satisfies $\mu$-GDP as $B$ goes to infinity. Moreover, we use deconvolution with the DP bootstrap estimates to accurately infer the sampling distribution, which is novel in DP. We derive CIs from our density estimate for tasks such as population mean estimation, logistic regression, and quantile regression, and we compare them to existing methods using simulations and real-world experiments on 2016 Canada Census data. Our private CIs achieve the nominal coverage level and offer the first approach to private inference for quantile regression.


title: Pure spinors in classical and quantum supergravity

abstract: This is an overview of the method of pure spinor superfields, written for "Handbook of Quantum Gravity", eds. C. Bambi, L. Modesto and I. Shapiro. The main focus is on the use of the formalism in maximal supergravity on a flat background. The basics of pure spinor superfields, and their relation to standard superspace, is reviewed. The pure spinor superstring model of Berkovits is briefly discussed. Consequences for divergence properties of loop diagrams in maximal supergravity are restated. Some final remarks are made concerning desirable development of the theoretical framework.


title: Creation of wormholes during the cosmological bounce

abstract: In this work we demonstrate that wormholes can in principle be naturally created during the cosmological bounce without the need for the exotic matter or any kind of additional modifications of the gravitational sector, apart from the one enabling the cosmological bounce. This result is general and does not depend on the details of the modifications of gravitational equations needed to support the bounce. To study the possible existence of wormholes around the cosmological bounce we introduce general modifications of Einstein's field equations need to support the bouncing solutions. In this regime we show that it is possible to construct a cosmological wormhole solution supported by matter, radiation and vacuum energy, satisfying the Weak Energy Condition (WEC), which asymptotically approaches the Friedmann-Lema\^{i}tre-Robertson-Walker (FLRW) metric. However, at a specific cosmological time, which depends on the parameters of the bouncing cosmological model, the WEC describing the matter needed to support such wormholes is spontaneously violated. This means that such wormholes could potentially exist in large numbers during some period around the bounce, significantly changing the causal structure of space-time, and then vanish afterwards.


title: On the Importance of Gradient Norm in PAC-Bayesian Bounds

abstract: Generalization bounds which assess the difference between the true risk and the empirical risk, have been studied extensively. However, to obtain bounds, current techniques use strict assumptions such as a uniformly bounded or a Lipschitz loss function. To avoid these assumptions, in this paper, we follow an alternative approach: we relax uniform bounds assumptions by using on-average bounded loss and on-average bounded gradient norm assumptions. Following this relaxation, we propose a new generalization bound that exploits the contractivity of the log-Sobolev inequalities. These inequalities add an additional loss-gradient norm term to the generalization bound, which is intuitively a surrogate of the model complexity. We apply the proposed bound on Bayesian deep nets and empirically analyze the effect of this new loss-gradient norm term on different neural architectures.


title: Digital twins of nonlinear dynamical systems

abstract: We articulate the design imperatives for machine-learning based digital twins for nonlinear dynamical systems subject to external driving, which can be used to monitor the ``health'' of the target system and anticipate its future collapse. We demonstrate that, with single or parallel reservoir computing configurations, the digital twins are capable of challenging forecasting and monitoring tasks. Employing prototypical systems from climate, optics and ecology, we show that the digital twins can extrapolate the dynamics of the target system to certain parameter regimes never experienced before, make continual forecasting/monitoring with sparse real-time updates under non-stationary external driving, infer hidden variables and accurately predict their dynamical evolution, adapt to different forms of external driving, and extrapolate the global bifurcation behaviors to systems of some different sizes. These features make our digital twins appealing in significant applications such as monitoring the health of critical systems and forecasting their potential collapse induced by environmental changes.


title: Can Artificial Intelligence Reconstruct Ancient Mosaics?

abstract: A large number of ancient mosaics have not reached us because they have been destroyed by erosion, earthquakes, looting or even used as materials in newer construction. To make things worse, among the small fraction of mosaics that we have been able to recover, many are damaged or incomplete. Therefore, restoration and reconstruction of mosaics play a fundamental role to preserve cultural heritage and to understand the role of mosaics in ancient cultures. This reconstruction has traditionally been done manually and more recently using computer graphics programs but always by humans. In the last years, Artificial Intelligence (AI) has made impressive progress in the generation of images from text descriptions and reference images. State of the art AI tools such as DALL-E2 can generate high quality images from text prompts and can take a reference image to guide the process. In august 2022, DALL-E2 launched a new feature called outpainting that takes as input an incomplete image and a text prompt and then generates a complete image filling the missing parts. In this paper, we explore whether this innovative technology can be used to reconstruct mosaics with missing parts. Hence a set of ancient mosaics have been used and reconstructed using DALL-E2; results are promising showing that AI is able to interpret the key features of the mosaics and is able to produce reconstructions that capture the essence of the scene. However, in some cases AI fails to reproduce some details, geometric forms or introduces elements that are not consistent with the rest of the mosaic. This suggests that as AI image generation technology matures in the next few years, it could be a valuable tool for mosaic reconstruction going forward.


title: Congruences for partial sums of the generating series for $\binom{3k}{k}$

abstract: We produce congruences modulo a prime $p>3$ for sums $\sum_k\binom{3k}{k}x^k$ over ranges $0\le k<q$ and $0\le k<q/3$, where $q$ is a power of $p$. Here $x$ equals either $c^2/(1-c)^3$, or $4s^2/\bigl(27(s^2-1)\bigr)$, where $c$ and $s$ are indeterminates. In the former case we deal more generally with shifted binomial coefficients $\binom{3k+e}{k}$. Our method derives such congruences directly from closed forms for the corresponding series.


title: Beyond the classical Cauchy-Born rule

abstract: Physically motivated variational problems involving non-convex energies are often formulated in a discrete setting and contain boundary conditions. The long-range interactions in such problems, combined with constraints imposed by lattice discreteness, can give rise to the phenomenon of geometric frustration even in a one-dimensional setting. While non-convexity entails the formation of microstructures, incompatibility between interactions operating at different scales can produce nontrivial mixing effects which are exacerbated in the case of incommensuration between the optimal microstructures and the scale of the underlying lattice. Unraveling the intricacies of the underlying interplay between non-convexity, non-locality and discreteness, represents the main goal of this study. While in general one cannot expect that ground states in such problems possess global properties, such as periodicity, in some cases the appropriately defined global solutions exist, and are sufficient to describe the corresponding continuum (homogenized) limits. We interpret those cases as complying with a Generalized Cauchy-Born (GCB) rule, and present a new class of problems with geometrical frustration which comply with GCB rule in one range of (loading) parameters while being strictly outside this class in a complementary range. A general approach to problems with such mixed behavior is developed.


title: Monte-Carlo Estimation of CoVaR

abstract: ${\rm CoVaR}$ is one of the most important measures of financial systemic risks. It is defined as the risk of a financial portfolio conditional on another financial portfolio being at risk. In this paper we first develop a Monte-Carlo simulation-based batching estimator of CoVaR and study its consistency and asymptotic normality. We show that the optimal rate of convergence of the batching estimator is $n^{-1/3}$, where $n$ is the sample size. We then develop an importance-sampling inspired estimator under the delta-gamma approximations to the portfolio losses, and we show that the rate of convergence of the estimator is $n^{-1/2}$. Numerical experiments support our theoretical findings and show that both estimators work well.


title: On the Internal Stability of Diffusively Coupled Multi-Agent Systems and the Dangers of Cancel Culture

abstract: We study internal stability in the context of diffusively-coupled control architectures, common in multi-agent systems (i.e. the celebrated consensus protocol), for linear time-invariant agents. We derive a condition under which the system can not be stabilized by any controller from that class. In the finite-dimensional case the condition states that diffusive controllers cannot stabilize agents that share common unstable dynamics, directions included. This class always contains the group of homogeneous unstable agents, like integrators. We argue that the underlying reason is intrinsic cancellations of unstable agent dynamics by such controllers, even static ones, where directional properties play a key role. The intrinsic lack of internal stability explains the notorious behavior of some distributed control protocols when affected by measurement noise or exogenous disturbances.


title: Annotating Norwegian Language Varieties on Twitter for Part-of-Speech

abstract: Norwegian Twitter data poses an interesting challenge for Natural Language Processing (NLP) tasks. These texts are difficult for models trained on standardized text in one of the two Norwegian written forms (Bokm{\aa}l and Nynorsk), as they contain both the typical variation of social media text, as well as a large amount of dialectal variety. In this paper we present a novel Norwegian Twitter dataset annotated with POS-tags. We show that models trained on Universal Dependency (UD) data perform worse when evaluated against this dataset, and that models trained on Bokm{\aa}l generally perform better than those trained on Nynorsk. We also see that performance on dialectal tweets is comparable to the written standards for some models. Finally we perform a detailed analysis of the errors that models commonly make on this data.


title: Gravitational lensing of pulsars as a probe of dark matter halos

abstract: A particular open problem in cosmology is whether dark matter on small scales is clumpy, forming gravitationally-bound halos distributed within the Galaxy. The practical difficulties inherent in testing this hypothesis stem from the fact that, on astrophysical scales, dark matter is solely observable via its gravitational interaction with other objects. This thesis presents a gravitational-lensing-based solution for the mapping and characterisation of low-mass, dark matter halos via their signature in millisecond pulsar observations. This involves: first, determining the time delay and magnification surfaces generated in the frame of reference of the halo; second, obtaining the corresponding pulsar signature in the reference frame of the observer; and last, generalising the method to multiple halos at varying distances. We discuss whether the delay is observationally detectable for both single and multiple lenses. The key dependency of the time delay is the density profile adopted for the halo. I utilise a variety of proposed halo mass profiles -- elliptical, Schwarzschild, horizontal-disc lenses and the Navarro-Frenk-White (NFW) density profile -- which are applicable over a broad range of halo masses. I demonstrate the use of Hankel transforms to increase the efficiency of the relativistic time delay calculation. The observational signatures of such halos are best identified using millisecond pulsars due to their high rotational frequencies and period stability. My method does not require major adjustments when searching for signs of lensing, thus it is unnecessary to implement specialist data reduction pipelines. Thus we can leverage data from both existing and future surveys easily. This method is readily extensible to nearby globular clusters and galaxies, pending improvements in pulsar detection at such distances.


title: Rashba and Dresselhaus effects in doped methylammonium lead halide perovskite MAPbI$_3$

abstract: Inorganic-organic lead halide perovskites, particularly methylammonium lead halide (MAPbI$_3$) perovskite, is perceived to be a promising material for optoelectronics and spintronics. However, lead toxicity and instability under air and moisture restrict its practical uses. Hence, it is essential to reduce lead extent by substituting appropriate alternatives. Here, we substitute Sn and Ge in cubic MAPbI$_3$ and compare various properties of hybrid perovskites by employing state-of-the-art first-principles-based methodologies, viz., density functional theory (DFT) with semilocal and hybrid functional (HSE06) and generalized gradient approximation (PBE) combined with spin-orbit coupling (SOC). We mainly study the Rashba-Dresselhaus (RD) effect, which occurs here due to two major mechanisms breaking inversion symmetry, i.e., static and dynamic, and the presence of heavy elements contributing to significant SOC. We find non-negligible spin-splitting effects in the conduction band minimum (CBm) and valence band maximum (VBM) for hybrid perovskites. For a deeper understanding of the observed spin-splitting, the spin textures are analyzed and Rashba coefficients are calculated. We find that Dresselhaus effect comes into play in substituted hybrids in addition to the usual Rashba effect observed in pristine compound. We also observe that the strength of Rashba spin-splitting can be substantially tuned on application of uniaxial strain ($\pm5\%$). Also, we notice that some of the hybrids are mechanically stable and ductile. Hence these hybrid perovskites can prove to be potent for perovskite-based spintronic applications.


title: $\Omega$-bounds for the partial sums of some modified Dirichlet characters

abstract: We consider the problem of $\Omega$ bounds for the partial sums of a modified character, \textit{i.e.}, a completely multiplicative function $f$ such that $f(p)=\chi(p)$ for all but a finite number of primes $p$, where $\chi$ is a primitive Dirichlet character. We prove that in some special circumstances, $\sum_{n\leq x}f(n)=\Omega((\log x)^{|S|})$, where $S$ is the set of primes $p$ where $f(p)\neq \chi(p)$. This gives credence to a corrected version of a conjecture of Klurman et al., Trans. Amer. Math. Soc., 374 (11), 2021, 7967-7990. We also compute the Riesz mean of order $k$ for large $k$ of a modified character, and show that the Diophantine properties of the irrational numbers of the form $\log p / \log q$, for primes $p$ and $q$, give information on these averages.


title: Aergia: Leveraging Heterogeneity in Federated Learning Systems

abstract: Federated Learning (FL) is a popular approach for distributed deep learning that prevents the pooling of large amounts of data in a central server. FL relies on clients to update a global model using their local datasets. Classical FL algorithms use a central federator that, for each training round, waits for all clients to send their model updates before aggregating them. In practical deployments, clients might have different computing powers and network capabilities, which might lead slow clients to become performance bottlenecks. Previous works have suggested to use a deadline for each learning round so that the federator ignores the late updates of slow clients, or so that clients send partially trained models before the deadline. To speed up the training process, we instead propose Aergia, a novel approach where slow clients (i) freeze the part of their model that is the most computationally intensive to train; (ii) train the unfrozen part of their model; and (iii) offload the training of the frozen part of their model to a faster client that trains it using its own dataset. The offloading decisions are orchestrated by the federator based on the training speed that clients report and on the similarities between their datasets, which are privately evaluated thanks to a trusted execution environment. We show through extensive experiments that Aergia maintains high accuracy and significantly reduces the training time under heterogeneous settings by up to 27% and 53% compared to FedAvg and TiFL, respectively.


title: ERNIE-Layout: Layout Knowledge Enhanced Pre-training for Visually-rich Document Understanding

abstract: Recent years have witnessed the rise and success of pre-training techniques in visually-rich document understanding. However, most existing methods lack the systematic mining and utilization of layout-centered knowledge, leading to sub-optimal performances. In this paper, we propose ERNIE-Layout, a novel document pre-training solution with layout knowledge enhancement in the whole workflow, to learn better representations that combine the features from text, layout, and image. Specifically, we first rearrange input sequences in the serialization stage, and then present a correlative pre-training task, reading order prediction, to learn the proper reading order of documents. To improve the layout awareness of the model, we integrate a spatial-aware disentangled attention into the multi-modal transformer and a replaced regions prediction task into the pre-training phase. Experimental results show that ERNIE-Layout achieves superior performance on various downstream tasks, setting new state-of-the-art on key information extraction, document image classification, and document question answering datasets. The code and models are publicly available at http://github.com/PaddlePaddle/PaddleNLP/tree/develop/model_zoo/ernie-layout.


title: The local Poincare inequality of stochastic dynamic and application to the Ising model

abstract: Inspired by the idea of stochastic quantization proposed by Parisi and Wu, we construct the transition probability matrix which plays a central role in the renormalization group through a stochastic differential equation. By establishing the discrete time stochastic dynamics, the renormalization procedure can be characterized from the perspective of probability. Hence, we will focus on the investigation of the infinite dimensional stochastic dynamic. From the stochastic point of view, the discrete time stochastic dynamic can induce a Markov chain. Via calculating the square field operator and the Bakry-\'Emery curvature for a class of two-points functions, the local Poincar\'e inequality is established, from which the estimate of correlation functions can also be obtained. Finally, under the condition of ergodicity, by choosing the couple relationship between the system parameter $K$ and the system time $T$ properly when $T\rightarrow +\infty$, the two-points correlation functions for limit system are also estimated.


title: Concentration Inequalities for Markov Jump Processes

abstract: We derive concentration inequalities for empirical means $\frac{1}{t} \int_0^t f(X_s) ds$ where $X_s$ is an irreducible Markov jump process on a finite state space and $f$ some observable. Using a Feynman-Kac semigroup we first derive a general concentration inequality. Then, based on this inequality we derive further concentration inequalities. Hereby we use three different methods; perturbation theory, Poincar\'e inequalities and information inequalities. We also obtain a Bernstein type concentration inequality.


title: A Hybrid System for Real-time Rendering of Depth of Field Effect in Games

abstract: Real-time depth of field in game cinematics tends to approximate the semi-transparent silhouettes of out-of-focus objects through post-processing techniques. We leverage ray tracing hardware acceleration and spatio-temporal reconstruction to improve the realism of such semi-transparent regions through hybrid rendering, while maintaining interactive frame rates for immersive gaming. This paper extends our previous work with a complete presentation of our technique and details on its design, implementation, and future work.


title: Hybrid MBlur: A Systematic Approach to Augment Rasterization with Ray Tracing for Rendering Motion Blur in Games

abstract: Motion blur is commonly used in game cinematics to achieve photorealism by modelling the behaviour of the camera shutter and simulating its effect associated with the relative motion of scene objects. A common real-time post-process approach is spatial sampling, where the directional blur of a moving object is rendered by integrating its colour based on velocity information within a single frame. However, such screen space approaches typically cannot produce accurate partial occlusion semi-transparencies. Our real-time hybrid rendering technique leverages hardware-accelerated ray tracing to correct post-process partial occlusion artifacts by advancing rays recursively into the scene to retrieve background information for motion-blurred regions, with reasonable additional performance cost for rendering game contents. We extend our previous work with details on the design, implementation, and future work of the technique as well as performance comparisons with post-processing.


title: RTSDF: Real-time Signed Distance Fields for Soft Shadow Approximation in Games

abstract: Signed distance fields (SDFs) are a form of surface representation widely used in computer graphics, having applications in rendering, collision detection and modelling. In interactive media such as games, high-resolution SDFs are commonly produced offline and subsequently loaded into the application, representing rigid meshes only. This work develops a novel technique that combines jump flooding and ray tracing to generate approximate SDFs in real-time. Our approach can produce relatively accurate scene representation for rendering soft shadows while maintaining interactive frame rates. We extend our previous work with details on the design and implementation as well as visual quality and performance evaluation of the technique.


title: Asymptotic Green's function solutions of the general relativistic thin disc equations

abstract: The leading order Green's function solutions of the general relativistic thin disc equations are computed, using a pseudo-Newtonian potential and asymptotic Laplace mode matching techniques. This solution, valid for a vanishing ISCO stress, is constructed by ensuring that it reproduces the leading order asymptotic behaviour of the near-ISCO, Newtonian, and global WKB limits. Despite the simplifications used in constructing this solution, it is typically accurate, for all values of the Kerr spin parameter $a$ and at all radii, to less than a percent of the full numerically calculated solutions of the general relativistic disc equations. These solutions will be of use in studying time-dependent accretion discs surrounding Kerr black holes.


title: Second order two-species systems with nonlocal interactions: existence and large damping limits

abstract: We study the mathematical theory of second order systems with two species, arising in the dynamics of interacting particles subject to linear damping, to nonlocal forces and to external ones, and resulting into a nonlocal version of the compressible Euler system with linear damping. Our results are limited to the $1$ space dimensional case but allow for initial data taken in a Wasserstein space of probability measures. We first consider the case of smooth nonlocal interaction potentials, not subject to any symmetry condition, and prove existence and uniqueness. The concept of solutions relies on a stickiness condition in case of collisions, in the spirit of previous works in the literature. The result uses concepts from classical Hilbert space theory of gradient flows (cf. Brezis [7]) and a trick used in [4]. We then consider a large-time and large-damping scaled version of our system and prove convergence to solutions to the corresponding first order system. Finally, we consider the case of Newtonian potentials -- subject to symmetry of the cross-interaction potentials -- and external convex potentials. After showing existence in the sticky particles framework in the spirit of [4], we prove convergence for large times towards Dirac delta solutions for the two densities. All the results share a common technical framework in that solutions are considered in a Lagrangian framework, which allows to estimate the behavior of solutions via $L^2$ estimates of the pseudo-inverse variables corresponding to the two densities. In particular, due to this technique, the large-damping result holds under a rather weak condition on the initial data, which does not require well-prepared initial velocities. We complement the results with numerical simulations.


title: Privacy of federated QR decomposition using additive secure multiparty computation

abstract: Federated learning (FL) is a privacy-aware data mining strategy keeping the private data on the owners' machine and thereby confidential. The clients compute local models and send them to an aggregator which computes a global model. In hybrid FL, the local parameters are additionally masked using secure aggregation, such that only the global aggregated statistics become available in clear text, not the client specific updates. Federated QR decomposition has not been studied extensively in the context of cross-silo federated learning. In this article, we investigate the suitability of three QR decomposition algorithms for cross-silo FL and suggest a privacy-aware QR decomposition scheme based on the Gram-Schmidt algorithm which does not blatantly leak raw data. We apply the algorithm to compute linear regression in a federated manner.


title: Focusing on Context is NICE: Improving Overshadowed Entity Disambiguation

abstract: Entity disambiguation (ED) is the task of mapping an ambiguous entity mention to the corresponding entry in a structured knowledge base. Previous research showed that entity overshadowing is a significant challenge for existing ED models: when presented with an ambiguous entity mention, the models are much more likely to rank a more frequent yet less contextually relevant entity at the top. Here, we present NICE, an iterative approach that uses entity type information to leverage context and avoid over-relying on the frequency-based prior. Our experiments show that NICE achieves the best performance results on the overshadowed entities while still performing competitively on the frequent entities.


title: COCONUT, a novel fast-converging MHD model for solar corona simulations: II. Assessing the impact of the input magnetic map on space-weather forecasting at minimum of activity

abstract: This paper is dedicated to the new implicit unstructured coronal code COCONUT, which aims at providing fast and accurate inputs for space weather forecast as an alternative to empirical models. We use all 20 available magnetic maps of the solar photosphere covering the date of the 2nd of July 2019 which corresponds to a solar eclipse on Earth. We use the same standard pre-processing on all maps, then perform coronal MHD simulations with the same numerical and physical parameters. In the end, we quantify the performance for each map using three indicators from remote-sensing observations: white-light total solar eclipse images for the streamers' edges, EUV synoptic maps for coronal holes and white-light coronagraph images for the heliospheric current sheet. We discuss the performance for space weather forecasts and we show that the choice of the input magnetic map has a strong impact. We find performances between 24% to 85% for the streamers' edges, 24% to 88% for the coronal hole boundaries and a mean deviation between 4 to 12 degrees for the heliospheric current sheet position. We find that the HMI runs are globally performing better on all indicators, with the GONG-ADAPT being the second-best choice. HMI runs perform better for the streamers' edges, GONG-ADAPT for polar coronal holes, HMI synchronic for equatorial coronal holes and for the streamer belt. We especially showcase the importance of the filling of the poles. This demonstrates that the solar poles have to be taken into account even for ecliptic plane previsions.


title: Noether Symmetries in $f(T,T_G)$ Cosmology

abstract: All degrees of freedom related to the torsion scalar can be explored by analysing, the $f(T,T_G)$ gravity formalism where, $T$ is a torsion scalar and $T_G$ is the teleparallel counterpart of the Gauss-Bonnet topological invariant term. The well-known Noether symmetry approach is a useful tool for selecting models that are motivated at a fundamental level and determining the exact solution to a given Lagrangian, hence we explore Noether symmetry approach in $f(T,T_G)$ gravity formalism with three different forms of $f(T,T_G)$ and study how to establish nontrivial Noether vector form for each one of them. We extend the analysis made in \cite{capozziello2016noether} for the form $f(T,T_{G})=b_{0}T_{G}^{k}+t_{0}T^{m}$ and discussed the symmetry for this model with linear teleparallel equivalent of the Gauss-Bonnet term, followed by the study of two models containing exponential form of the teleparallel equivalent of the Gauss-Bonnet term. We have shown that all three cases will allow us to obtain non-trivial Noether vector which will play an important role to obtain the exact solutions for the cosmological equations.


title: Stability analysis of chaotic systems from data

abstract: The prediction of the temporal dynamics of chaotic systems is challenging because infinitesimal perturbations grow exponentially. The analysis of the dynamics of infinitesimal perturbations is the subject of stability analysis. In stability analysis, we linearize the equations of the dynamical system around a reference point, and compute the properties of the tangent space (i.e., the Jacobian). The main goal of this paper is to propose a method that learns the Jacobian, thus, the stability properties, from observables (data). First, we propose the Echo State Network (ESN) with the Recycle Validation as a tool to accurately infer the chaotic dynamics from data. Second, we mathematically derive the Jacobian of the Echo State Network, which provides the evolution of infinitesimal perturbations. Third, we analyse the stability properties of the Jacobian inferred from the ESN, and compare them with the benchmark results obtained by linearizing the equations. The ESN correctly infers the nonlinear solution, and its tangent space with negligible numerical errors. In detail, (i) the long-term statistics of the chaotic state; (ii) the covariant Lyapunov vectors; (ii) the Lyapunov spectrum; (iii) the finite-time Lyapunov exponents; (iv) and the angles between the stable, neutral, and unstable splittings of the tangent space (the degree of hyperbolicity of the attractor). This work opens up new opportunities for the computation of stability properties of nonlinear systems from data, instead of equations.


title: The Role of Exploration for Task Transfer in Reinforcement Learning

abstract: The exploration--exploitation trade-off in reinforcement learning (RL) is a well-known and much-studied problem that balances greedy action selection with novel experience, and the study of exploration methods is usually only considered in the context of learning the optimal policy for a single learning task. However, in the context of online task transfer, where there is a change to the task during online operation, we hypothesize that exploration strategies that anticipate the need to adapt to future tasks can have a pronounced impact on the efficiency of transfer. As such, we re-examine the exploration--exploitation trade-off in the context of transfer learning. In this work, we review reinforcement learning exploration methods, define a taxonomy with which to organize them, analyze these methods' differences in the context of task transfer, and suggest avenues for future investigation.


title: Model order reduction of solidification problems

abstract: Advection driven problems are known to be difficult to model with a reduced basis because of a slow decay of the Kolmogorov $N$-width. This paper investigates how this challenge transfers to the context of solidification problems and tries to answer when and to what extend reduced order models (ROMs) work for solidification problems. In solidification problems, the challenge is not the advection per se, but rather a moving solidification front. This paper studies reduced spaces for 1D step functions that move in time, which can either be seen as advection of a quantity or as a moving solidification front. Furthermore, the reduced space of a 2D solidification test case is compared with the reduced space of an alloy solidification featuring a mushy zone. The results show that not only the PDE itself, but the smoothness of the solution is crucial for the decay of the singular values and thus the quality of a reduced space representation.


title: Contrastive Neural Ratio Estimation

abstract: Likelihood-to-evidence ratio estimation is usually cast as either a binary (NRE-A) or a multiclass (NRE-B) classification task. In contrast to the binary classification framework, the current formulation of the multiclass version has an intrinsic and unknown bias term, making otherwise informative diagnostics unreliable. We propose a multiclass framework free from the bias inherent to NRE-B at optimum, leaving us in the position to run diagnostics that practitioners depend on. It also recovers NRE-A in one corner case and NRE-B in the limiting case. For fair comparison, we benchmark the behavior of all algorithms in both familiar and novel training regimes: when jointly drawn data is unlimited, when data is fixed but prior draws are unlimited, and in the commonplace fixed data and parameters setting. Our investigations reveal that the highest performing models are distant from the competitors (NRE-A, NRE-B) in hyperparameter space. We make a recommendation for hyperparameters distinct from the previous models. We suggest a bound on the mutual information as a performance metric for simulation-based inference methods, without the need for posterior samples, and provide experimental results.


title: Learning to Optimize Quasi-Newton Methods

abstract: Fast gradient-based optimization algorithms have become increasingly essential for the computationally efficient training of machine learning models. One technique is to multiply the gradient by a preconditioner matrix to produce a step, but it is unclear what the best preconditioner matrix is. This paper introduces a novel machine learning optimizer called LODO, which tries to online meta-learn the best preconditioner during optimization. Specifically, our optimizer merges Learning to Optimize (L2O) techniques with quasi-Newton methods to learn preconditioners parameterized as neural networks; they are more flexible than preconditioners in other quasi-Newton methods. Unlike other L2O methods, LODO does not require any meta-training on a training task distribution, and instead learns to optimize on the fly while optimizing on the test task, adapting to the local characteristics of the loss landscape while traversing it. Theoretically, we show that our optimizer approximates the inverse Hessian in noisy loss landscapes and is capable of representing a wide range of inverse Hessians. We experimentally verify that our algorithm can optimize in noisy settings, and show that simpler alternatives for representing the inverse Hessians worsen performance. Lastly, we use our optimizer to train a semi-realistic deep neural network with 95k parameters at speeds comparable to those of standard neural network optimizers.


title: Potential Applications of Quantum Computing for the Insurance Industry

abstract: This paper is the documentation of a pre-study performed by AXA Konzern AG in collaboration with Fraunhofer ITWM to assess the relevance of quantum computing for the insurance industry. Beside a general overview of the status quo of quantum computing technologies, we investigate its applicability for the valuation of insurance contracts as a concrete use case. This valuation is a computationally intensive problem because the lack of closed pricing formulas requires the use of Monte Carlo methods. Therefore current technical capabilities force insurers to apply approximation methods for many subsequent tasks like economic capital calculation or optimization of strategic asset allocations. The business-criticality of these tasks combined with the existence of a quantum algorithm called Amplitude Estimation which promises a quadratic speed-up of Monte Carlo simulation makes this use case obvious. We provide a detailed explanation of Amplitude Estimation and present two quantum circuits which describe insurance-related payoff features in a quantum circuit model. An exemplary circuit that encodes dynamic lapse is evaluated both on a simulator and on real quantum hardware.


title: Codazzi tensors and their space-times, and Cotton gravity

abstract: We study the geometric properties of certain Codazzi tensors for their own sake, and for their appearance in the recent theory of Cotton gravity. We prove that a perfect-fluid tensor is Codazzi if and only if the metric is a generalized Stephani universe. A trace condition restricts it to a warped space-time, as proven by Merton and Derdzinski. We also give necessary and sufficient conditions for a space-time to host a current-flow Codazzi tensor. In particular, we study the static and spherically symmetric cases, which include the Nariai and Bertotti-Robinson metrics. The latter are a special case of Yang Pure space-times, together with spatially flat FRW space-times with constant curvature scalar. We apply these results to the recent Cotton gravity by Harada. The equations have the freedom of choosing a Codazzi tensor, that constrains the space-time where the theory is staged. The tensor, chosen in forms significative for physics, implies the form of the Ricci tensor, and the two specify the energy-momentum tensor, which is the source in Cotton gravity for the chosen metric. For example, the Stephani, Nariai and Bertotti-Robinson space-times solve Cotton gravity with physically sensible energy-momentum tensors. Finally, we discuss Cotton gravity in De Sitter space-times.


title: Molecular dynamics simulation of the ferroelectric phase transition in GeTe: displacive or order-disorder?

abstract: Experimental investigations of the phase transition in GeTe provide contradictory conclusions regarding the nature of the phase transition. Considering growing interest in technological applications of GeTe, settling these disputes is of great importance. To that end, we present a molecular dynamics study of the structural phase transition in GeTe using a machine-learned interatomic potential with ab-initio accuracy. First, we calculate the asymmetric shape of the radial distribution function of the nearest-neighbor bonds above the critical temperature, in agreement with previous studies. However, we show that this effect is not necessarily linked with the order-disorder phase transition and can occur as a result of large anharmonicity. Next, we study in detail the static and dynamic properties of the order parameter in the vicinity of the phase transition and find fingerprints of both order-disorder and displacive phase transition.


title: Exploring Efficient-tuning Methods in Self-supervised Speech Models

abstract: In this study, we aim to explore efficient tuning methods for speech self-supervised learning. Recent studies show that self-supervised learning (SSL) can learn powerful representations for different speech tasks. However, fine-tuning pre-trained models for each downstream task is parameter-inefficient since SSL models are notoriously large with millions of parameters. Adapters are lightweight modules commonly used in NLP to solve this problem. In downstream tasks, the parameters of SSL models are frozen, and only the adapters are trained. Given the lack of studies generally exploring the effectiveness of adapters for self-supervised speech tasks, we intend to fill this gap by adding various adapter modules in pre-trained speech SSL models. We show that the performance parity can be achieved with over 90% parameter reduction, and discussed the pros and cons of efficient tuning techniques. This is the first comprehensive investigation of various adapter types across speech tasks.


title: Cosmic evolution of grain size distribution in galaxies using the $\nu^2$GC semi-analytic model

abstract: We investigate the cosmological evolution of interstellar dust with a semi-analytical galaxy formation model ($\nu^2$GC), focusing on the evolution of grain size distribution. The model predicts the statistical properties of dust mass and grain size distribution in galaxies across cosmic history. We confirm that the model reproduces the relation between dust-to-gas ratio and metallicity in the local Universe, and that the grain size distributions of the Milky Way (MW)-like sample become similar to the so-called MRN distribution that reproduces the observed MW extinction curve. Our model, however, tends to overpredict the dust mass function at the massive end at redshift $z\lesssim 0.8$ while it reproduces the abundance of dusty galaxies at higher redshifts. We also examine the correlation between grain size distribution and galaxy properties (metallicity, specific star formation rate, gas fraction, and stellar mass), and observe a clear trend of large-grain-dominated, small-grain-dominated, and MRN-like grain size distributions from unevolved to evolved stages. As a consequence, the extinction curve shapes are flat, steep, and intermediate (MW-like) from the unevolved to evolved phases. At a fixed metallicity, the grain size distribution tends to have larger fractions of small grains at lower redshift; accordingly, the extinction curve tends to be steeper at lower redshift. We also predict that supersolar-metallicity objects at high redshift have flat extinction curves with weak 2175 \AA bump strength.


title: VCSE: Time-Domain Visual-Contextual Speaker Extraction Network

abstract: Speaker extraction seeks to extract the target speech in a multi-talker scenario given an auxiliary reference. Such reference can be auditory, i.e., a pre-recorded speech, visual, i.e., lip movements, or contextual, i.e., phonetic sequence. References in different modalities provide distinct and complementary information that could be fused to form top-down attention on the target speaker. Previous studies have introduced visual and contextual modalities in a single model. In this paper, we propose a two-stage time-domain visual-contextual speaker extraction network named VCSE, which incorporates visual and self-enrolled contextual cues stage by stage to take full advantage of every modality. In the first stage, we pre-extract a target speech with visual cues and estimate the underlying phonetic sequence. In the second stage, we refine the pre-extracted target speech with the self-enrolled contextual cues. Experimental results on the real-world Lip Reading Sentences 3 (LRS3) database demonstrate that our proposed VCSE network consistently outperforms other state-of-the-art baselines.


title: Multi-messenger constraints on Abelian-Higgs cosmic string networks

abstract: Nielsen-Olesen vortices in the Abelian-Higgs (AH) model are the simplest realisations of cosmic strings in a gauge field theory. Large-scale numerical solutions show that the dominant decay channel of a network of AH strings produced from random initial conditions is classical field radiation. However, they also show that with special initial conditions, loops of string can be created for which classical field radiation is suppressed, and which behave like Nambu-Goto (NG) strings with a dominant decay channel into gravitational radiation. This indicates that cosmic strings are generically sources of both high-energy particles and gravitational waves. Here we adopt a simple parametrisation of the AH string network allowing for both particle and gravitational wave production. With a reference to a specific model for NG-like loop distribution, this sets the basis for a ``multi-messenger'' investigation of this model. We find that, in order to explain the NANOGrav detection of a possible gravitational wave background, while satisfying the constraint on NG-like loop production from simulations and bounds from the cosmic microwave background, the tension of the AH string in Planck units $G\mu$ and the fraction of the NG-like loops $f_{\rm NG}$ should satisfy $G\mu f_{\rm NG}^{2.6} \gtrsim 3.2\times 10^{-13}$ at 95$\%$ confidence. On the other hand, for such string tensions, constraints from the diffuse gamma-ray background (DGRB) indicate that more than 97$\%$ of the total network energy should be converted to dark matter (DM) or dark radiation. We also consider joint constraints on the annihilation cross-section, the mass, and the relic abundance of DM produced by decays of strings. For example, for a DM mass of 500 GeV, the observed relic abundance can be explained by decaying AH strings that also account for the NANOGrav signal.


title: Convolutional Neural Network-Based Image Watermarking using Discrete Wavelet Transform

abstract: With the growing popularity of the Internet, digital images are used and transferred more frequently. Although this phenomenon facilitates easy access to information, it also creates security concerns and violates intellectual property rights by allowing illegal use, copying, and digital content theft. Using watermarks in digital images is one of the most common ways to maintain security. Watermarking is proving and declaring ownership of an image by adding a digital watermark to the original image. Watermarks can be either text or an image placed overtly or covertly in an image and are expected to be challenging to remove. This paper proposes a combination of convolutional neural networks (CNNs) and wavelet transforms to obtain a watermarking network for embedding and extracting watermarks. The network is independent of the host image resolution, can accept all kinds of watermarks, and has only 11 layers while keeping performance. Performance is measured by two terms; the similarity between the extracted watermark and the original one and the similarity between the host image and the watermarked one.


title: Dominant Auslander-Gorenstein algebras and mixed cluster tilting

abstract: We introduce the class of dominant Auslander-Gorenstein algebras as a generalisation of higher Auslander algebras and minimal Auslander-Gorenstein algebras, and give their basic properties. We also introduce mixed (pre)cluster tilting modules as a generalisation of (pre)cluster tilting modules, and establish an Auslander type correspondence by showing that dominant Auslander-Gorenstein (respectively, Auslander-regular) algebras correspond bijectively with mixed precluster (respectively, cluster) tilting modules. We show that every trivial extension algebra $T(A)$ of a $d$-representation-finite algebra A admits a mixed cluster tilting module and show that this can be seen as a generalisation of the well known result that $d$-representation-finite algebras are fractionally Calabi-Yau. We show that iterated SGC-extensions of a gendo-symmetric dominant Auslander-Gorenstein algebra admit mixed precluster tilting modules.


title: Five Trigonometric addition laws on semigroups

abstract: In this paper, we determine the complex-valued solutions of the following functional equations \[g(x\sigma (y)) = g(x)g(y)+f(x)f(y),\quad x,y\in S,\]\[f(x\sigma (y)) = f(x)g(y)+f(y)g(x),\quad x,y\in S,\]\[f(x\sigma (y)) = f(x)g(y)+f(y)g(x)-g(x)g(y),\quad x,y\in S,\]\[f(x\sigma(y))=f(x)g(y)+f(y)g(x)+\alpha g(x\sigma(y)),\quad x,y\in S,\]\[f(x\sigma(y))=f(x)g(y)-f(y)g(x)+\alpha g(x\sigma(y)),\quad x,y\in S,\] where $S$ is a semigroup, $\alpha \in \mathbb{C}\backslash \lbrace 0\rbrace$ is a fixed constant and $\sigma :S\rightarrow S$ an involutive automorphism.


title: The $p$-adic limits of class numbers in $\mathbb{Z}_p$-towers

abstract: This article discusses variants of Weber's class number problem in the spirit of arithmetic topology to connect the results of Sinnott--Kisilevsky and Kionke. Let $p$ be a prime number. We first prove the $p$-adic convergence of class numbers in a $\mathbb{Z}_p$-extension of a global field and a similar result in a $\mathbb{Z}_p$-cover of a compact 3-manifold. Secondly, we establish an explicit formula for the $p$-adic limit of the $p$-power-th cyclic resultants of a polynomial using roots of unity of orders prime to $p$, the $p$-adic logarithm, and the Iwasawa invariants. Finally, we give thorough investigations of torus knots, twist knots, and elliptic curves; we complete the list of the cases with $p$-adic limits being in $\mathbb{Z}$ and find the cases such that the base $p$-class numbers are small and $\nu$'s are arbitrarily large.


title: Transfer Learning on Heterogeneous Feature Spaces for Treatment Effects Estimation

abstract: Consider the problem of improving the estimation of conditional average treatment effects (CATE) for a target domain of interest by leveraging related information from a source domain with a different feature space. This heterogeneous transfer learning problem for CATE estimation is ubiquitous in areas such as healthcare where we may wish to evaluate the effectiveness of a treatment for a new patient population for which different clinical covariates and limited data are available. In this paper, we address this problem by introducing several building blocks that use representation learning to handle the heterogeneous feature spaces and a flexible multi-task architecture with shared and private layers to transfer information between potential outcome functions across domains. Then, we show how these building blocks can be used to recover transfer learning equivalents of the standard CATE learners. On a new semi-synthetic data simulation benchmark for heterogeneous transfer learning we not only demonstrate performance improvements of our heterogeneous transfer causal effect learners across datasets, but also provide insights into the differences between these learners from a transfer perspective.


title: Images as Weight Matrices: Sequential Image Generation Through Synaptic Learning Rules

abstract: Work on fast weight programmers has demonstrated the effectiveness of key/value outer product-based learning rules for sequentially generating a weight matrix (WM) of a neural net (NN) by another NN or itself. However, the weight generation steps are typically not visually interpretable by humans, because the contents stored in the WM of an NN are not. Here we apply the same principle to generate natural images. The resulting fast weight painters (FPAs) learn to execute sequences of delta learning rules to sequentially generate images as sums of outer products of self-invented keys and values, one rank at a time, as if each image was a WM of an NN. We train our FPAs in the generative adversarial networks framework, and evaluate on various image datasets. We show how these generic learning rules can generate images with respectable visual quality without any explicit inductive bias for images. While the performance largely lags behind the one of specialised state-of-the-art image generators, our approach allows for visualising how synaptic learning rules iteratively produce complex connection patterns, yielding human-interpretable meaningful images. Finally, we also show that an additional convolutional U-Net (now popular in diffusion models) at the output of an FPA can learn one-step "denoising" of FPA-generated images to enhance their quality. Our code is public.


title: Polynomial tractability for integration in an unweighted function space with absolutely convergent Fourier series

abstract: In this note, we prove that the following function space with absolutely convergent Fourier series \[ F_d:=\left\{ f\in L^2([0,1)^d)\:\middle| \: \|f\|:=\sum_{\boldsymbol{k}\in \mathbb{Z}^d}|\hat{f}(\boldsymbol{k})| \max\left(1,\min_{j\in \mathrm{supp}(\boldsymbol{k})}\log |k_j|\right) <\infty \right\}\] with $\hat{f}(\boldsymbol{k})$ being the $\boldsymbol{k}$-th Fourier coefficient of $f$ and $\mathrm{supp}(\boldsymbol{k}):=\{j\in \{1,\ldots,d\}\mid k_j\neq 0\}$ is polynomially tractable for multivariate integration in the worst-case setting. Here polynomial tractability means that the minimum number of function evaluations required to make the worst-case error less than or equal to a tolerance $\varepsilon$ grows only polynomially with respect to $\varepsilon^{-1}$ and $d$. It is important to remark that the function space $F_d$ is unweighted, that is, all variables contribute equally to the norm of functions. Our tractability result is in contrast to those for most of the unweighted integration problems studied in the literature, in which polynomial tractability does not hold and the problem suffers from the curse of dimensionality. Our proof is constructive in the sense that we provide an explicit quasi-Monte Carlo rule that attains a desired worst-case error bound.