title: Contrastive Learning with Boosted Memorization

abstract: Self-supervised learning has achieved a great success in the representation learning of visual and textual data. However, the current methods are mainly validated on the well-curated datasets, which do not exhibit the real-world long-tailed distribution. Recent attempts to consider self-supervised long-tailed learning are made by rebalancing in the loss perspective or the model perspective, resembling the paradigms in the supervised long-tailed learning. Nevertheless, without the aid of labels, these explorations have not shown the expected significant promise due to the limitation in tail sample discovery or the heuristic structure design. Different from previous works, we explore this direction from an alternative perspective, i.e., the data perspective, and propose a novel Boosted Contrastive Learning (BCL) method. Specifically, BCL leverages the memorization effect of deep neural networks to automatically drive the information discrepancy of the sample views in contrastive learning, which is more efficient to enhance the long-tailed learning in the label-unaware context. Extensive experiments on a range of benchmark datasets demonstrate the effectiveness of BCL over several state-of-the-art methods. Our code is available at https://github.com/MediaBrain-SJTU/BCL.


title: Train Flat, Then Compress: Sharpness-Aware Minimization Learns More Compressible Models

abstract: Model compression by way of parameter pruning, quantization, or distillation has recently gained popularity as an approach for reducing the computational requirements of modern deep neural network models for NLP. Inspired by prior works suggesting a connection between simpler, more generalizable models and those that lie within wider loss basins, we hypothesize that optimizing for flat minima should lead to simpler parameterizations and thus more compressible models. We propose to combine sharpness-aware minimization (SAM) with various task-specific model compression methods, including iterative magnitude pruning (IMP), structured pruning with a distillation objective, and post-training dynamic quantization. Empirically, we show that optimizing for flatter minima consistently leads to greater compressibility of parameters compared to vanilla Adam when fine-tuning BERT models, with little to no loss in accuracy on the GLUE text classification and SQuAD question answering benchmarks. Moreover, SAM finds superior winning tickets during IMP that 1) are amenable to vanilla Adam optimization, and 2) transfer more effectively across tasks.


title: Surprises in adversarially-trained linear regression

abstract: State-of-the-art machine learning models can be vulnerable to very small input perturbations that are adversarially constructed. Adversarial training is an effective approach to defend against such examples. It is formulated as a min-max problem, searching for the best solution when the training data was corrupted by the worst-case attacks. For linear regression problems, adversarial training can be formulated as a convex problem. We use this reformulation to make two technical contributions: First, we formulate the training problem as an instance of robust regression to reveal its connection to parameter-shrinking methods, specifically that $\ell_\infty$-adversarial training produces sparse solutions. Secondly, we study adversarial training in the overparameterized regime, i.e. when there are more parameters than data. We prove that adversarial training with small disturbances gives the solution with the minimum-norm that interpolates the training data. Ridge regression and lasso approximate such interpolating solutions as their regularization parameter vanishes. By contrast, for adversarial training, the transition into the interpolation regime is abrupt and for non-zero values of disturbance. This result is proved and illustrated with numerical examples.

categories: stat.ML cs.CR cs.LG eess.SP math.ST stat.TH


title: Revisiting DocRED -- Addressing the False Negative Problem in Relation Extraction

abstract: The DocRED dataset is one of the most popular and widely used benchmarks for document-level relation extraction (RE). It adopts a recommend-revise annotation scheme so as to have a large-scale annotated dataset. However, we find that the annotation of DocRED is incomplete, i.e., false negative samples are prevalent. We analyze the causes and effects of the overwhelming false negative problem in the DocRED dataset. To address the shortcoming, we re-annotate 4,053 documents in the DocRED dataset by adding the missed relation triples back to the original DocRED. We name our revised DocRED dataset Re-DocRED. We conduct extensive experiments with state-of-the-art neural models on both datasets, and the experimental results show that the models trained and evaluated on our Re-DocRED achieve performance improvements of around 13 F1 points. Moreover, we conduct a comprehensive analysis to identify the potential areas for further improvement. Our dataset is publicly available at https://github.com/tonytan48/Re-DocRED.


title: PLOG: Table-to-Logic Pretraining for Logical Table-to-Text Generation

abstract: Logical table-to-text generation is a task that involves generating logically faithful sentences from tables, which requires models to derive logical level facts from table records via logical inference. It raises a new challenge on the logical-level content planning of table-to-text models. However, directly learning the logical inference knowledge from table-text pairs is very difficult for neural models because of the ambiguity of natural language and the scarcity of parallel data. Hence even large-scale pre-trained language models present low logical fidelity on logical table-to-text. In this work, we propose a PLOG (Pretrained Logical Form Generator) framework to improve the generation fidelity. Specifically, PLOG is first pretrained on a table-to-logic-form generation (table-to-logic) task, then finetuned on downstream table-to-text tasks. The formal definition of logical forms enables us to collect large amount of accurate logical forms from tables without human annotation. In addition, PLOG can learn logical inference from table-logic pairs much more definitely than from table-text pairs. To evaluate our model, we further collect a controlled logical table-to-text dataset CONTLOG based on an existing dataset. On two benchmarks, LOGICNLG and CONTLOG, PLOG outperforms strong baselines by a large margin on the logical fidelity, demonstrating the effectiveness of table-to-logic pretraining.


title: Empathic Conversations: A Multi-level Dataset of Contextualized Conversations

abstract: Empathy is a cognitive and emotional reaction to an observed situation of others. Empathy has recently attracted interest because it has numerous applications in psychology and AI, but it is unclear how different forms of empathy (e.g., self-report vs counterpart other-report, concern vs. distress) interact with other affective phenomena or demographics like gender and age. To better understand this, we created the {\it Empathic Conversations} dataset of annotated negative, empathy-eliciting dialogues in which pairs of participants converse about news articles. People differ in their perception of the empathy of others. These differences are associated with certain characteristics such as personality and demographics. Hence, we collected detailed characterization of the participants' traits, their self-reported empathetic response to news articles, their conversational partner other-report, and turn-by-turn third-party assessments of the level of self-disclosure, emotion, and empathy expressed. This dataset is the first to present empathy in multiple forms along with personal distress, emotion, personality characteristics, and person-level demographic information. We present baseline models for predicting some of these features from conversations.


title: DRLinFluids -- An open-source python platform of coupling Deep Reinforcement Learning and OpenFOAM

abstract: We propose an open-source python platform for applications of Deep Reinforcement Learning (DRL) in fluid mechanics. DRL has been widely used in optimizing decision-making in nonlinear and high-dimensional problems. Here, an agent maximizes a cumulative reward with learning a feedback policy by acting in an environment. In control theory terms, the cumulative reward would correspond to the cost function, the agent to the actuator, the environment to the measured signals and the learned policy to the feedback law. Thus, DRL assumes an interactive environment or, equivalently, control plant. The setup of a numerical simulation plant with DRL is challenging and time-consuming. In this work, a novel python platform, named DRLinFluids is developed for this purpose, with DRL for flow control and optimization problems in fluid mechanics. The simulations employ OpenFOAM as popular, flexible Navier-Stokes solver in industry and academia, and Tensorforce or Tianshou as widely used versatile DRL packages. The reliability and efficiency of DRLinFluids are demonstrated for two wake stabilization benchmark problems. DRLinFluids significantly reduces the application effort of DRL in fluid mechanics and is expected to greatly accelerates academic and industrial applications.


title: BITE: Textual Backdoor Attacks with Iterative Trigger Injection

abstract: Backdoor attacks have become an emerging threat to NLP systems. By providing poisoned training data, the adversary can embed a "backdoor" into the victim model, which allows input instances satisfying certain textual patterns (e.g., containing a keyword) to be predicted as a target label of the adversary's choice. In this paper, we demonstrate that it is possible to design a backdoor attack that is both stealthy (i.e., hard to notice) and effective (i.e., has a high attack success rate). We propose BITE, a backdoor attack that poisons the training data to establish strong correlations between the target label and a set of "trigger words". These trigger words are iteratively identified and injected into the target-label instances through natural word-level perturbations. The poisoned training data instruct the victim model to predict the target label on inputs containing trigger words, forming the backdoor. Experiments on four text classification datasets show that our proposed attack is significantly more effective than baseline methods while maintaining decent stealthiness, raising alarm on the usage of untrusted training data. We further propose a defense method named DeBITE based on potential trigger word removal, which outperforms existing methods in defending against BITE and generalizes well to handling other backdoor attacks.


title: Eliciting and Understanding Cross-Task Skills with Task-Level Mixture-of-Experts

abstract: Recent works suggest that transformer models are capable of multi-tasking on diverse NLP tasks and adapting to new tasks efficiently. However, the potential of these multi-task models may be limited as they use the same set of parameters for all tasks. In contrast, humans tackle tasks in a more flexible way, by making proper presumptions on what skills and knowledge are relevant and executing only the necessary computations. Inspired by this, we propose to use task-level mixture-of-expert models, which has a collection of transformer layers (i.e., experts) and a router component that chooses from these experts dynamically and flexibly. We find that these models help improve the average performance gain (ARG) metric by 2.6% when adapting to unseen tasks in the few-shot setting and by 5.6% in the zero-shot generalization setting. Further, we show that the learned routing decisions partly rediscover human categorization of NLP tasks -- certain experts are strongly associated with extractive tasks, some with classification tasks, and some with tasks requiring world knowledge.


title: Detecting Label Errors by using Pre-Trained Language Models

abstract: We show that large pre-trained language models are inherently highly capable of identifying label errors in natural language datasets: simply examining out-of-sample data points in descending order of fine-tuned task loss significantly outperforms more complex error-detection mechanisms proposed in previous work. To this end, we contribute a novel method for introducing realistic, human-originated label noise into existing crowdsourced datasets such as SNLI and TweetNLP. We show that this noise has similar properties to real, hand-verified label errors, and is harder to detect than existing synthetic noise, creating challenges for model robustness. We argue that human-originated noise is a better standard for evaluation than synthetic noise. Finally, we use crowdsourced verification to evaluate the detection of real errors on IMDB, Amazon Reviews, and Recon, and confirm that pre-trained models perform at a 9-36% higher absolute Area Under the Precision-Recall Curve than existing models.


title: All about unambiguous polynomial closure

abstract: We study a standard operator on classes of languages: unambiguous polynomial closure. We prove that for every class C of regular languages satisfying mild properties, the membership problem for its unambiguous polynomial closure UPol(C) reduces to the same problem for C. We also show that unambiguous polynomial closure coincides with alternating left and right deterministic closure. Moreover, we prove that if additionally C is finite, the separation and covering problems are decidable for UPol(C). Finally, we present an overview of the generic logical characterizations of the classes built using unambiguous polynomial closure.


title: Lift force in odd compressible fluids

abstract: We compute the response matrix for a tracer particle in a compressible fluid with odd viscosity living on a two-dimensional surface. Unlike the incompressible case, we find that an odd compressible fluid can produce an odd lift force on a tracer particle. Using a "shell localization" formalism, we provide analytic expressions for the drag and odd lift forces acting on the tracer particle in a steady state and also at finite frequency. Importantly, we find that the existence of an odd lift force in a steady state requires taking into account the non-conservation of the fluid mass density due to the coupling between the two-dimensional surface and the three-dimensional bulk fluid.


title: COVID-19 Severity Classification on Chest X-ray Images

abstract: Biomedical imaging analysis combined with artificial intelligence (AI) methods has proven to be quite valuable in order to diagnose COVID-19. So far, various classification models have been used for diagnosing COVID-19. However, classification of patients based on their severity level is not yet analyzed. In this work, we classify covid images based on the severity of the infection. First, we pre-process the X-ray images using a median filter and histogram equalization. Enhanced X-ray images are then augmented using SMOTE technique for achieving a balanced dataset. Pre-trained Resnet50, VGG16 model and SVM classifier are then used for feature extraction and classification. The result of the classification model confirms that compared with the alternatives, with chest X-Ray images, the ResNet-50 model produced remarkable classification results in terms of accuracy (95%), recall (0.94), and F1-Score (0.92), and precision (0.91).


title: Maximum Mean Discrepancy on Exponential Windows for Online Change Detection

abstract: Detecting changes is of fundamental importance when analyzing data streams and has many applications, e.g., predictive maintenance, fraud detection, or medicine. A principled approach to detect changes is to compare the distributions of observations within the stream to each other via hypothesis testing. Maximum mean discrepancy (MMD; also called energy distance) is a well-known (semi-)metric on the space of probability distributions. MMD gives rise to powerful non-parametric two-sample tests on kernel-enriched domains under mild conditions, which makes its deployment for change detection desirable. However, the classic MMD estimators suffer quadratic complexity, which prohibits their application in the online change detection setting. We propose a general-purpose change detection algorithm, Maximum Mean Discrepancy on Exponential Windows (MMDEW), which leverages the MMD two-sample test, facilitates its efficient online computation on any kernel-enriched domain, and is able to detect any disparity between distributions. Our experiments and analysis show that (1) MMDEW achieves better detection quality than state-of-the-art competitors and that (2) the algorithm has polylogarithmic runtime and logarithmic memory requirements, which allow its deployment to the streaming setting.


title: Towards the chiral phase transition in the Roberge-Weiss plane

abstract: We discuss the interplay between chiral and center sector phase transitions that occur in QCD with an imaginary quark chemical potential $\mu=i(2n+1) \pi T/3$. Based on a finite size scaling analysis in (2+1)-flavor QCD using HISQ fermions with a physical strange quark mass and a range of light quark masses, we show that the endpoint of the line of first-order Roberge-Weiss (RW) transitions between center sectors is second order for light quark masses $m_l\ge m_s/320$, and that it belongs to the $3$-d, $Z(2)$ universality class. The operator for the chiral condensate behaves like an energy-like operator in an effective spin model for the RW phase transition. As a consequence, for any non-zero value of the quark mass, the chiral condensate will have an infinite slope at the RW phase transition temperature, $T_{RW}$. Its fluctuation, the disconnected chiral susceptibility, behaves like the specific heat in $Z(2)$ symmetric models and diverges in the infinite volume limit at the RW phase transition temperature $T_{RW}$ for any non-zero value of the light quark masses. Our analysis suggests the critical temperatures for the RW phase transition and the chiral phase transition coincide in the RW plane. On lattices with temporal extent $N_\tau=4$, we find in the chiral limit $T_{\chi}=T_{RW}=195(1)~$MeV.


title: Compact H\"older retractions and nearest point maps

abstract: In this paper, two main results concerning uniformly continuous retractions are proved. First, an $\alpha$-H\"older retraction from any separable Banach space onto a compact convex subset whose closed linear span is the whole space is constructed for every positive $\alpha<1$. This constitutes a positive solution to a H\"older version of a question raised by Godefroy and Ozawa. In fact, compact convex sets are found to be absolute $\alpha$-H\"older retracts under certain assumption of flatness. Second, we provide an example of a strictly convex Banach space $X$ arbitrarily close to $\ell_2$ (for the Banach Mazur distance) and a finite dimensional compact convex subset of $X$ for which the nearest point map is not uniformly continuous even when restricted to bounded sets.


title: VeriFi: Towards Verifiable Federated Unlearning

abstract: Federated learning (FL) is a collaborative learning paradigm where participants jointly train a powerful model without sharing their private data. One desirable property for FL is the implementation of the right to be forgotten (RTBF), i.e., a leaving participant has the right to request to delete its private data from the global model. However, unlearning itself may not be enough to implement RTBF unless the unlearning effect can be independently verified, an important aspect that has been overlooked in the current literature. In this paper, we prompt the concept of verifiable federated unlearning, and propose VeriFi, a unified framework integrating federated unlearning and verification that allows systematic analysis of the unlearning and quantification of its effect, with different combinations of multiple unlearning and verification methods. In VeriFi, the leaving participant is granted the right to verify (RTV), that is, the participant notifies the server before leaving, then actively verifies the unlearning effect in the next few communication rounds. The unlearning is done at the server side immediately after receiving the leaving notification, while the verification is done locally by the leaving participant via two steps: marking (injecting carefully-designed markers to fingerprint the leaver) and checking (examining the change of the global model's performance on the markers). Based on VeriFi, we conduct the first systematic and large-scale study for verifiable federated unlearning, considering 7 unlearning methods and 5 verification methods. Particularly, we propose a more efficient and FL-friendly unlearning method, and two more effective and robust non-invasive-verification methods. We extensively evaluate VeriFi on 7 datasets and 4 types of deep learning models. Our analysis establishes important empirical understandings for more trustworthy federated unlearning.


title: Effect of scattering and electronic noise upon selection of detectors for Gamma Computerized Tomography

abstract: Computed tomography (CT) has become a vital tool in a variety of fields as a result of technological developments and continual improvement. High-quality CT images are desirable for image interpretation and obtaining information from CT images. A variety of things influence the CT image quality. Various research groups have investigated and attempted to improve image quality by examining noise/error associated with CT geometry. This study aims to select detectors for CT, which yield the least amount of noise in projection data. Three distinct gamma-ray detectors that are routinely used in CT have been compared in terms of scattering and electrical noise. The sensitivity of Kanpur Theorem-1 to scattering noise is demonstrated in this work and used to quantify the relative level of scattering noise. The detector measures the signal multiple times, and the standard deviation of the signal is used to calculate the electronic noise. It is observed that IC CsI(Tl) scintillation detector produces low electronic noise and relative scattering noise as compared to conventional electronic detectors; NaI(Tl) and HPGe.


title: Service Discovery in Social Internet of Things using Graph Neural Networks

abstract: Internet-of-Things (IoT) networks intelligently connect thousands of physical entities to provide various services for the community. It is witnessing an exponential expansion, which is complicating the process of discovering IoT devices existing in the network and requesting corresponding services from them. As the highly dynamic nature of the IoT environment hinders the use of traditional solutions of service discovery, we aim, in this paper, to address this issue by proposing a scalable resource allocation neural model adequate for heterogeneous large-scale IoT networks. We devise a Graph Neural Network (GNN) approach that utilizes the social relationships formed between the devices in the IoT network to reduce the search space of any entity lookup and acquire a service from another device in the network. This proposed resource allocation approach surpasses standardization issues and embeds the structure and characteristics of the social IoT graph, by the means of GNNs, for eventual clustering analysis process. Simulation results applied on a real-world dataset illustrate the performance of this solution and its significant efficiency to operate on large-scale IoT networks.


title: Intramolecular Vibrational Redistribution in Formic Acid and its Deuterated Forms

abstract: The intramolecular vibrational relaxation dynamics of formic acid and its deuterated isotopologues is simulated on the full-dimensional potential energy surface of Richter and Carbonniere [F. Richter and P. Carbonniere, J. Chem. Phys., 148, 064303 (2018)] using the Heidelberg MCTDH package. Mode couplings with the torsion coordinate capturing most of the trans-cis isomerisation are identified in the dynamics of artificially excited vibrational mode overtones. The C-O stretch bright vibrational mode is coupled to the out-of-the plane torsion mode in HCOOH, where this coupling could be exploited for laser-induced trans-to-cis isomerisation. Strong isotopic effects are observed: deuteration of the hydroxyl group, i.e., in HCOOD and DCOOD, destroys the C-O stretch to torsion mode coupling whereas in DCOOH, little to no effect is observed.


title: jTrans: Jump-Aware Transformer for Binary Code Similarity

abstract: Binary code similarity detection (BCSD) has important applications in various fields such as vulnerability detection, software component analysis, and reverse engineering. Recent studies have shown that deep neural networks (DNNs) can comprehend instructions or control-flow graphs (CFG) of binary code and support BCSD. In this study, we propose a novel Transformer-based approach, namely jTrans, to learn representations of binary code. It is the first solution that embeds control flow information of binary code into Transformer-based language models, by using a novel jump-aware representation of the analyzed binaries and a newly-designed pre-training task. Additionally, we release to the community a newly-created large dataset of binaries, BinaryCorp, which is the most diverse to date. Evaluation results show that jTrans outperforms state-of-the-art (SOTA) approaches on this more challenging dataset by 30.5% (i.e., from 32.0% to 62.5%). In a real-world task of known vulnerability searching, jTrans achieves a recall that is 2X higher than existing SOTA baselines.


title: Quiescence generates moving average in a stochastic epidemiological model with one host and two parasites

abstract: Mathematical modelling of epidemiological and coevolutionary dynamics is widely being used to improve disease management strategies of infectious diseases. Many diseases present some form of intra-host quiescent stage, also known as covert infection, while others exhibit dormant stages in the environment. As quiescent/dormant stages can be resistant to drug, antibiotics, fungicide treatments, it is of practical relevance to study the influence of these two life-history traits on the coevolutionary dynamics. We develop first a deterministic coevolutionary model with two parasite types infecting one host type and study analytically the stability of the dynamical system. We specifically derive a stability condition for a five-by-five system of equations with quiescence. Second, we develop a stochastic version of the model to study the influence of quiescence on stochasticity of the system dynamics. We compute the steady state distribution of the parasite types which follows a multivariate normal distribution. Furthermore, we obtain numerical solutions for the covariance matrix of the system under symmetric and asymmetric quiescence rates between parasite types. When parasite strains are identical, quiescence increases the variance of the number of infected individuals at high transmission rate and vice versa when the transmission rate is low. However, when there is competition between parasite strains with different quiescent rates, quiescence generates a moving average behaviour which dampen off stochasticity and decreases the variance of the number of infected hosts. The strain with the highest rate of entering quiescence determines the strength of the moving average and the magnitude of reduction of stochasticity. Thus, it is worth investigating simple models of multi-strain parasite under quiescence/dormancy to improve disease management strategies.


title: Investigation of atomic and molecular rates in plasma-edge simulations through experiment-simulation comparisons

abstract: Divertor plasma detachment is likely needed for the function of magnetically confined nuclear fusion. It greatly reduces the particle and heat flux incident on a target, and thus reduces the sputtering and heat loading on the target. It is therefore advantageous to have accurate simulations of plasma behaviour in the divertor to design future Tokamak divertors. A common simulation package used for this purpose is SOLPS-ITER, which has previously been observed to be underestimating the contribution of molecular effects to plasma detachment. To correct this, its reaction rate for molecular charge exchange was altered. This alteration resulted in a significant increase in the density of $D_2^+$ ions within the divertor. The particle balance and $D\alpha$ emission data was then computed from the simulation outputs. These were compared to experimental data and a set of post-processing routines for the original simulations that predicts the effect of a corrected charge exchange rate. In comparison to the post-processing predictions: the increase in Molecular activated Recombination and the depth of the target flux rollover was less than predicted. This is due to the post-processing not being self consistent and it does not account for how the alterations in reaction rate would affect the background plasma. Compared to the experimental data: the correction showed a significant improvement in the agreement of general trends, such as the increased MAR reaction rate and the rollover of target flux. However, there were still significant disagreements in the magnitudes of various reaction rates, suggesting further improvements to SOLPS-ITER are still needed.


title: Searching for quasi-periodic oscillations in astrophysical transients using Gaussian processes

abstract: Analyses of quasi-periodic oscillations (QPOs) are important to understanding the dynamic behaviour in many astrophysical objects during transient events like gamma-ray bursts, solar flares, magnetar flares and fast radio bursts. Astrophysicists often search for QPOs with frequency-domain methods such as (Lomb-Scargle) periodograms, which generally assume power-law models plus some excess around the QPO frequency. Time-series data can alternatively be investigated directly in the time domain using Gaussian Process (GP) regression. While GP regression is computationally expensive in the general case, the properties of astrophysical data and models allow fast likelihood strategies. Heteroscedasticity and non-stationarity in data have been shown to cause bias in periodogram-based analyses. Gaussian processes can take account of these properties. Using GPs, we model QPOs as a stochastic process on top of a deterministic flare shape. Using Bayesian inference, we demonstrate how to infer GP hyperparameters and assign them physical meaning, such as the QPO frequency. We also perform model selection between QPOs and alternative models such as red noise and show that this can be used to reliably find QPOs. This method is easily applicable to a variety of different astrophysical data sets. We demonstrate the use of this method on a range of short transients: a gamma-ray burst, a magnetar flare, a magnetar giant flare, and simulated solar flare data.


title: Reverse Faber-Krahn inequalities for Zaremba problems

abstract: Let $\Omega$ be a multiply-connected domain in $\mathbb{R}^n$ ($n\geq 2$) of the form $\Omega=\Omega_{\text{out}}\setminus \bar{\Omega_{\text{in}}}.$ Set $\Omega_D$ to be either $\Omega_{\text{out}}$ or $\Omega_{\text{in}}$. For $p\in (1,\infty),$ and $q\in [1,p],$ let $\tau_{1,q}(\Omega)$ be the first eigenvalue of \begin{equation*} -\Delta_p u =\tau \left(\int_{\Omega}|u|^q \text{d}x \right)^{\frac{p-q}{q}} |u|^{q-2}u\;\text{in} \;\Omega,\; u =0\;\text{on}\;\partial\Omega_D, \frac{\partial u}{\partial \eta}=0\;\text{on}\; \partial \Omega\setminus \partial \Omega_D. \end{equation*} Under the assumption that $\Omega_D$ is convex, we establish the following reverse Faber-Krahn inequality $$\tau_{1,q}(\Omega)\leq \tau_{1,q}({\Omega}^\bigstar),$$ where ${\Omega}^\bigstar=B_R\setminus \bar{B_r}$ is a concentric annular region in $\mathbb{R}^n$ having the same Lebesgue measure as $\Omega$ and such that (i) (when $\Omega_D=\Omega_{\text{out}}$) $W_1(\Omega_D)= \omega_n R^{n-1}$, and $(\Omega^\bigstar)_D=B_R$, (ii) (when $\Omega_D=\Omega_{\text{in}}$) $W_{n-1}(\Omega_D)=\omega_nr$, and $(\Omega^\bigstar)_D=B_r$. Here $W_{i}(\Omega_D)$ is the $i^{\text{th}}$ $quermassintegral$ of $\Omega_D.$ We also establish Sz. Nagy's type inequalities for parallel sets of a convex domain in $\mathbb{R}^n$ ($n\geq 3$) for our proof.


title: DPSNN: A Differentially Private Spiking Neural Network with Temporal Enhanced Pooling

abstract: Privacy protection is a crucial issue in machine learning algorithms, and the current privacy protection is combined with traditional artificial neural networks based on real values. Spiking neural network (SNN), the new generation of artificial neural networks, plays a crucial role in many fields. Therefore, research on the privacy protection of SNN is urgently needed. This paper combines the differential privacy(DP) algorithm with SNN and proposes a differentially private spiking neural network (DPSNN). The SNN uses discrete spike sequences to transmit information, combined with the gradient noise introduced by DP so that SNN maintains strong privacy protection. At the same time, to make SNN maintain high performance while obtaining high privacy protection, we propose the temporal enhanced pooling (TEP) method. It fully integrates the temporal information of SNN into the spatial information transfer, which enables SNN to perform better information transfer. We conduct experiments on static and neuromorphic datasets, and the experimental results show that our algorithm still maintains high performance while providing strong privacy protection.


title: Social network heterogeneity benefits individuals at the expense of groups in the creation of innovation

abstract: Innovation is fundamental for development and provides a competitive advantage for societies. It is the process of creating more complex technologies, ideas, or protocols from existing ones. While innovation may be created by single agents (i.e. individuals or organisations), it is often a result of social interactions between agents exchanging and combining complementary expertise and perspectives. The structure of social networks impacts this knowledge exchange process. To study the role of social network structures on the creation of new technologies, we design an evolutionary mechanistic model combining self-creation and social learning. We find that social heterogeneity allows agents to leverage the benefits of diversity and to develop technologies of higher complexity. Social heterogeneity, however, reduces the group ability to innovate. Not only the social structure but also the openness of agents to collaborate affect innovation. We find that interdisciplinary interactions lead to more complex technologies benefiting the entire group but also increase the inequality in the innovation output. Lower openness to interdisciplinary collaborations may be compensated by a higher ability to collaborate with multiple peers, but low openness also neutralises the intrinsic benefits of network heterogeneity. Our findings indicate that social network heterogeneity has contrasting effects on microscopic (local) and macroscopic (group) levels, suggesting that the emergence of innovation leaders may suppress the overall group performance.


title: Giant enhancement of third-harmonic generation in graphene-metal heterostructures

abstract: Nonlinear nanophotonics leverages engineered nanostructures to funnel light into small volumes and intensify nonlinear optical processes with spectral and spatial control. Due to its intrinsically large and electrically tunable nonlinear optical response, graphene is an especially promising nanomaterial for nonlinear optoelectronic applications. Here we report on exceptionally strong optical nonlinearities in graphene-insulator-metal heterostructures, demonstrating an enhancement by three orders of magnitude in the third-harmonic signal compared to bare graphene. Furthermore, by increasing the graphene Fermi energy through an external gate voltage, we find that graphene plasmons mediate the optical nonlinearity and modify the third-harmonic signal. Our findings show that graphene-insulator-metal is a promising heterostructure for optically-controlled and electrically-tunable nano-optoelectronic components.


title: Accelerating High-Order Mesh Optimization Using Finite Element Partial Assembly on GPUs

abstract: In this paper we present a new GPU-oriented mesh optimization method based on high-order finite elements. Our approach relies on node movement with fixed topology, through the Target-Matrix Optimization Paradigm (TMOP) and uses a global nonlinear solve over the whole computational mesh, i.e., all mesh nodes are moved together. A key property of the method is that the mesh optimization process is recast in terms of finite element operations, which allows us to utilize recent advances in the field of GPU-accelerated high-order finite element algorithms. For example, we reduce data motion by using tensor factorization and matrix-free methods, which have superior performance characteristics compared to traditional full finite element matrix assembly and offer advantages for GPU-based HPC hardware. We describe the major mathematical components of the method along with their efficient GPU-oriented implementation. In addition, we propose an easily reproducible mesh optimization test that can serve as a performance benchmark for the mesh optimization community.


title: Mathematical Models of Human Drivers Using Artificial Risk Fields

abstract: In this paper, we use the concept of artificial risk fields to predict how human operators control a vehicle in response to upcoming road situations. A risk field assigns a non-negative risk measure to the state of the system in order to model how close that state is to violating a safety property, such as hitting an obstacle or exiting the road. Using risk fields, we construct a stochastic model of the operator that maps from states to likely actions. We demonstrate our approach on a driving task wherein human subjects are asked to drive a car inside a realistic driving simulator while avoiding obstacles placed on the road. We show that the most likely risk field given the driving data is obtained by solving a convex optimization problem. Next, we apply the inferred risk fields to generate distinct driving behaviors while comparing predicted trajectories against ground truth measurements. We observe that the risk fields are excellent at predicting future trajectory distributions with high prediction accuracy for up to twenty seconds prediction horizons. At the same time, we observe some challenges such as the inability to account for how drivers choose to accelerate/decelerate based on the road conditions.


title: Interpretable Feature Engineering for Time Series Predictors using Attention Networks

abstract: Regression problems with time-series predictors are common in banking and many other areas of application. In this paper, we use multi-head attention networks to develop interpretable features and use them to achieve good predictive performance. The customized attention layer explicitly uses multiplicative interactions and builds feature-engineering heads that capture temporal dynamics in a parsimonious manner. Convolutional layers are used to combine multivariate time series. We also discuss methods for handling static covariates in the modeling process. Visualization and explanation tools are used to interpret the results and explain the relationship between the inputs and the extracted features. Both simulation and real dataset are used to illustrate the usefulness of the methodology. Keyword: Attention heads, Deep neural networks, Interpretable feature engineering


title: Convergence of some perturbed sequences of rational powers and application to syracuse problem

abstract: Sequences of rational powers \left( \xi\left( \frac{p}{q} \right)^{n} \right)_{n\ge 0}, especially in the case \frac{p}{q}=\frac{3}{2}, have a connection with many important combinatorics and number theory problems as for example Syracuse, Z-number and waring problems. Conjectures from such problems are known to be intractable and only few partial results exist until now. In this paper, we study a family of perturbed sequences of rational powers called 'Branch sequences' of the form \left( S_{n}=\left( \xi+\Sigma_{n} \right)\left( \frac{p^{n}}{q^{n+e_{n}}} \right) \right)_{n\ge 0}. Under the assumption that such sequences are deterministic and they have controlled positive perturbations, we establish the convergence result: min_{n\ge 0}(S_{n})\le q^{2}. As an application, we show that Syracuse sequences are 'Branch sequences' with all the required conditions for convergence and therefore this confirms the Collatz conjecture. Keywords: Sequences of rational powers, Syracuse conjecture, Collatz problem, 3x+1 problem.


title: Wigner-Smith Time Delay Matrix for Acoustic Scattering: Computational Aspects

abstract: The Wigner-Smith (WS) time delay matrix relates an acoustic system's scattering matrix to its wavenumber derivative. The entries of the WS time delay matrix can be expressed in terms of energy density-like volume integrals, which cannot be efficiently evaluated in a boundary element method framework. This paper presents two schemes for efficiently populating the WS time delay matrix. The direct formulation casts the energy density-like volume integrals into integrals of the incident field and the field and/or its normal derivative over the scatterer surface. The indirect formulation computes the system's scattering matrix and its wavenumber derivative, again via surface integration, and then invokes the WS relationship to compute the WS time delay matrix. Both the direct and the indirect formulations yield equivalent results and can be easily integrated into standard boundary element codes.


title: The Quantum-House Effect: Filling the Gap Between Classicality and Quantum Discord

abstract: We introduce the quantum-house effect, a non-local phenomenon which apparently does not require quantum discord to be present. It suffices for the effect if neither subsystem of a bipartite system is in a pure state. This way, the quantum-house effect completely fills the gap between trivial correlations and quantum discord. However, we discuss why the situation is more subtle than that, by showing that in a concrete cryptographic setting called "the quantum-house game", the ability to produce quantum discord is in fact necessary for the quantum-house effect to work. Then, we suggest a principle called "quantum detachment" to characterize where quantumness in general departs from classicality, based on the information a physical system contains about itself. The quantum-house effect is demonstrated on SpinQ Gemini, a 2-qubit liquid-state NMR desktop quantum computer.


title: Semantic-preserved Communication System for Highly Efficient Speech Transmission

abstract: Deep learning (DL) based semantic communication methods have been explored for the efficient transmission of images, text, and speech in recent years. In contrast to traditional wireless communication methods that focus on the transmission of abstract symbols, semantic communication approaches attempt to achieve better transmission efficiency by only sending the semantic-related information of the source data. In this paper, we consider semantic-oriented speech transmission which transmits only the semantic-relevant information over the channel for the speech recognition task, and a compact additional set of semantic-irrelevant information for the speech reconstruction task. We propose a novel end-to-end DL-based transceiver which extracts and encodes the semantic information from the input speech spectrums at the transmitter and outputs the corresponding transcriptions from the decoded semantic information at the receiver. For the speech to speech transmission, we further include a CTC alignment module that extracts a small number of additional semantic-irrelevant but speech-related information for the better reconstruction of the original speech signals at the receiver. The simulation results confirm that our proposed method outperforms current methods in terms of the accuracy of the predicted text for the speech to text transmission and the quality of the recovered speech signals for the speech to speech transmission, and significantly improves transmission efficiency. More specifically, the proposed method only sends 16% of the amount of the transmitted symbols required by the existing methods while achieving about 10% reduction in WER for the speech to text transmission. For the speech to speech transmission, it results in an even more remarkable improvement in terms of transmission efficiency with only 0.2% of the amount of the transmitted symbols required by the existing method.


title: Step Size is a Consequential Parameter in Continuous Cellular Automata

abstract: Step size in continuous cellular automata (CA) plays an important role in the stability and behavior of self-organizing patterns. Continous CA dynamics are defined by formula very similar to numerical estimation of physics-based ordinary differential equations, specifically Euler's method, for which a large step size is often inaccurate and unstable. Rather than asymptotically approaching more accurate estimates of CA dynamics with decreasing step size, continuous CA may support different self-organizing patterns at different ranges of step size. We discuss several examples of mobile patterns that become unstable at step sizes that are too small as well as too large. Additionally, an individual mobile pattern may exhibit qualitatively different behavior across a range of step sizes. We demonstrate examples of the effects of step size in pattern stability and qualitative behavior in continuous CA implemented in the Lenia framework and its variant, Glaberish.


title: Deep interpretable ensembles

abstract: Ensembles improve prediction performance and allow uncertainty quantification by aggregating predictions from multiple models. In deep ensembling, the individual models are usually black box neural networks, or recently, partially interpretable semi-structured deep transformation models. However, interpretability of the ensemble members is generally lost upon aggregation. This is a crucial drawback of deep ensembles in high-stake decision fields, in which interpretable models are desired. We propose a novel transformation ensemble which aggregates probabilistic predictions with the guarantee to preserve interpretability and yield uniformly better predictions than the ensemble members on average. Transformation ensembles are tailored towards interpretable deep transformation models but are applicable to a wider range of probabilistic neural networks. In experiments on several publicly available data sets, we demonstrate that transformation ensembles perform on par with classical deep ensembles in terms of prediction performance, discrimination, and calibration. In addition, we demonstrate how transformation ensembles quantify both aleatoric and epistemic uncertainty, and produce minimax optimal predictions under certain conditions.


title: Uncertainty Quantification for Transport in Porous media using Parameterized Physics Informed neural Networks

abstract: We present a Parametrization of the Physics Informed Neural Network (P-PINN) approach to tackle the problem of uncertainty quantification in reservoir engineering problems. We demonstrate the approach with the immiscible two phase flow displacement (Buckley-Leverett problem) in heterogeneous porous medium. The reservoir properties (porosity, permeability) are treated as random variables. The distribution of these properties can affect dynamic properties such as the fluids saturation, front propagation speed or breakthrough time. We explore and use to our advantage the ability of networks to interpolate complex high dimensional functions. We observe that the additional dimensions resulting from a stochastic treatment of the partial differential equations tend to produce smoother solutions on quantities of interest (distributions parameters) which is shown to improve the performance of PINNS. We show that provided a proper parameterization of the uncertainty space, PINN can produce solutions that match closely both the ensemble realizations and the stochastic moments. We demonstrate applications for both homogeneous and heterogeneous fields of properties. We are able to solve problems that can be challenging for classical methods. This approach gives rise to trained models that are both more robust to variations in the input space and can compete in performance with traditional stochastic sampling methods.


title: Machine learning methods for Schlieren imaging of a plasma channel in tenuous atomic vapor

abstract: We investigate the usage of a Schlieren imaging setup to measure the geometrical dimensions of a plasma channel in atomic vapor. Near resonant probe light is used to image the plasma channel in a tenuous vapor and machine learning techniques are tested for extracting quantitative information from the images. By building a database of simulated signals with a range of plasma parameters for training Deep Neural Networks, we demonstrate that they can extract from the Schlieren images reliably and with high accuracy the location, the radius and the maximum ionization fraction of the plasma channel as well as the width of the transition region between the core of the plasma channel and the unionized vapor. We test several different neural network architectures with supervised learning and show that the parameter estimations supplied by the networks are resilient with respect to slight changes of the experimental parameters that may occur in the course of a measurement.


title: A Mathematical Analysis and Evaluation of Varroa mite Control Methods for a Mite-infested Honey bee Colony

abstract: In this paper, we present a mathematical model for the interaction between honey bees and mites. The dynamics of a mite-infested honey bee colony and the evaluation of the commonly used mite-control strategies (traditional, mechanical and chemical) are studied. The mite-free and mite reproduction numbers are derived using the next generation operator approach. The mathematical analysis of the model reveals that in the absence of mites, the colony survives if the mite-free reproduction number is greater than unity otherwise it goes extinct. Stability and sensitivity analyses of the model reveal that the egg laying rate of the queen bee is key in regulating mite reproduction. Adult bee grooming and hygienic behavior of worker bees have also been shown to play a vital role in reducing parasitism. Using the Volterra-Lyapunov stable matrix approach, the mite-infested equilibrium is confirmed to be globally asymptotically stable when the mite-free reproduction number is greater than unity and the mite reproduction number is greater than unity. It is also shown that varroa mite control strategies that focus on limiting mite-reproduction such as caging the queen bee and using a young queen bee quickly reduces the mite reproduction number to a value less than unity compared to those that are intended to kill the mites.


title: On Duclos-Exner's conjecture about waveguides in strong uniform magnetic fields

abstract: We consider the Dirichlet Laplacian with uniform magnetic field on a curved strip in two dimensions. We give a sufficient condition ensuring the existence of the discrete spectrum in the strong magnetic field limit.


title: Global geomagnetic perturbation forecasting using Deep Learning

abstract: Geomagnetically Induced Currents (GICs) arise from spatio-temporal changes to Earth's magnetic field which arise from the interaction of the solar wind with Earth's magnetosphere, and drive catastrophic destruction to our technologically dependent society. Hence, computational models to forecast GICs globally with large forecast horizon, high spatial resolution and temporal cadence are of increasing importance to perform prompt necessary mitigation. Since GIC data is proprietary, the time variability of horizontal component of the magnetic field perturbation (dB/dt) is used as a proxy for GICs. In this work, we develop a fast, global dB/dt forecasting model, which forecasts 30 minutes into the future using only solar wind measurements as input. The model summarizes 2 hours of solar wind measurement using a Gated Recurrent Unit, and generates forecasts of coefficients which are folded with a spherical harmonic basis to enable global forecasts. When deployed, our model produces results in under a second, and generates global forecasts for horizontal magnetic perturbation components at 1-minute cadence. We evaluate our model across models in literature for two specific storms of 5 August 2011 and 17 March 2015, while having a self-consistent benchmark model set. Our model outperforms, or has consistent performance with state-of-the-practice high time cadence local and low time cadence global models, while also outperforming/having comparable performance with the benchmark models. Such quick inferences at high temporal cadence and arbitrary spatial resolutions may ultimately enable accurate forewarning of dB/dt for any place on Earth, resulting in precautionary measures to be taken in an informed manner.

categories: physics.space-ph astro-ph.IM astro-ph.SR cs.LG


title: Neuro-Symbolic Learning of Answer Set Programs from Raw Data

abstract: One of the ultimate goals of Artificial Intelligence is to assist humans in complex decision making. A promising direction for achieving this goal is Neuro-Symbolic AI, which aims to combine the interpretability of symbolic techniques with the ability of deep learning to learn from raw data. However, most current approaches require manually engineered symbolic knowledge, and where end-to-end training is considered, such approaches are either restricted to learning definite programs, or are restricted to training binary neural networks. In this paper, we introduce Neuro-Symbolic Inductive Learner (NSIL), an approach that trains a general neural network to extract latent concepts from raw data, whilst learning symbolic knowledge that maps latent concepts to target labels. The novelty of our approach is a method for biasing the learning of symbolic knowledge, based on the in-training performance of both neural and symbolic components. We evaluate NSIL on three problem domains of different complexity, including an NP-complete problem. Our results demonstrate that NSIL learns expressive knowledge, solves computationally complex problems, and achieves state-of-the-art performance in terms of accuracy and data efficiency. Code and technical appendix: https://github.com/DanCunnington/NSIL


title: Efficient generation of entangled multi-photon graph states from a single atom

abstract: Entanglement is a powerful concept with an enormous potential for scientific and technological advances. A central focus in modern research is to extend the generation and control of entangled states from few to many qubits, and protect them against decoherence. Optical photons play a prominent role as these qubit carriers are naturally robust and easy to manipulate. However, the most successful technique to date for creating photonic entanglement is inherently probabilistic and therefore subject to severe scalability limitations. Here we avoid these by implementing a deterministic protocol with a single memory atom in a cavity. We interleave controlled single-photon emissions with tailored atomic qubit rotations to efficiently grow Greenberger-Horne-Zeilinger states of up to 14 photons and linear cluster states of up to 12 photons with a fidelity lower bounded by 76(6)% and 56(4)%, respectively. Thanks to a source-to-detection efficiency of 43.18(7)% per photon we measure these large states about once every minute, orders of magnitude faster than in any previous experiment. In the future, this rate could be increased even further, the scheme could be extended to two atoms in a cavity, or several sources could be quantum mechanically coupled, to generate higher-dimensional cluster states. Overcoming the limitations encountered by probabilistic schemes for photonic entanglement generation, our results may offer a way towards scalable measurement-based quantum computation and communication.


title: On the Routing Convergence Delay in the Lightning Network

abstract: Nodes in the Lightning Network synchronise routing information through a gossip protocol that makes use of a staggered broadcast mechanism. In this work, we show that the convergence delay in the network is larger than what would be expected from the protocol's specification and that payment attempt failures caused by the delay are more frequent, the larger the delay is. To this end, we measure the convergence delay incurred in the network and analyse what its primary causes are. Moreover, we further investigate and confirm our findings through a time-discrete simulation of the Lightning Network gossip protocol. We explore the use of alternative gossip protocols as well as parameter variations of the current protocol and evaluate them by the resulting bandwidth usage and convergence delay. Our research shows that there are multiple ways of lowering the convergence delay, ranging from simple parameter changes to overhauling the entire protocol.


title: Generic Decoding in the Cover Metric

abstract: In this paper, we study the hardness of decoding a random code endowed with the cover metric. As the cover metric lies in between the Hamming and rank metric, it presents itself as a promising candidate for code-based cryptography. We give a polynomial-time reduction from the classical Hamming-metric decoding problem, which proves the NP-hardness of the decoding problem in the cover metric. We then provide a generic decoder, following the information set decoding idea from Prange's algorithm in the Hamming metric. A study of its cost then shows that the complexity is exponential in the number of rows and columns, which is in contrast to the behaviour in the Hamming metric, where the complexity grows exponentially in the number of code symbols.


title: High-efficiency, 80-mm aperture metalens telescope

abstract: Metalenses, artificially engineered subwavelength nanostructures to focus light within ultrathin thickness, promise potential for a paradigm shift of conventional optical devices. However, the aperture sizes of metalenses are usually bound within hundreds of micrometers by the commonly-used scanning-based fabrication methods, limiting their usage on practical optical devices like telescopes. Here, for the first time, we demonstrate a high-efficiency, single-lens, refractive metalens telescope. We developed a mass production-friendly workflow for fabricating wafer-scale (80-mm aperture) metalenses using deep-ultraviolet (DUV) photolithography and a multi-exposure process involving reticle rotation and pattern stitching to leverage the radial symmetry of metalenses. Our metalens works in the near-infrared region (1200 - 1600 nm) with diffraction-limited performance and a high peak focusing efficiency of 80.84% at 1450 nm experimentally. Based on the metalens, we built a single-lens telescope and acquired images of the lunar surface, revealing its geographical structures. We believe our demonstration of the metalens telescope proves the exciting potential lying in the metasurfaces and could bring new possibilities for areas involving large optical systems, including geosciences, planetary observation, and astrophysical science.


title: SIoU Loss: More Powerful Learning for Bounding Box Regression

abstract: The effectiveness of Object Detection, one of the central problems in computer vision tasks, highly depends on the definition of the loss function - a measure of how accurately your ML model can predict the expected outcome. Conventional object detection loss functions depend on aggregation of metrics of bounding box regression such as the distance, overlap area and aspect ratio of the predicted and ground truth boxes (i.e. GIoU, CIoU, ICIoU etc). However, none of the methods proposed and used to date considers the direction of the mismatch between the desired ground box and the predicted, "experimental" box. This shortage results in slower and less effective convergence as the predicted box can "wander around" during the training process and eventually end up producing a worse model. In this paper a new loss function SIoU was suggested, where penalty metrics were redefined considering the angle of the vector between the desired regression. Applied to conventional Neural Networks and datasets it is shown that SIoU improves both the speed of training and the accuracy of the inference. The effectiveness of the proposed loss function was revealed in a number of simulations and tests.


title: On-demand continuous-variable quantum entanglement source for integrated circuits

abstract: Integration of devices generating nonclassical states~(such as entanglement) into photonic circuits is one of the major goals in achieving integrated quantum circuits~(IQCs). This is demonstrated successfully in recent decades. Controlling the nonclassicality generation in these micron-scale devices is also crucial for the robust operation of the IQCs. Here, we propose a micron-scale quantum entanglement device whose nonlinearity (so the generated nonclassicality) can be tuned by several orders of magnitude via an \textit{applied voltage} without altering the linear response. Quantum emitters~(QEs), whose level-spacing can be tuned by voltage, are embedded into the hotspot of a metal nanostructure~(MNS). QE-MNS coupling introduces a Fano resonance in the ``nonlinear response''. Nonlinearity, already enhanced extremely due to localization, can be controlled by the QEs' level-spacing. Nonlinearity can either be suppressed (also when the probe is on the device) or be further enhanced by several orders. Fano resonance takes place in a relatively narrow frequency window so that $\sim$meV voltage-tunability for QEs becomes sufficient for a \textit{continuous} turning on/off of the nonclassicality. This provides as much as 5 orders of magnitude modulation depths.


title: SoK: Hardware-supported Trusted Execution Environments

abstract: The growing complexity of modern computing platforms and the need for strong isolation protections among their software components has led to the increased adoption of Trusted Execution Environments (TEEs). While several commercial and academic TEE architectures have emerged in recent times, they remain hard to compare and contrast. More generally, existing TEEs have not been subject to a holistic systematization to understand the available design alternatives for various aspects of TEE design and their corresponding pros-and-cons. Therefore, in this work, we analyze the design of existing TEEs and systematize the mechanisms that TEEs implement to achieve their security goals, namely, verifiable launch, run-time isolation, trusted IO, and secure storage. More specifically, we analyze the typical architectural building blocks underlying TEE solutions, design alternatives for each of these components and the trade-offs that they entail. We focus on hardware-assisted TEEs and cover a wide range of TEE proposals from academia and the industry. Our analysis shows that although TEEs are diverse in terms of their goals, usage models, and instruction set architectures, they all share many common building blocks in terms of their design.


title: $2 n^2$-inequality for $cA_1$ points and applications to birational rigidity

abstract: The $4 n^2$-inequality for smooth points plays an important role in the proofs of birational (super)rigidity. The main aim of this paper is to generalize such an inequality to terminal singular points of type $cA_1$, and obtain a $2 n^2$-inequality for $cA_1$ points. As applications, we prove birational (super)rigidity of sextic double solids, many other prime Fano 3-fold weighted complete intersections, and del Pezzo fibrations of degree $1$ over $\mathbb{P}^1$ satisfying the $K^2$-condition, all of which have at most terminal $cA_1$ singularities and terminal quotient singularities. These give first examples of birationally (super)rigid Fano 3-folds and del Pezzo fibrations admitting a $cA_1$ point which is not an ordinary double point.


title: High dimensional Bernoulli distributions: algebraic representation and applications

abstract: The main contribution of this paper is to find a representation of the class $\mathcal{F}_d(p)$ of multivariate Bernoulli distributions with the same mean $p$ that allows us to find its generators analytically in any dimension. We map $\mathcal{F}_d(p)$ to an ideal of points and we prove that the class $\mathcal{F}_d(p)$ can be generated from a finite set of simple polynomials. We present two applications. Firstly, we show that polynomial generators help to find extremal points of the convex polytope $\mathcal{F}_d(p)$ in high dimensions. Secondly, we solve the problem of determining the lower bounds in the convex order for sums of multivariate Bernoulli distributions with given margins, but with an unspecified dependence structure.


title: Theory of strong coupling between molecules and surface plasmons on a grating

abstract: The strong coupling of molecules with surface plasmons results in hybrid states which are part molecule, part surface-bound light. Since molecular resonances may acquire the spatial coherence of plasmons, which have mm-scale propagation lengths, strong-coupling with molecular resonances potentially enables long-range molecular energy transfer. Gratings are often used to couple incident light to surface plasmons, by scattering the otherwise non-radiative surface plasmon inside the light-line. We calculate the dispersion relation for surface plasmons strongly coupled to molecular resonances when grating scattering is involved. By treating the molecules as independent oscillators rather than the more typically-considered single collective dipole, we find the full multi-band dispersion relation. This approach offers a natural way to include the dark states in the dispersion. We demonstrate that for a molecular resonance tuned near the crossing point of forward and backward grating-scattered plasmon modes, the interaction between plasmons and molecules gives a five-band dispersion relation, including a bright state not captured in calculations using a single collective dipole. We also show that the role of the grating in breaking the translational invariance of the system appears in the position-dependent coupling between the molecules and the surface plasmon. The presence of the grating is thus not only important for the experimental observation of molecule-surface-plasmon coupling, but also provides an additional design parameter that tunes the system.


title: Machine learning method for return direction forecasting of Exchange Traded Funds using classification and regression models

abstract: This article aims to propose and apply a machine learning method to analyze the direction of returns from Exchange Traded Funds (ETFs) using the historical return data of its components, helping to make investment strategy decisions through a trading algorithm. In methodological terms, regression and classification models were applied, using standard datasets from Brazilian and American markets, in addition to algorithmic error metrics. In terms of research results, they were analyzed and compared to those of the Na\"ive forecast and the returns obtained by the buy & hold technique in the same period of time. In terms of risk and return, the models mostly performed better than the control metrics, with emphasis on the linear regression model and the classification models by logistic regression, support vector machine (using the LinearSVC model), Gaussian Naive Bayes and K-Nearest Neighbors, where in certain datasets the returns exceeded by two times and the Sharpe ratio by up to four times those of the buy & hold control model.


title: Room temperature coherent control of protected qubit in hexagonal boron nitride

abstract: Spin defects in foils of hexagonal boron nitride are an attractive platform for magnetic field imaging, since the probe can be placed in close proximity to the target. However, as a III-V material the electron spin coherence is limited by the nuclear spin environment, with spin echo coherence time of $\sim100~\mathrm{ns}$ at room temperature accessible magnetic fields. We use a strong continuous microwave drive with a modulation in order to stabilize a Rabi oscillation, extending the coherence time up to $\sim4~\mathrm{\mu s}$, which is close to the 10-$\mathrm{\mu s}$ electron spin lifetime in our sample. We then define a protected qubit basis, and show full control of the protected qubit. The coherence times of a superposition of the protected qubit can be as high as $0.8~\mathrm{\mu s}$. This work establishes that boron vacancies in hexagonal boron nitride can have electron spin coherence times that are competitive with typical NV-centers in small nanodiamonds under ambient conditions.


title: Secure and Efficient Tunneling of MACsec for Modern Industrial Use Cases

abstract: Trends like Industry 4.0 will pose new challenges for future industrial networks. Greater interconnectedness, higher data volumes as well as new requirements for speeds as well as security will make new approaches necessary. Performanceoptimized networking techniques will be demanded to implement new use cases, like network separation and isolation, in a secure fashion. A new and highly efficient protocol, that will be vital for that purpose, is MACsec. It is a Layer 2 encryption protocol that was previously extended specifically for industrial environments. Yet, it lacks the ability to bridge local networks. Therefore, in this work, we propose a secure and efficient Layer 3 tunneling scheme for MACsec. We design and implement two approaches, that are equally secure and considerably outperform comparable state-of-the-art techniques.


title: A Human-Centric Assessment Framework for AI

abstract: With the rise of AI systems in real-world applications comes the need for reliable and trustworthy AI. An essential aspect of this are explainable AI systems. However, there is no agreed standard on how explainable AI systems should be assessed. Inspired by the Turing test, we introduce a human-centric assessment framework where a leading domain expert accepts or rejects the solutions of an AI system and another domain expert. By comparing the acceptance rates of provided solutions, we can assess how the AI system performs compared to the domain expert, and whether the AI system's explanations (if provided) are human-understandable. This setup -- comparable to the Turing test -- can serve as a framework for a wide range of human-centric AI system assessments. We demonstrate this by presenting two instantiations: (1) an assessment that measures the classification accuracy of a system with the option to incorporate label uncertainties; (2) an assessment where the usefulness of provided explanations is determined in a human-centric manner.


title: VLBI observations of GRB 201015A, a relatively faint GRB with a hint of Very High Energy gamma-ray emission

abstract: GRB 201015A is a long-duration Gamma-Ray Burst (GRB) which was detected at very high energies (> 100 GeV) using the MAGIC telescopes. If confirmed, this would be the fifth and least luminous GRB ever detected at this energies. We performed a radio follow-up of GRB 201015A over twelve different epochs, from 1.4 to 117 days post-burst, with the Karl G. Jansky Very Large Array, e-MERLIN and the European VLBI Network. We included optical and X-rays observations, performed with the Multiple Mirror Telescope and the Chandra X-ray Observatory respectively, together with publicly available data. We detected a point-like transient, consistent with the position of GRB 201015A until 23 and 47 days post-burst at 1.5 and 5 GHz, respectively. The source was detected also in both optical (1.4 and 2.2 days post-burst) and X-ray (8.4 and 13.6 days post-burst) observations. The multi-wavelength afterglow light curves can be explained with the standard model for a GRB seen on-axis, which expands and decelerates into a medium with a homogeneous density, while a circumburst medium with a wind-like profile is disfavoured. Notwithstanding the high resolution provided by the VLBI, we could not pinpoint any expansion or centroid displacement of the outflow. If the GRB is seen at the viewing angle which maximises the apparent velocity, we estimate that the Lorentz factor for the possible proper motion is $\Gamma_{\alpha}$ < 40 in right ascension and $\Gamma_{\delta}$ < 61 in declination. On the other hand, if the GRB is seen on-axis, the size of the afterglow is <5 pc and <16 pc at 25 and 47 days. Finally, the early peak in the optical light curve suggests the presence of a reverse shock component before 0.01 days from the burst.


title: Fast Stochastic Composite Minimization and an Accelerated Frank-Wolfe Algorithm under Parallelization

abstract: We consider the problem of minimizing the sum of two convex functions. One of those functions has Lipschitz-continuous gradients, and can be accessed via stochastic oracles, whereas the other is "simple". We provide a Bregman-type algorithm with accelerated convergence in function values to a ball containing the minimum. The radius of this ball depends on problem-dependent constants, including the variance of the stochastic oracle. We further show that this algorithmic setup naturally leads to a variant of Frank-Wolfe achieving acceleration under parallelization. More precisely, when minimizing a smooth convex function on a bounded domain, we show that one can achieve an $\epsilon$ primal-dual gap (in expectation) in $\tilde{O}(1/ \sqrt{\epsilon})$ iterations, by only accessing gradients of the original function and a linear maximization oracle with $O(1/\sqrt{\epsilon})$ computing units in parallel. We illustrate this fast convergence on synthetic numerical experiments.


title: NECA: Network-Embedded Deep Representation Learning for Categorical Data

abstract: We propose NECA, a deep representation learning method for categorical data. Built upon the foundations of network embedding and deep unsupervised representation learning, NECA deeply embeds the intrinsic relationship among attribute values and explicitly expresses data objects with numeric vector representations. Designed specifically for categorical data, NECA can support important downstream data mining tasks, such as clustering. Extensive experimental analysis demonstrated the effectiveness of NECA.


title: An Empirical Study on Distribution Shift Robustness From the Perspective of Pre-Training and Data Augmentation

abstract: The performance of machine learning models under distribution shift has been the focus of the community in recent years. Most of current methods have been proposed to improve the robustness to distribution shift from the algorithmic perspective, i.e., designing better training algorithms to help the generalization in shifted test distributions. This paper studies the distribution shift problem from the perspective of pre-training and data augmentation, two important factors in the practice of deep learning that have not been systematically investigated by existing work. By evaluating seven pre-trained models, including ResNets and ViT's with self-supervision and supervision mode, on five important distribution-shift datasets, from WILDS and DomainBed benchmarks, with five different learning algorithms, we provide the first comprehensive empirical study focusing on pre-training and data augmentation. With our empirical result obtained from 1,330 models, we provide the following main observations: 1) ERM combined with data augmentation can achieve state-of-the-art performance if we choose a proper pre-trained model respecting the data property; 2) specialized algorithms further improve the robustness on top of ERM when handling a specific type of distribution shift, e.g., GroupDRO for spurious correlation and CORAL for large-scale out-of-distribution data; 3) Comparing different pre-training modes, architectures and data sizes, we provide novel observations about pre-training on distribution shift, which sheds light on designing or selecting pre-training strategy for different kinds of distribution shifts. In summary, our empirical study provides a comprehensive baseline for a wide range of pre-training models fine-tuned with data augmentation, which potentially inspires research exploiting the power of pre-training and data augmentation in the future of distribution shift study.


title: Restricted mean survival time regression model with time-dependent covariates

abstract: In clinical or epidemiological follow-up studies, methods based on time scale indicators such as the restricted mean survival time (RMST) have been developed to some extent. Compared with traditional hazard rate indicator system methods, the RMST is easier to interpret and does not require the proportional hazard assumption. To date, regression models based on the RMST are indirect or direct models of the RMST and baseline covariates. However, time-dependent covariates are becoming increasingly common in follow-up studies. Based on the inverse probability of censoring weighting (IPCW) method, we developed a regression model of the RMST and time-dependent covariates. Through Monte Carlo simulation, we verified the estimation performance of the regression parameters of the proposed model. Compared with the time-dependent Cox model and the fixed (baseline) covariate RMST model, the time-dependent RMST model has a better prediction ability. Finally, an example of heart transplantation was used to verify the above conclusions.


title: An Evolutionary Approach to Dynamic Introduction of Tasks in Large-scale Multitask Learning Systems

abstract: Multitask learning assumes that models capable of learning from multiple tasks can achieve better quality and efficiency via knowledge transfer, a key feature of human learning. Though, state of the art ML models rely on high customization for each task and leverage size and data scale rather than scaling the number of tasks. Also, continual learning, that adds the temporal aspect to multitask, is often focused to the study of common pitfalls such as catastrophic forgetting instead of being studied at a large scale as a critical component to build the next generation artificial intelligence.We propose an evolutionary method capable of generating large scale multitask models that support the dynamic addition of new tasks. The generated multitask models are sparsely activated and integrates a task-based routing that guarantees bounded compute cost and fewer added parameters per task as the model expands.The proposed method relies on a knowledge compartmentalization technique to achieve immunity against catastrophic forgetting and other common pitfalls such as gradient interference and negative transfer. We demonstrate empirically that the proposed method can jointly solve and achieve competitive results on 69public image classification tasks, for example improving the state of the art on a competitive benchmark such as cifar10 by achieving a 15% relative error reduction compared to the best model trained on public data.


title: Development of a Stereo-Vision Based High-Throughput Robotic System for Mouse Tail Vein Injection

abstract: In this paper, we present a robotic device for mouse tail vein injection. We propose a mouse holding mechanism to realize vein injection without anesthetizing the mouse, which consists of a tourniquet, vacuum port, and adaptive tail-end fixture. The position of the target vein in 3D space is reconstructed from a high-resolution stereo vision. The vein is detected by a simple but robust vein line detector. Thanks to the proposed two-staged calibration process, the total time for the injection process is limited to 1.5 minutes, despite that the position of needle and tail vein varies for each trial. We performed an injection experiment targeting 40 mice and succeeded to inject saline to 37 of them, resulting 92.5% success ratio.


title: A Case for Practical Configuration Management Using Hardware-based Security Tokens

abstract: Future industrial networks will consist of a complex mixture of new and legacy components, while new use cases and applications envisioned by Industry 4.0 will demand increased flexibility and dynamics from these networks. Industrial security gateways will become an important building block to tackle new security requirements demanded by these changes. Their introduction will further increase the already high complexity of these networks, demanding more efforts in properly and securely configuring them. Yet, past research showed, that most operators of industrial networks are already today unable to configure industrial networks in a secure fashion. Therefore, we propose a scheme that allows factory operators to configure security gateways in an easy and practical way that is also understandable for staff not trained in the security domain. We employ hardware security tokens that allow to reduce every day configuration to one physical interaction. Our results show the practical feasibility of our proposed scheme and that it does not reduce the security level of industrial security gateways in any way.


title: Periodic perturbations of a class of scalar second order functional differential equations

abstract: We study, by means of a topological approach, the forced oscillations of second order functional retarded differential equations subject to periodic perturbations. We consider a delay-type functional dependence involving a gamma probability distribution. By a linear chain trick we obtain a first order system of ODE's whose $T$-periodic solutions correspond to those of the functional equation.


title: Stochastic Cahn-Hilliard-Navier-Stokes equations with the dynamic boundary: Martingale weak solution, Markov selection

abstract: The existence of global martingale weak solution for the 2D and 3D stochastic Cahn-Hilliard-Navier-Stokes equations driven by multiplicative noise in a smooth bounded domain is established. In particular, the system is supplied with the dynamic boundary condition which accounts for the interaction between the fluid components and the rigid walls. The proof is completed by a three-level approximate scheme combining a fixed point argument and the stochastic compactness argument, overcoming challenges from strong nonlinearity, dynamic boundary and random effect. Then, we prove the existence of an almost surely Markov selection to the associated martingale problem following the abstract framework established by F. Flandoli and M. Romito.


title: Guiding Vector Fields for Following Occluded Paths

abstract: Accurately following a geometric desired path in a two-dimensional space is a fundamental task for many engineering systems, in particular mobile robots. When the desired path is occluded by obstacles, it is necessary and crucial to temporarily deviate from the path for obstacle/collision avoidance. In this paper, we develop a composite guiding vector field via the use of smooth bump functions, and provide theoretical guarantees that the integral curves of the vector field can follow an arbitrary sufficiently smooth desired path and avoid collision with obstacles of arbitrary shapes. These two behaviors are reactive since path (re)-planning and global map construction are not involved. To deal with the common deadlock problem, we introduce a switching vector field, and the Zeno behavior is excluded. Simulations are conducted to support the theoretical results.


title: Smooth subvarieties of Jacobians

abstract: We give new examples of algebraic integral cohomology classes on smooth projective complex varieties that are not integral linear combinations of classes of smooth subvarieties. Some of our examples have dimension 6, the lowest possible. The classes that we consider are minimal cohomology classes on Jacobians of very general curves. Our main tool is complex cobordism.


title: On-demand multimode optical storage in a laser-written on-chip waveguide

abstract: Quantum memory is a fundamental building block for large-scale quantum networks. On-demand optical storage with a large bandwidth, a high multimode capacity and an integrated structure simultaneously is crucial for practical application. However, this has not been demonstrated yet. Here, we fabricate an on-chip waveguide in a $\mathrm {^{151}Eu^{3+}:Y_2SiO_5}$ crystal with insertion losses of 0.2 dB, and propose a novel pumping scheme to enable spin-wave atomic frequency comb (AFC) storage with a bandwidth of 11 MHz inside the waveguide. Based on this, we demonstrate the storage of 200 temporal modes using the AFC scheme and conditional on-demand storage of 100 temporal modes using the spin-wave AFC scheme. The interference visibility between the readout light field and the reference light field is $99.0\% \pm 0.6\%$ and $97\% \pm 3\%$ for AFC and spin-wave AFC storage, respectively, indicating the coherent nature of this low-loss, multimode and integrated storage device.


title: Theory of the Energy Variance in a Quantum Bit

abstract: We define a new quantum Hermitian operator (namely, the energy variance operator) which is simply duplicated from the statistical definition of energy variance in classical physics. Its expectation value yields the standard deviation of the energy about the mean value of this latter. We show by use of an exact Hamiltonian description that this standard deviation is due to the high-frequeny energy oscillations which are usually discarded in the rotating wave aproximation. We check the present theory by recovering the duration of an abrupt quantum jump that has been described in a recent experiment.


title: Square roots of nearly planar graphs

abstract: We prove that it is NP-hard to decide whether a graph is the square of a 6-apex graph. This shows that the square root problem is not tractable for squares of sparse graphs (or even graphs from proper minor-closed classes).


title: No Time for Downtime: Understanding Post-Attack Behaviors by Customers of Managed DNS Providers

abstract: We leverage large-scale DNS measurement data on authoritative name servers to study the reactions of domain owners affected by the 2016 DDoS attack on Dyn. We use industry sources of information about domain names to study the influence of factors such as industry sector and website popularity on the willingness of domain managers to invest in high availability of online services. Specifically, we correlate business characteristics of domain owners with their resilience strategies in the wake of DoS attacks affecting their domains. Our analysis revealed correlations between two properties of domains -- industry sector and popularity -- and post-attack strategies. Specifically, owners of more popular domains were more likely to re-act to increase the diversity of their authoritative DNS service for their domains. Similarly, domains in certain industry sectors were more likely to seek out such diversity in their DNS service. For example, domains categorized as General News were nearly 6 times more likely to re-act than domains categorized as Internet Services. Our results can inform managed DNS and other network service providers regarding the potential impact of downtime on their customer portfolio.


title: Tuning Spin Transport in a Graphene Antiferromagnetic Insulator

abstract: Long-distance spin transport through anti-ferromagnetic insulators (AFMIs) is a long-standing goal of spintronics research. Unlike conventional spintronics systems, monolayer graphene in quantum Hall regime (QH) offers an unprecedented tuneability of spin-polarization and charge carrier density in QH edge states. Here, using gate-controlled QH edges as spin-dependent injectors and detectors in an all-graphene electrical circuit, for the first time we demonstrate a selective tuning of ambipolar spin transport through graphene $\nu$=0 AFMIs. By modulating polarities of the excitation bias, magnetic fields, and charge carriers that host opposite chiralities, we show that the difference between spin chemical potentials of adjacent edge channels in the spin-injector region is crucial in tuning spin-transport observed across graphene AFMI. We demonstrate that non-local response vanishes upon reversing directions of the co-propagating edge channels when the spin-filters in our devices are no longer selective for a particular spin-polarization. Our results establish a versatile set of methods to tune pure spin transport via an anti-ferromagnetic media and open a pathway to explore their applications for a broad field of antiferromagnetic spintronics research.


title: Variational thermal quantum simulation of the lattice Schwinger model

abstract: Confinement of quarks due to the strong interaction and the deconfinement at high temperatures and high densities are a basic paradigm for understanding the nuclear matter. Their simulation, however, is very challenging for classical computers due to the sign problem of solving equilibrium states of finite-temperature quantum chromodynamical systems at finite density. In this paper, we propose a variational approach, using the lattice Schwinger model, to simulate the confinement or deconfinement by investigating the string tension. We adopt an ansatz that the string tension can be evaluated without referring to quantum protocols for measuring the entropy in the free energy. Results of numeral simulation show that the string tension decreases both along the increasing of the temperature and the chemical potential, which can be an analog of the phase diagram of QCD. Our work paves a way for exploiting near-term quantum computers for investigating the phase diagram of finite-temperature and finite density for nuclear matters.


title: Would You Ask it that Way? Measuring and Improving Question Naturalness for Knowledge Graph Question Answering

abstract: Knowledge graph question answering (KGQA) facilitates information access by leveraging structured data without requiring formal query language expertise from the user. Instead, users can express their information needs by simply asking their questions in natural language (NL). Datasets used to train KGQA models that would provide such a service are expensive to construct, both in terms of expert and crowdsourced labor. Typically, crowdsourced labor is used to improve template-based pseudo-natural questions generated from formal queries. However, the resulting datasets often fall short of representing genuinely natural and fluent language. In the present work, we investigate ways to characterize and remedy these shortcomings. We create the IQN-KGQA test collection by sampling questions from existing KGQA datasets and evaluating them with regards to five different aspects of naturalness. Then, the questions are rewritten to improve their fluency. Finally, the performance of existing KGQA models is compared on the original and rewritten versions of the NL questions. We find that some KGQA systems fare worse when presented with more realistic formulations of NL questions. The IQN-KGQA test collection is a resource to help evaluate KGQA systems in a more realistic setting. The construction of this test collection also sheds light on the challenges of constructing large-scale KGQA datasets with genuinely NL questions.


title: Small domain estimation of census coverage: A case study in Bayesian analysis of complex survey data

abstract: Many countries conduct a full census survey to report official population statistics. As no census survey ever achieves 100 per cent response rate, a post-enumeration survey (PES) is usually conducted and analysed to assess census coverage and produce official population estimates by geographic area and demographic attributes. Considering the usually small size of PES, direct estimation at the desired level of disaggregation is not feasible. Design-based estimation with sampling weight adjustment is a commonly used method but is difficult to implement when survey non-response patterns cannot be fully documented and population benchmarks are not available. We overcome these limitations with a fully model-based Bayesian approach applied to the New Zealand PES. Although theory for the Bayesian treatment of complex surveys has been described, published applications of individual level Bayesian models for complex survey data remain scarce. We provide such an application through a case study of the 2018 census and PES surveys. We implement a multilevel model that accounts for the complex design of PES. We then illustrate how mixed posterior predictive checking and cross-validation can assist with model building and model selection. Finally, we discuss potential methodological improvements to the model and potential solutions to mitigate dependence between the two surveys.


title: An Experimental Comparison Between Temporal Difference and Residual Gradient with Neural Network Approximation

abstract: Gradient descent or its variants are popular in training neural networks. However, in deep Q-learning with neural network approximation, a type of reinforcement learning, gradient descent (also known as Residual Gradient (RG)) is barely used to solve Bellman residual minimization problem. On the contrary, Temporal Difference (TD), an incomplete gradient descent method prevails. In this work, we perform extensive experiments to show that TD outperforms RG, that is, when the training leads to a small Bellman residual error, the solution found by TD has a better policy and is more robust against the perturbation of neural network parameters. We further use experiments to reveal a key difference between reinforcement learning and supervised learning, that is, a small Bellman residual error can correspond to a bad policy in reinforcement learning while the test loss function in supervised learning is a standard index to indicate the performance. We also empirically examine that the missing term in TD is a key reason why RG performs badly. Our work shows that the performance of a deep Q-learning solution is closely related to the training dynamics and how an incomplete gradient descent method can find a good policy is interesting for future study.


title: Does Moral Code Have a Moral Code? Probing Delphi's Moral Philosophy

abstract: In an effort to guarantee that machine learning model outputs conform with human moral values, recent work has begun exploring the possibility of explicitly training models to learn the difference between right and wrong. This is typically done in a bottom-up fashion, by exposing the model to different scenarios, annotated with human moral judgements. One question, however, is whether the trained models actually learn any consistent, higher-level ethical principles from these datasets -- and if so, what? Here, we probe the Allen AI Delphi model with a set of standardized morality questionnaires, and find that, despite some inconsistencies, Delphi tends to mirror the moral principles associated with the demographic groups involved in the annotation process. We question whether this is desirable and discuss how we might move forward with this knowledge.


title: A systematic approach to Lyapunov analyses of continuous-time models in convex optimization

abstract: First-order methods are often analyzed via their continuous-time models, where their worst-case convergence properties are usually approached via Lyapunov functions. In this work, we provide a systematic and principled approach to find and verify Lyapunov functions for classes of ordinary and stochastic differential equations. More precisely, we extend the performance estimation framework, originally proposed by Drori and Teboulle [10], to continuous-time models. We retrieve convergence results comparable to those of discrete methods using fewer assumptions and convexity inequalities, and provide new results for stochastic accelerated gradient flows.


title: Production of three isolated photons in the parton Reggeization approach at high energies

abstract: We study a large-$p_T$ three-photon production in proton-proton collisions at the LHC. We use the leading order (LO) approximation of the parton Reggeization approach consistently merged with the next-to-leading order corrections originated from the emission of additional jet. For numerical calculations we use the parton-level generator KaTie and modified KMR-type unintegrated parton distribution functions which satisfy exact normalization conditions for arbitrary $x$. We compare our prediction with data from ATLAS collaboration at the center-of-mass energy $\sqrt{s}=8$ TeV. We find that the inclusion of the real next-to-leading-order corrections leads to a good agreement between our predictions and data with the same accuracy as for the next-to-next-to-leading calculations based on the collinear parton model of QCD. At higher energies ($\sqrt{s}=13$ and 27 TeV) parton Reggeization approach predicts larger cross sections, up to $\sim 15$ \% and $\sim 30$ \%, respectively.


abstract: We classify topological $4$-manifolds with boundary and fundamental group $\mathbb{Z}$, under some assumptions on the boundary. We apply this to classify surfaces in simply-connected $4$-manifolds with $S^3$ boundary, where the fundamental group of the surface complement is $\mathbb{Z}$. We then compare these homeomorphism classifications with the smooth setting. For manifolds, we show that every Hermitian form over $\mathbb{Z}[t^{\pm 1}]$ arises as the equivariant intersection form of a pair of exotic smooth 4-manifolds with boundary and fundamental group $\mathbb{Z}$. For surfaces we have a similar result, and in particular we show that every $2$-handlebody with $S^3$ boundary contains a pair of exotic discs.


title: Residual-Concatenate Neural Network with Deep Regularization Layers for Binary Classification

abstract: Many complex Deep Learning models are used with different variations for various prognostication tasks. The higher learning parameters not necessarily ensure great accuracy. This can be solved by considering changes in very deep models with many regularization based techniques. In this paper we train a deep neural network that uses many regularization layers with residual and concatenation process for best fit with Polycystic Ovary Syndrome Diagnosis prognostication. The network was built with improvements from every step of failure to meet the needs of the data and achieves an accuracy of 99.3% seamlessly.