title: Local-Global Knowledge Distillation in Heterogeneous Federated Learning with Non-IID Data

abstract: Federated learning enables multiple clients to collaboratively learn a global model by periodically aggregating the clients' models without transferring the local data. However, due to the heterogeneity of the system and data, many approaches suffer from the "client-drift" issue that could significantly slow down the convergence of the global model training. As clients perform local updates on heterogeneous data through heterogeneous systems, their local models drift apart. To tackle this issue, one intuitive idea is to guide the local model training by the global teachers, i.e., past global models, where each client learns the global knowledge from past global models via adaptive knowledge distillation techniques. Coming from these insights, we propose a novel approach for heterogeneous federated learning, namely FedGKD, which fuses the knowledge from historical global models for local training to alleviate the "client-drift" issue. In this paper, we evaluate FedGKD with extensive experiments on various CV/NLP datasets (i.e., CIFAR-10/100, Tiny-ImageNet, AG News, SST5) and different heterogeneous settings. The proposed method is guaranteed to converge under common assumptions, and achieves superior empirical accuracy in fewer communication runs than five state-of-the-art methods.


title: Stochastic Gradient Descent-Ascent and Consensus Optimization for Smooth Games: Convergence Analysis under Expected Co-coercivity

abstract: Two of the most prominent algorithms for solving unconstrained smooth games are the classical stochastic gradient descent-ascent (SGDA) and the recently introduced stochastic consensus optimization (SCO) [Mescheder et al., 2017]. SGDA is known to converge to a stationary point for specific classes of games, but current convergence analyses require a bounded variance assumption. SCO is used successfully for solving large-scale adversarial problems, but its convergence guarantees are limited to its deterministic variant. In this work, we introduce the expected co-coercivity condition, explain its benefits, and provide the first last-iterate convergence guarantees of SGDA and SCO under this condition for solving a class of stochastic variational inequality problems that are potentially non-monotone. We prove linear convergence of both methods to a neighborhood of the solution when they use constant step-size, and we propose insightful stepsize-switching rules to guarantee convergence to the exact solution. In addition, our convergence guarantees hold under the arbitrary sampling paradigm, and as such, we give insights into the complexity of minibatching.


title: General String Cosmologies at Order $\alpha'{}^{\,3}$

abstract: We compute the cosmological reduction of general string theories, including bosonic, heterotic and type II string theory to order $\alpha'^{3}$, i.e., with up to eight derivatives. To this end we refine recently introduced methods that allow one to bring the reduced theory in one dimension to a canonical form with only first-order time derivatives. The resulting theories are compatible with a continuous $O(d,d,\mathbb{R})$ invariance, which in turn fixes the B-field couplings.


title: Plasma Wakefield Accelerators with Ion Motion and the E-314 Experiment at FACET-II

abstract: A future plasma based linear collider has the potential to reach unprecedented energies and transform our understanding of high energy physics. The extremely dense beams in such a device would cause the plasma ions to fall toward the axis. For more mild ion motion, this introduces a nonlinear perturbation to the focusing fields inside of the bubble. However, for extreme ion motion, the ion distribution collapses to a quasi-equilibrium characterized by a thin filament of extreme density on the axis which generates strong, nonlinear focusing fields. These fields can provoke unacceptable emittance growth that can be reduced through careful beam matching. In this paper, we discuss the rich physics of ion motion, give a brief overview of plans for the E-314 experiment at FACET-II which will experimentally demonstrate ion motion in plasma accelerators, and present results of particle-in-cell simulations of ion motion relevant to the E-314 experiment.


title: Approximate Regions of Attraction in Learning with Decision-Dependent Distributions

abstract: As data-driven methods are deployed in real-world settings, the processes that generate the observed data will often react to the decisions of the learner. For example, a data source may have some incentive for the algorithm to provide a particular label (e.g. approve a bank loan), and manipulate their features accordingly. Work in strategic classification and decision-dependent distributions seeks to characterize the closed-loop behavior of deploying learning algorithms by explicitly considering the effect of the classifier on the underlying data distribution. More recently, works in performative prediction seek to classify the closed-loop behavior by considering general properties of the mapping from classifier to data distribution, rather than an explicit form. Building on this notion, we analyze repeated risk minimization as the perturbed trajectories of the gradient flows of performative risk minimization. We consider the case where there may be multiple local minimizers of performative risk, motivated by situations where the initial conditions may have significant impact on the long-term behavior of the system. We provide sufficient conditions to characterize the region of attraction for the various equilibria in this settings. Additionally, we introduce the notion of performative alignment, which provides a geometric condition on the convergence of repeated risk minimization to performative risk minimizers.


title: Micromotion minimisation by synchronous detection of parametrically excited motion

abstract: Precise control of charged particles in radio-frequency (Paul) traps requires minimising excess micromotion induced by stray electric fields. We present a method to detect and compensate such fields through amplitude modulation of the radio-frequency trapping field. Modulation at frequencies close to the motional modes of the trapped particle excites coherent motion whose amplitude linearly depends on the stray field. In trapped-ion experiments, this motion can be detected by recording the arrival times of photons scattered during laser cooling. Only a single laser beam is required to resolve fields in multiple directions. In a demonstration using a $^{88}\mathrm{Sr}^{+}$ ion in a surface electrode trap, we achieve a sensitivity of $0.1\, \mathrm{V}\, \mathrm{m}^{-1}\, /\, \sqrt{\mathrm{Hz}}$ and a minimal uncertainty of $0.015\, \mathrm{V}\, \mathrm{m}^{-1}$.


title: Simple Training Strategies and Model Scaling for Object Detection

abstract: The speed-accuracy Pareto curve of object detection systems have advanced through a combination of better model architectures, training and inference methods. In this paper, we methodically evaluate a variety of these techniques to understand where most of the improvements in modern detection systems come from. We benchmark these improvements on the vanilla ResNet-FPN backbone with RetinaNet and RCNN detectors. The vanilla detectors are improved by 7.7% in accuracy while being 30% faster in speed. We further provide simple scaling strategies to generate family of models that form two Pareto curves, named RetinaNet-RS and Cascade RCNN-RS. These simple rescaled detectors explore the speed-accuracy trade-off between the one-stage RetinaNet detectors and two-stage RCNN detectors. Our largest Cascade RCNN-RS models achieve 52.9% AP with a ResNet152-FPN backbone and 53.6% with a SpineNet143L backbone. Finally, we show the ResNet architecture, with three minor architectural changes, outperforms EfficientNet as the backbone for object detection and instance segmentation systems.


title: PV Cep and V350 Cep: stars on the way between FUors AND EXors

abstract: Based on new observations during 2015-2020 and published data, the unusual eruptive variables PV Cep and V350 Cep are examined. It is shown that PV Cep underwent a regular outburst followed by a drop in brightness that lasted overall from 2011 to 2019 and is still in a deep minimum. The outburst was accompanied by substantial changes in the intensity and profiles of a number of lines, including Ha, [SII], and [OI]. The forbidden lines generally have negative radial velocities and can be divided into four components, with variable velocities and relative intensities. V350 Cep essentially is at a maximum brightness level over the entire time and its spectrum is practically unaltered. The available data suggest that the pronounced P Cyg profile of the Ha line in the spectrum of V350 Cep appeared several years after the luminosity rise, in 1986. The luminosities of the stars in the current state are estimated to be 20 L(sun) and 3.3 L(sun), respectively. It is concluded that both stars may represent a so-called intermediate objects between the FUor and EXor classes.


title: A Fair Method for Distributing Collective Assets in the Stellar Blockchain Financial Network

abstract: The financial industry is a pioneer in Blockchain technology. One of the most popular platforms in Token-based banking is the flexible Stellar platform. This platform is open-source, and today, its wide range of features makes it possible for many countries and companies to use it in cryptocurrency and Token-based modern banking. This network charges a fee for each transaction. As well, a percentage of the net amount is generated as the inflation rate of the network due to the increased number of tokens. These fees and inflationary amounts are aggregated into a general account and ultimately distributed among members of the network on a collective vote basis. In this mechanism, network users select an account as the destination for which they wish to transfer assets using their user interface, which is generally a wallet. This account could be the account of charities that need this help. It is then determined the target distribution network based on the voting results of all members. One of the challenges in this network is the purposeful and fair distribution of these funds between accounts. In this paper, the first step is a complete infrastructure of a Stellar financial network that will consist of three network-based segments of the core network, off-chain server, and wallet interface. In the second step, a context-aware recommendation system will be explored and implemented as a solution for the purposeful management of payroll account selection. The results of this study concerning the importance of the purposeful division of collective assets and showing a context-aware recommendation system as a solution to improve the process of stellar users' participation in the voting process by effectively helping them in choosing an eligible destination


title: Fast, efficient and flexible particle accelerator optimisation using densely connected and invertible neural networks

abstract: Particle accelerators are enabling tools for scientific exploration and discovery in various disciplines. Finding optimized operation points for these complex machines is a challenging task, however, due to the large number of parameters involved and the underlying non-linear dynamics. Here, we introduce two families of data-driven surrogate models, based on deep and invertible neural networks, that can replace the expensive physics computer models. These models are employed in multi-objective optimisations to find Pareto optimal operation points for two fundamentally different types of particle accelerators. Our approach reduces the time-to-solution for a multi-objective accelerator optimisation up to a factor of 640 and the computational cost up to 98%. The framework established here should pave the way for future on-line and real-time multi-objective optimisation of particle accelerators.


title: All That's 'Human' Is Not Gold: Evaluating Human Evaluation of Generated Text

abstract: Human evaluations are typically considered the gold standard in natural language generation, but as models' fluency improves, how well can evaluators detect and judge machine-generated text? We run a study assessing non-experts' ability to distinguish between human- and machine-authored text (GPT2 and GPT3) in three domains (stories, news articles, and recipes). We find that, without training, evaluators distinguished between GPT3- and human-authored text at random chance level. We explore three approaches for quickly training evaluators to better identify GPT3-authored text (detailed instructions, annotated examples, and paired examples) and find that while evaluators' accuracy improved up to 55%, it did not significantly improve across the three domains. Given the inconsistent results across text domains and the often contradictory reasons evaluators gave for their judgments, we examine the role untrained human evaluations play in NLG evaluation and provide recommendations to NLG researchers for improving human evaluations of text generated from state-of-the-art models.


title: Modeling displaced squeezed number states in waveguide arrays

abstract: We present an exact analytical solution for a one-dimensional zigzag waveguide array with first and second neighbor interactions. It is found that the waveguide system possess a classical analog to the displaced squeezed number states. The exact solution was compared directly with the numerical solution showing a perfect agreement between both results. The implication of a linear index of refraction changing as a function of the site number is also studied. In this case, we show that the first neighbor interaction strongly influences the periodicity of Bloch oscillations.


title: Visualizing The Intermediate Representation of Just-in-Time Compilers

abstract: Just-in-Time (JIT) compilers are used by many modern programming systems in order to improve performance. Bugs in JIT compilers provide exploitable security vulnerabilities and debugging them is difficult as they are large, complex, and dynamic. Current debugging and visualization tools deal with static code and are not suitable in this domain. We describe a new approach for simplifying the large and complex intermediate representation, generated by a JIT compiler and visualize it with a metro map metaphor to aid developers in debugging. Experiments using our prototype implementation on Google's V8 JavaScript interpreter and TurboFan JIT compiler demonstrate that it can help identify and localize buggy code.


title: Toward Efficient Interactions between Python and Native Libraries

abstract: Python has become a popular programming language because of its excellent programmability. Many modern software packages utilize Python for high-level algorithm design and depend on native libraries written in C/C++/Fortran for efficient computation kernels. Interaction between Python code and native libraries introduces performance losses because of the abstraction lying on the boundary of Python and native libraries. On the one side, Python code, typically run with interpretation, is disjoint from its execution behavior. On the other side, native libraries do not include program semantics to understand algorithm defects. To understand the interaction inefficiencies, we extensively study a large collection of Python software packages and categorize them according to the root causes of inefficiencies. We extract two inefficiency patterns that are common in interaction inefficiencies. Based on these patterns, we develop PieProf, a lightweight profiler, to pinpoint interaction inefficiencies in Python applications. The principle of PieProf is to measure the inefficiencies in the native execution and associate inefficiencies with high-level Python code to provide a holistic view. Guided by PieProf, we optimize 17 real-world applications, yielding speedups up to 6.3$\times$ on application level.


title: Design and Evaluation of Scalable Representations of Communication in Gantt Charts for Large-scale Execution Traces

abstract: Gantt charts are frequently used to explore execution traces of large-scale parallel programs found in high-performance computing (HPC). In these visualizations, each parallel processor is assigned a row showing the computation state of a processor at a particular time. Lines are drawn between rows to show communication between these processors. When drawn to align equivalent calls across rows, structures can emerge reflecting communication patterns employed by the executing code. However, though these structures have the same definition at any scale, they are obscured by the density of rendered lines when displaying more than a few hundred processors. A more scalable metaphor is necessary to aid HPC experts in understanding communication in large-scale traces. To address this issue, we first conduct an exploratory study to identify what visual features are critical for determining similarity between structures shown at different scales. Based on these findings, we design a set of glyphs for displaying these structures in dense charts. We then conduct a pre-registered user study evaluating how well people interpret communication using our new representation versus their base depictions in large-scale Gantt charts. Through our evaluation, we find that our representation enables users to more accurately identify communication patterns compared to full renderings of dense charts. We discuss the results of our evaluation and findings regarding the design of metaphors for extensible structures.


title: Market regime classification with signatures

abstract: We provide a data-driven algorithm to classify market regimes for time series. We utilise the path signature, encoding time series into easy-to-describe objects, and provide a metric structure which establishes a connection between separation of regimes and clustering of points.


title: Fair Visual Recognition in Limited Data Regime using Self-Supervision and Self-Distillation

abstract: Deep learning models generally learn the biases present in the training data. Researchers have proposed several approaches to mitigate such biases and make the model fair. Bias mitigation techniques assume that a sufficiently large number of training examples are present. However, we observe that if the training data is limited, then the effectiveness of bias mitigation methods is severely degraded. In this paper, we propose a novel approach to address this problem. Specifically, we adapt self-supervision and self-distillation to reduce the impact of biases on the model in this setting. Self-supervision and self-distillation are not used for bias mitigation. However, through this work, we demonstrate for the first time that these techniques are very effective in bias mitigation. We empirically show that our approach can significantly reduce the biases learned by the model. Further, we experimentally demonstrate that our approach is complementary to other bias mitigation strategies. Our approach significantly improves their performance and further reduces the model biases in the limited data regime. Specifically, on the L-CIFAR-10S skewed dataset, our approach significantly reduces the bias score of the baseline model by 78.22% and outperforms it in terms of accuracy by a significant absolute margin of 8.89%. It also significantly reduces the bias score for the state-of-the-art domain independent bias mitigation method by 59.26% and improves its performance by a significant absolute margin of 7.08%.


title: Robust and Fully-Dynamic Coreset for Continuous-and-Bounded Learning (With Outliers) Problems

abstract: In many machine learning tasks, a common approach for dealing with large-scale data is to build a small summary, {\em e.g.,} coreset, that can efficiently represent the original input. However, real-world datasets usually contain outliers and most existing coreset construction methods are not resilient against outliers (in particular, an outlier can be located arbitrarily in the space by an adversarial attacker). In this paper, we propose a novel robust coreset method for the {\em continuous-and-bounded learning} problems (with outliers) which includes a broad range of popular optimization objectives in machine learning, {\em e.g.,} logistic regression and $ k $-means clustering. Moreover, our robust coreset can be efficiently maintained in fully-dynamic environment. To the best of our knowledge, this is the first robust and fully-dynamic coreset construction method for these optimization problems. Another highlight is that our coreset size can depend on the doubling dimension of the parameter space, rather than the VC dimension of the objective function which could be very large or even challenging to compute. Finally, we conduct the experiments on real-world datasets to evaluate the effectiveness of our proposed robust coreset method.


title: A uniform reaching phase strategy in adaptive sliding mode control

abstract: In adaptive sliding mode control methods, an updating gain strategy associated with finite-time convergence to the sliding set is essential to deal with matched bounded perturbations with unknown upper-bound. However, the estimation of the finite time of any adaptive design is a complicated task since it depends not only on the upper-bound of unknown perturbation but also on the size of initial conditions. This brief proposes a uniform adaptive reaching phase strategy (ARPS) within a predefined reaching-time. Moreover, as a case of study, the barrier function approach is extended for perturbed MIMO systems with uncertain control matrix. The usage of proposed ARPS in the MIMO case solves simultaneously two issues: giving a uniform reaching phase with a predefined reaching-time and adapting to the perturbation norm while in a predefined vicinity of the sliding manifold.


title: Dep-$L_0$: Improving $L_0$-based Network Sparsification via Dependency Modeling

abstract: Training deep neural networks with an $L_0$ regularization is one of the prominent approaches for network pruning or sparsification. The method prunes the network during training by encouraging weights to become exactly zero. However, recent work of Gale et al. reveals that although this method yields high compression rates on smaller datasets, it performs inconsistently on large-scale learning tasks, such as ResNet50 on ImageNet. We analyze this phenomenon through the lens of variational inference and find that it is likely due to the independent modeling of binary gates, the mean-field approximation, which is known in Bayesian statistics for its poor performance due to the crude approximation. To mitigate this deficiency, we propose a dependency modeling of binary gates, which can be modeled effectively as a multi-layer perceptron (MLP). We term our algorithm Dep-$L_0$ as it prunes networks via a dependency-enabled $L_0$ regularization. Extensive experiments on CIFAR10, CIFAR100 and ImageNet with VGG16, ResNet50, ResNet56 show that our Dep-$L_0$ outperforms the original $L_0$-HC algorithm of Louizos et al. by a significant margin, especially on ImageNet. Compared with the state-of-the-arts network sparsification algorithms, our dependency modeling makes the $L_0$-based sparsification once again very competitive on large-scale learning tasks. Our source code is available at https://github.com/leo-yangli/dep-l0.


title: Randic index, radius, and diameter for cactus graphs

abstract: We study the Randic index for cactus graphs. It is conjectured to be bounded below by radius (for other than an even path), and it is known to obey several bounds based on diameter. We study radius and diameter for cacti then verify the radius bound and strengthen two diameter bounds for cacti. Along the way, we produce several other bounds for the Randic index in terms of graph size, order, and valency for several special classes of graphs, including chemical nontrivial cacti and cacti with starlike BC-trees.


title: A Simple Linear-Time Algorithm for the Common Refinement of Rooted Phylogenetic Trees on a Common Leaf Set

abstract: Background. The supertree problem, i.e., the task of finding a common refinement of a set of rooted trees is an important topic in mathematical phylogenetics. The special case of a common leaf set $L$ is known to be solvable in linear time. Existing approaches refine one input tree using information of the others and then test whether the results are isomorphic. Results. A linear-time algorithm, LinCR, for constructing the common refinement $T$ of $k$ input trees with a common leaf set is proposed that explicitly computes the parent function of $T$ in a bottom-up approach. Conclusion. LinCR is simpler to implement than other asymptotically optimal algorithms for the problem and outperforms the alternatives in empirical comparisons. Availability. An implementation of LinCR in Python is freely available at https://github.com/david-schaller/tralda.


title: SATDBailiff- Mining and Tracking Self-Admitted Technical Debt

abstract: Self-Admitted Technical Debt (SATD) is a metaphorical concept to describe the self-documented addition of technical debt to a software project in the form of source code comments. SATD can linger in projects and degrade source-code quality, but it can also be more visible than unintentionally added or undocumented technical debt. Understanding the implications of adding SATD to a software project is important because developers can benefit from a better understanding of the quality trade-offs they are making. However, empirical studies, analyzing the survivability and removal of SATD comments, are challenged by potential code changes or SATD comment updates that may interfere with properly tracking their appearance, existence, and removal. In this paper, we propose SATDBailiff, a tool that uses an existing state-of-the-art SATD detection tool, to identify SATD in method comments, then properly track their lifespan. SATDBailiff is given as input links to open source projects, and its output is a list of all identified SATDs, and for each detected SATD, SATDBailiff reports all its associated changes, including any updates to its text, all the way to reporting its removal. The goal of SATDBailiff is to aid researchers and practitioners in better tracking SATDs instances and providing them with a reliable tool that can be easily extended. SATDBailiff was validated using a dataset of previously detected and manually validated SATD instances. SATDBailiff is publicly available as an open-source, along with the manual analysis of SATD instances associated with its validation, on the project website


title: Spatial kriging for replicated temporal point processes

abstract: This paper presents a kriging method for spatial prediction of temporal intensity functions, for situations where a temporal point process is observed at different spatial locations. Assuming that several replications of the processes are available at the spatial sites, this method avoids assumptions like isotropy, which are not valid in many applications. As part of the derivations, new nonparametric estimators for the mean and covariance functions of temporal point processes are introduced, and their properties are studied theoretically and by simulation. The method is applied to the analysis of bike demand patterns in the Divvy bicycle sharing system of the city of Chicago.


title: Parallel Graph Coloring Algorithms for Distributed GPU Environments

abstract: Graph coloring is often used in parallelizing scientific computations that run in distributed and multi-GPU environments; it identifies sets of independent data that can be updated in parallel. Many algorithms exist for graph coloring on a single GPU or in distributed memory, but to the best of our knowledge, hybrid MPI+GPU algorithms have been unexplored until this work. We present several MPI+GPU coloring approaches based on the distributed coloring algorithms of Gebremedhin et al. and the shared-memory algorithms of Deveci et al. . The on-node parallel coloring uses implementations in KokkosKernels, which provide parallelization for both multicore CPUs and GPUs. We further extend our approaches to compute distance-2 and partial distance-2 colorings, giving the first known distributed, multi-GPU algorithm for these problems. In addition, we propose a novel heuristic to reduce communication for recoloring in distributed graph coloring. Our experiments show that our approaches operate efficiently on inputs too large to fit on a single GPU and scale up to graphs with 76.7 billion edges running on 128 GPUs.


title: Strongly regular graphs satisfying the 4-vertex condition

abstract: We survey the area of strongly regular graphs satisfying the 4-vertex condition and find several new families. We describe a switching operation on collinearity graphs of polar spaces that produces cospectral graphs. The obtained graphs satisfy the 4-vertex condition if the original graph belongs to a symplectic polar space.


title: Learning to communicate about shared procedural abstractions

abstract: Many real-world tasks require agents to coordinate their behavior to achieve shared goals. Successful collaboration requires not only adopting the same communicative conventions, but also grounding these conventions in the same task-appropriate conceptual abstractions. We investigate how humans use natural language to collaboratively solve physical assembly problems more effectively over time. Human participants were paired up in an online environment to reconstruct scenes containing two block towers. One participant could see the target towers, and sent assembly instructions for the other participant to reconstruct. Participants provided increasingly concise instructions across repeated attempts on each pair of towers, using higher-level referring expressions that captured each scene's hierarchical structure. To explain these findings, we extend recent probabilistic models of ad-hoc convention formation with an explicit perceptual learning mechanism. These results shed light on the inductive biases that enable intelligent agents to coordinate upon shared procedural abstractions.


title: Optimal condition to probe strong coupling of two-dimensional excitons and zero-dimensional cavity modes

abstract: The light-matter interaction associated with a two-dimensional (2D) excitonic transition coupled to a zero-dimensional (0D) photonic cavity is fundamentally different from coupling localized excitations in quantum dots or color centers, which have negligible spatial extent compared to the cavity-confined mode profile. By calculating the radiation-matter coupling of the exciton transition of a surface deposited 2D material and a 0D photonic crystal nanobeam mode, we found that there is an optimal spatial extent of the monolayer material that maximizes such an interaction strength due to the competition between minimizing the excitonic envelope function area and maximizing the total integrated field. This is counter to the intuition from the Dicke model, where the oscillator strength is expected to monotonically grow with the number of oscillators, which correlates to the monolayer area assuming the excitonic wavefunction is delocalized over the entire quantum well. We also found that at near zero exciton-cavity detuning, the direct transmission efficiency of a waveguide-integrated cavity can be severely suppressed, which suggests performing experiments by using a side-coupled cavity to get better performances.


title: Using AntiPatterns to avoid MLOps Mistakes

abstract: We describe lessons learned from developing and deploying machine learning models at scale across the enterprise in a range of financial analytics applications. These lessons are presented in the form of antipatterns. Just as design patterns codify best software engineering practices, antipatterns provide a vocabulary to describe defective practices and methodologies. Here we catalog and document numerous antipatterns in financial ML operations (MLOps). Some antipatterns are due to technical errors, while others are due to not having sufficient knowledge of the surrounding context in which ML results are used. By providing a common vocabulary to discuss these situations, our intent is that antipatterns will support better documentation of issues, rapid communication between stakeholders, and faster resolution of problems. In addition to cataloging antipatterns, we describe solutions, best practices, and future directions toward MLOps maturity.


title: Regressing Location on Text for Probabilistic Geocoding

abstract: Text data are an important source of detailed information about social and political events. Automated systems parse large volumes of text data to infer or extract structured information that describes actors, actions, dates, times, and locations. One of these sub-tasks is geocoding: predicting the geographic coordinates associated with events or locations described by a given text. We present an end-to-end probabilistic model for geocoding text data. Additionally, we collect a novel data set for evaluating the performance of geocoding systems. We compare the model-based solution, called ELECTRo-map, to the current state-of-the-art open source system for geocoding texts for event data. Finally, we discuss the benefits of end-to-end model-based geocoding, including principled uncertainty estimation and the ability of these models to leverage contextual information.


title: A property of Absolute Minimizers in $L^\infty$ Calculus of Variations and of solutions of the Aronsson-Euler equation

abstract: We discover a new minimality property of the absolute minimisers of supremal functionals (also known as $L^\infty$ Calculus of Variations problems).


title: A Search Engine for Scientific Publications: a Cybersecurity Case Study

abstract: Cybersecurity is a very challenging topic of research nowadays, as digitalization increases the interaction of people, software and services on the Internet by means of technology devices and networks connected to it. The field is broad and has a lot of unexplored ground under numerous disciplines such as management, psychology, and data science. Its large disciplinary spectrum and many significant research topics generate a considerable amount of information, making it hard for us to find what we are looking for when researching a particular subject. This work proposes a new search engine for scientific publications which combines both information retrieval and reading comprehension algorithms to extract answers from a collection of domain-specific documents. The proposed solution although being applied to the context of cybersecurity exhibited great generalization capabilities and can be easily adapted to perform under other distinct knowledge domains.


title: Project MOMO: Multiwavelength Observations and Modelling of OJ 287

abstract: Our project MOMO (Multiwavelength observations and modelling of OJ 287) consists of dedicated, dense, long-term flux and spectroscopic monitoring and deep follow-up observations of the blazar OJ 287 at >13 frequencies from the radio to the X-ray band since late 2015. In particular, we are using Swift to obtain optical-UV-X-ray spectral energy distributions (SEDs) and the Effelsberg telescope to obtain radio measurements between 2 and 40 GHz. MOMO is the densest long-term monitoring of OJ 287 involving X-rays and broad-band SEDs. The theoretical part of the project aims at understanding jet and accretion physics of the blazar central engine in general and the supermassive binary black hole scenario in particular. Results are presented in a sequence of publications and so far included: detection and detailed analysis of the bright 2016/17 and 2020 outbursts and the long-term light curve; Swift, XMM and NuSTAR spectroscopy of the 2020 outburst around maximum; and interpretation of selected events in the context of the binary black hole scenario of OJ 287 (papers I-IV). Here, we provide a description of the project MOMO, a summary of previous results, the latest results, and we discuss future prospects.


title: An extension of a theorem and errata for "A Class of Representations of Hecke Algebras"

abstract: By Theorem~1.12 of the paper "A Class of Representations of Hecke Algebras", if $W$ is a Coxeter group whose proper parabolic subgroups are finite, and if the module of a finite $W$-digraph $\Gamma$ is isomorphic to the module of a $W$-graph, then $\Gamma$ must be acyclic. Here we extend this result to Coxeter groups with finite dihedral parabolic subgroups and $W$-graphs with arbitrary scalar edge labels. Also, errata for the paper are listed in the last section.


title: CLDA: Contrastive Learning for Semi-Supervised Domain Adaptation

abstract: Unsupervised Domain Adaptation (UDA) aims to align the labeled source distribution with the unlabeled target distribution to obtain domain invariant predictive models. However, the application of well-known UDA approaches does not generalize well in Semi-Supervised Domain Adaptation (SSDA) scenarios where few labeled samples from the target domain are available. In this paper, we propose a simple Contrastive Learning framework for semi-supervised Domain Adaptation (CLDA) that attempts to bridge the intra-domain gap between the labeled and unlabeled target distributions and inter-domain gap between source and unlabeled target distribution in SSDA. We suggest employing class-wise contrastive learning to reduce the inter-domain gap and instance-level contrastive alignment between the original (input image) and strongly augmented unlabeled target images to minimize the intra-domain discrepancy. We have shown empirically that both of these modules complement each other to achieve superior performance. Experiments on three well-known domain adaptation benchmark datasets namely DomainNet, Office-Home, and Office31 demonstrate the effectiveness of our approach. CLDA achieves state-of-the-art results on all the above datasets.


title: An extended and more practical mwp flow analysis

abstract: We improve and refine a method for certifying that the values' sizes computed by an imperative program will be bounded by polynomials in the program's inputs' sizes. Our work ''tames'' the non-determinism of the original analysis, and offers an innovative way of completing the analysis when a non-polynomial growth is found. We furthermore enrich the analyzed language by adding function definitions and calls, allowing to compose the analysis of different libraries and offering generally more modularity. The implementation of our improved method, discussed in a tool paper (https://hal.archives-ouvertes.fr/hal-03269121), also required to reason about the efficiency of some of the needed operations on the matrices produced by the analysis. It is our hope that this work will enable and facilitate static analysis of source code to guarantee its correctness with respect to resource usages.


title: The Swampland Conjectures: A bridge from Quantum Gravity to Particle Physics

abstract: The swampland is the set of seemingly consistent low-energy effective field theories that cannot be consistently coupled to quantum gravity. In this review we cover some of the conjectural properties that effective theories should possess in order not to fall in the swampland, and we give an overview of their main applications to particle physics. The latter include predictions on neutrino masses, bounds on the cosmological constant, the electroweak and QCD scales, the photon mass, the Higgs potential and some insights about supersymmetry.


title: Inverse Design of Grating Couplers Using the Policy Gradient Method from Reinforcement Learning

abstract: We present a proof-of-concept technique for the inverse design of electromagnetic devices motivated by the policy gradient method in reinforcement learning, named PHORCED (PHotonic Optimization using REINFORCE Criteria for Enhanced Design). This technique uses a probabilistic generative neural network interfaced with an electromagnetic solver to assist in the design of photonic devices, such as grating couplers. We show that PHORCED obtains better performing grating coupler designs than local gradient-based inverse design via the adjoint method, while potentially providing faster convergence over competing state-of-the-art generative methods. As a further example of the benefits of this method, we implement transfer learning with PHORCED, demonstrating that a neural network trained to optimize 8$^\circ$ grating couplers can then be re-trained on grating couplers with alternate scattering angles while requiring >10$\times$ fewer simulations than control cases.


title: Homogenization estimates for high order elliptic operators

abstract: In the whole space $R^d$, $d\ge 2$, we study homogenization of a divergence form elliptic operator $A_\varepsilon$ of order $2m\ge 4$ with measurable $\varepsilon$-periodic coefficients, where $\varepsilon$ is a small parameter. For the resolvent $(A_\varepsilon+1)^{-1}$, we construct an approximation with the remainder term of order $\varepsilon^2$ in the operator $(L^2{\to}H^m)$-norm, using the resolvent of the homogenized operator, solutions of several auxiliary periodic problems on the unit cube, and smoothing operators. The homogenized operator here differs from the one commonly employed in homogenization.


title: Mesh-based graph convolutional neural networks for modeling materials with microstructure

abstract: Predicting the evolution of a representative sample of a material with microstructure is a fundamental problem in homogenization. In this work we propose a graph convolutional neural network that utilizes the discretized representation of the initial microstructure directly, without segmentation or clustering. Compared to feature-based and pixel-based convolutional neural network models, the proposed method has a number of advantages: (a) it is deep in that it does not require featurization but can benefit from it, (b) it has a simple implementation with standard convolutional filters and layers, (c) it works natively on unstructured and structured grid data without interpolation (unlike pixel-based convolutional neural networks), and (d) it preserves rotational invariance like other graph-based convolutional neural networks. We demonstrate the performance of the proposed network and compare it to traditional pixel-based convolution neural network models and feature-based graph convolutional neural networks on multiple large datasets.


title: Exceptional algebroids and type IIB superstrings

abstract: In this note we study exceptional algebroids, focusing on their relation to type IIB superstring theory. We show that a IIB-exact exceptional algebroid (corresponding to the group $E_{n(n)}\times \mathbb{R}^+$, for $n\le 6$) locally has a standard form given by the exceptional tangent bundle. We derive possible twists, given by a flat $\mathfrak{gl}(2,\mathbb{R})$-connection, a covariantly closed pair of 3-forms, and a 5-form, and comment on their physical interpretation. Using this analysis we reduce the search for Leibniz parallelisable spaces, and hence maximally supersymmetric consistent truncations, to a simple algebraic problem. We show that the exceptional algebroid perspective also gives a simple description of Poisson-Lie U-duality without spectators and hence of generalised Yang-Baxter deformations.


title: From DNNs to GANs: Review of efficient hardware architectures for deep learning

abstract: In recent times, the trend in very large scale integration (VLSI) industry is multi-dimensional, for example, reduction of energy consumption, occupancy of less space, precise result, less power dissipation, faster response. To meet these needs, the hardware architecture should be reliable and robust to these problems. Recently, neural network and deep learning has been started to impact the present research paradigm significantly which consists of parameters in the order of millions, nonlinear function for activation, convolutional operation for feature extraction, regression for classification, generative adversarial networks. These operations involve huge calculation and memory overhead. Presently available DSP processors are incapable of performing these operations and they mostly face the problems, for example, memory overhead, performance drop and compromised accuracy. Moreover, if a huge silicon area is powered to accelerate the operation using parallel computation, the ICs will be having significant chance of burning out due to the considerable generation of heat. Hence, novel dark silicon constraint is developed to reduce the heat dissipation without sacrificing the accuracy. Similarly, different algorithms have been adapted to design a DSP processor compatible for fast performance in neural network, activation function, convolutional neural network and generative adversarial network. In this review, we illustrate the recent developments in hardware for accelerating the efficient implementation of deep learning networks with enhanced performance. The techniques investigated in this review are expected to direct future research challenges of hardware optimization for high-performance computations.


title: Automatic Synthesis of Experiment Designs from Probabilistic Environment Specifications

abstract: This paper presents an extension to the probabilistic programming language ProbRobScene, allowing users to automatically synthesize uniform experiment designs directly from environment specifications. We demonstrate its effectiveness on a number of environment specification snippets from tabletop manipulation, and show that our method generates reliably low-discrepancy designs.


title: Super Twisting based Lyapunov Redesign for Uncertain Linear Delay Systems

abstract: We present a new continuous Lyapunov Redesign (LR) methodology for the robust stabilization of a class of uncertain time-delay systems that is based on the so-called Super Twisting Algorithm. The main feature of the proposed approach is that allows one to simultaneously adjust the chattering effect and achieve asymptotic stabilization of the uncertain system, which is lost when continuous approximation of the unit control is considered. At the basis of the Super Twisting based LR methodology is a class of Lyapunov-Krasovskii functionals, whose particular form of its time derivative allows one to define a delay-free sliding manifold on which some class of smooth uncertainties are compensated.


title: A universal bound in the dimensional Brunn-Minkowski inequality for log-concave measures

abstract: We show that for any log-concave measure $\mu$ on $\mathbb{R}^n$, any pair of symmetric convex sets $K$ and $L$, and any $\lambda\in [0,1],$ $$\mu((1-\lambda) K+\lambda L)^{c_n}\geq (1-\lambda) \mu(K)^{c_n}+\lambda\mu(L)^{c_n},$$ where $c_n\geq n^{-4-o(1)}.$ This constitutes progress towards the dimensional Brunn-Minkowski conjecture (see Gardner, Zvavitch \cite{GZ}, Colesanti, L, Marsiglietti \cite{CLM}). Moreover, our bound improves for various special classes of log-concave measures.


title: Improving black-box optimization in VAE latent space using decoder uncertainty

abstract: Optimization in the latent space of variational autoencoders is a promising approach to generate high-dimensional discrete objects that maximize an expensive black-box property (e.g., drug-likeness in molecular generation, function approximation with arithmetic expressions). However, existing methods lack robustness as they may decide to explore areas of the latent space for which no data was available during training and where the decoder can be unreliable, leading to the generation of unrealistic or invalid objects. We propose to leverage the epistemic uncertainty of the decoder to guide the optimization process. This is not trivial though, as a naive estimation of uncertainty in the high-dimensional and structured settings we consider would result in high estimator variance. To solve this problem, we introduce an importance sampling-based estimator that provides more robust estimates of epistemic uncertainty. Our uncertainty-guided optimization approach does not require modifications of the model architecture nor the training process. It produces samples with a better trade-off between black-box objective and validity of the generated samples, sometimes improving both simultaneously. We illustrate these advantages across several experimental settings in digit generation, arithmetic expression approximation and molecule generation for drug design.


title: pymwp: A Tool for Guaranteeing Complexity Bounds for C Programs

abstract: Complexity analysis offers assurance of program's runtime behavior, but large classes of programs remain unanalyzable by existing automated techniques.The mwp-flow analysis sidesteps many difficulties shared by existing approaches, and offers interesting features, such as compositionality, multivariate bounds, and applicability to non-terminating programs.It analyzes resource usage and determines if a program's variables growth rates are no more than polynomially related to their inputs sizes.This sound calculus, however, is computationally expensive to manipulate, and provides no feedback if the program does not have polynomial bounds.Those two defaults were addressed in a previous work, and prepared for the tool we present here: pymwp, a static complexity analyzer for C programs based on our improved mwp-flow analysis.


title: Metallic Hydrogen: A Liquid Superconductor?

abstract: Metallic hydrogen is expected to exhibit remarkable physics. Of particular interest in this work is the possibility of high-temperature superconductivity. Comparing calculations of the superconducting critical temperatures of the solid phase to melting temperatures over a range of pressures leads to an interesting question: Will the solid, in a superconducting state, melt to a liquid that remains a superconductor? In this work, the possibility of liquid superconductivity in metallic hydrogen is investigated. This is done by first-principles simulations, and using the results of these to solve the Eliashberg equations. These are carried out over the pressure (and temperature) conditions where molecular dissociation is expected to first occur in the solid phase. Over the pressure range $386.8(4)$--$783.7(4)$ GPa, $T_c$ increases from $308(6)$ to $372(2)$ K with a maximum uncertainty of $10$ K; it then decreases to $356(2)$ K at $883.7(3)$ GPa. Comparisons to the solid phase show that the critical temperature is not significantly changed between the two phases, though the physics behind their superconductivity is different. Careful comparisons of these values to recent results in the context of the hydrogen phase diagram show that they are higher than the melting temperatures and that the solid will melt to liquid atomic hydrogen. The results of this work (in this context) therefore suggest that liquid atomic hydrogen will indeed exist in a superconducting state. They also provide the pressure and temperature conditions over which to look for it.


title: Sequence-level Confidence Classifier for ASR Utterance Accuracy and Application to Acoustic Models

abstract: Scores from traditional confidence classifiers (CCs) in automatic speech recognition (ASR) systems lack universal interpretation and vary with updates to the underlying confidence or acoustic models (AMs). In this work, we build interpretable confidence scores with an objective to closely align with ASR accuracy. We propose a new sequence-level CC with a richer context providing CC scores highly correlated with ASR accuracy and scores stable across CC updates. Hence, expanding CC applications. Recently, AM customization has gained traction with the widespread use of unified models. Conventional adaptation strategies that customize AM expect well-matched data for the target domain with gold-standard transcriptions. We propose a cost-effective method of using CC scores to select an optimal adaptation data set, where we maximize ASR gains from minimal data. We study data in various confidence ranges and optimally choose data for AM adaptation with KL-Divergence regularization. On the Microsoft voice search task, data selection for supervised adaptation using the sequence-level confidence scores achieves word error rate reduction (WERR) of 8.5% for row-convolution LSTM (RC-LSTM) and 5.2% for latency-controlled bidirectional LSTM (LC-BLSTM). In the semi-supervised case, with ASR hypotheses as labels, our method provides WERR of 5.9% and 2.8% for RC-LSTM and LC-BLSTM, respectively.


title: FCMI: Feature Correlation based Missing Data Imputation

abstract: Processed data are insightful, and crude data are obtuse. A serious threat to data reliability is missing values. Such data leads to inaccurate analysis and wrong predictions. We propose an efficient technique to impute the missing value in the dataset based on correlation called FCMI (Feature Correlation based Missing Data Imputation). We have considered the correlation of the attributes of the dataset, and that is our central idea. Our proposed algorithm picks the highly correlated attributes of the dataset and uses these attributes to build a regression model whose parameters are optimized such that the correlation of the dataset is maintained. Experiments conducted on both classification and regression datasets show that the proposed imputation technique outperforms existing imputation algorithms.


title: Latent Execution for Neural Program Synthesis

abstract: Program synthesis from input-output (IO) examples has been a long-standing challenge. While recent works demonstrated limited success on domain-specific languages (DSL), it remains highly challenging to apply them to real-world programming languages, such as C. Due to complicated syntax and token variation, there are three major challenges: (1) unlike many DSLs, programs in languages like C need to compile first and are not executed via interpreters; (2) the program search space grows exponentially when the syntax and semantics of the programming language become more complex; and (3) collecting a large-scale dataset of real-world programs is non-trivial. As a first step to address these challenges, we propose LaSynth and show its efficacy in a restricted-C domain. More specifically, LaSynth learns the latent representation to approximate the execution of partially generated programs, even if they are incomplete in syntax (addressing (1)). The learned execution significantly improves the performance of next token prediction over existing approaches, facilitating search (addressing (2)). Finally, once trained with randomly generated ground-truth programs and their IO pairs, LaSynth can synthesize more concise programs that resemble human-written code. Furthermore, retraining our model with these synthesized programs yields better performance with fewer samples for both Karel and C program synthesis, indicating the promise of leveraging the learned program synthesizer to improve the dataset quality for input-output program synthesis (addressing (3)). When evaluating on whether the program execution outputs match the IO pairs, LaSynth achieves 55.2% accuracy on generating simple C code with tens of tokens including loops and branches, outperforming existing approaches without executors by around 20%.


title: Zitterbewegung of moir\'e excitons in twisted MoS$_2$/WSe$_2$ hetero-bilayers

abstract: The moir\'e pattern observed in stacked non-commensurate crystal lattices, such as hetero-bilayers of transition metal dichalcogenides, produces a periodic modulation of their bandgap. Excitons subjected to this potential landscape exhibit a band structure that gives rise to a quasi-particle dubbed moir\'e exciton. In the case of MoS$_2$/WSe$_2$ hetero-bilayers, the moir\'e trapping potential has honeycomb symmetry and, consequently, the moir\'e exciton band structure is the same as that of a Dirac-Weyl fermion, whose mass can be further tuned down to zero with a perpendicularly applied field. Here we show that, analogously to other Dirac-like particles, moir\'e exciton exhibits a trembling motion, also known as zitterbewegung, whose long timescales are compatible with current experimental techniques for exciton dynamics. This promotes the study of the dynamics of moir\'e excitons in van der Waals heterostructures as an advantageous solid-state platform to probe zitterbewegung, broadly tunable by gating and inter-layer twist angle.


title: Limitations of coupled cluster approximations for highlyaccurate investigations of Rb$_2^+$

abstract: We reveal limitations of several standard coupled-cluster (CC) methods with perturbation-theorybased noniterative or approximate iterative treatments of triple excitations when applied to thedetermination of highly accurate potential energy curves (PECs) of ionic dimers, such as the X $^2\Sigma^+_g$ electronic ground state of Rb$_2^+$. Such computations are of current interest for the understanding ofion-atom interactions in the ultracold regime. We demonstrate that these coupled-cluster methodslead to an unphysical long-range barrier for the Rb$_2^+$ system. The barrier is small but clearly spoilsthe entire long-range behavior of the PEC. The effect is also found for other X$_2^+$ systems, like X = Li, Na, and K. Calculations using a new flexible framework for obtaining leading perturbativetriples corrections derived using an analytic CC singles and doubles (CCSD) energy derivativeformulation demonstrate that the origin of this problem lies in the use of $T_3$ amplitudes obtained from approximate CC singles, doubles and triples (CCSDT) amplitude equations. It is shown thatthe unphysical barrier is related to a symmetry instability of the underlying Hartree-Fock mean-fieldsolution. Physically meaningful perturbative corrections in the long-range tail of the PEC mayinstead be obtained using symmetry-broken reference determinants.


title: Demonstration of the DC-Kerr Effect in Silicon-Rich Nitride

abstract: We demonstrate the DC-Kerr effect in PECVD Silicon-rich Nitride (SRN) and use it to demonstrate a third order nonlinear susceptibility, \c{hi}^((3)), as high as (6 +/- 0.58)x10-19 m2/v2. We employ spectral shift versus applied voltage measurements in a racetrack ring resonator as a tool by which to characterize the nonlinear susceptibilities of these films. In doing so we demonstrate a \c{hi}^((3)) larger than that of silicon and argue that PECVD SRN can provide a versatile platform for employing optical phase-shifters while maintain a low thermal budget using a deposition technique readily available in CMOS process flows.


title: Transit-Gym: A Simulation and Evaluation Engine for Analysis of Bus Transit Systems

abstract: Public-transit systems face a number of operational challenges: (a) changing ridership patterns requiring optimization of fixed line services, (b) optimizing vehicle-to-trip assignments to reduce maintenance and operation codes, and (c) ensuring equitable and fair coverage to areas with low ridership. Optimizing these objectives presents a hard computational problem due to the size and complexity of the decision space. State-of-the-art methods formulate these problems as variants of the vehicle routing problem and use data-driven heuristics for optimizing the procedures. However, the evaluation and training of these algorithms require large datasets that provide realistic coverage of various operational uncertainties. This paper presents a dynamic simulation platform, called Transit-Gym, that can bridge this gap by providing the ability to simulate scenarios, focusing on variation of demand models, variations of route networks, and variations of vehicle-to-trip assignments. The central contribution of this work is a domain-specific language and associated experimentation tool-chain and infrastructure to enable subject-matter experts to intuitively specify, simulate, and analyze large-scale transit scenarios and their parametric variations. Of particular significance is an integrated microscopic energy consumption model that also helps to analyze the energy cost of various transit decisions made by the transportation agency of a city.


title: Choice of a Mentor: A Subjective Evaluation of Expectations, Experiences and Feedbacks

abstract: Recent trends in academics show an increase in enrollment levels in higher education Predominantly in Doctoral programmes where individual scholars institutes and supervisors play the key roles The human factor at receiving end of academic excellence is the scholar having a supervisor at the facilitating end In this paper I try to establish the role of different factors and availability of information about them in forming the basic choice set in a scholars mind After studying three different groups of individuals who were subjected to substitutive choices we found that scholars prefer an approachable, moderately intervening and frequently interacting professor as their guide


title: Ab-initio Symmetric Quasi-Classical Approach to Investigate Molecular Tully Models

abstract: We perform on-the-fly non-adiabatic molecular dynamics simulations using the symmetrical quasi-classical (SQC) approach with the recently suggested molecular Tully models: ethylene and fulvene. We attempt to provide benchmarks of the SQC methods using both the square and the triangle windowing schemes as well as the recently proposed electronic zero-point-energy correction scheme (so-called the gamma correction). We use the quasi-diabatic propagation scheme to directly interface the diabatic SQC methods with adiabatic electronic structure calculations. Our results showcase the drastic improvement of the accuracy by using the trajectory-adjusted gamma-corrections, which outperform the widely used trajectory surface hopping method with decoherence corrections. These calculations provide useful and non-trivial tests to systematically investigate the numerical performance of various diabatic quantum dynamics approaches, going beyond simple diabatic model systems that have been used as the major workhorse in the quantum dynamics field. At the same time, these available benchmark studies will also likely foster the development of new quantum dynamics approaches based on these techniques.


title: Convex Optimization for Parameter Synthesis in MDPs

abstract: Probabilistic model checking aims to prove whether a Markov decision process (MDP) satisfies a temporal logic specification. The underlying methods rely on an often unrealistic assumption that the MDP is precisely known. Consequently, parametric MDPs (pMDPs) extend MDPs with transition probabilities that are functions over unspecified parameters. The parameter synthesis problem is to compute an instantiation of these unspecified parameters such that the resulting MDP satisfies the temporal logic specification. We formulate the parameter synthesis problem as a quadratically constrained quadratic program (QCQP), which is nonconvex and is NP-hard to solve in general. We develop two approaches that iteratively obtain locally optimal solutions. The first approach exploits the so-called convex-concave procedure (CCP), and the second approach utilizes a sequential convex programming (SCP) method. The techniques improve the runtime and scalability by multiple orders of magnitude compared to black-box CCP and SCP by merging ideas from convex optimization and probabilistic model checking. We demonstrate the approaches on a satellite collision avoidance problem with hundreds of thousands of states and tens of thousands of parameters and their scalability on a wide range of commonly used benchmarks.


title: Adaptive Capped Least Squares

abstract: This paper proposes the capped least squares regression with an adaptive resistance parameter, hence the name, adaptive capped least squares regression. The key observation is, by taking the resistant parameter to be data dependent, the proposed estimator achieves full asymptotic efficiency without losing the resistance property: it achieves the maximum breakdown point asymptotically. Computationally, we formulate the proposed regression problem as a quadratic mixed integer programming problem, which becomes computationally expensive when the sample size gets large. The data-dependent resistant parameter, however, makes the loss function more convex-like for larger-scale problems. This makes a fast randomly initialized gradient descent algorithm possible for global optimization. Numerical examples indicate the superiority of the proposed estimator compared with classical methods. Three data applications to cancer cell lines, stationary background recovery in video surveillance, and blind image inpainting showcase its broad applicability.


title: Classical Planning in Deep Latent Space

abstract: Current domain-independent, classical planners require symbolic models of the problem domain and instance as input, resulting in a knowledge acquisition bottleneck. Meanwhile, although deep learning has achieved significant success in many fields, the knowledge is encoded in a subsymbolic representation which is incompatible with symbolic systems such as planners. We propose Latplan, an unsupervised architecture combining deep learning and classical planning. Given only an unlabeled set of image pairs showing a subset of transitions allowed in the environment (training inputs), Latplan learns a complete propositional PDDL action model of the environment. Later, when a pair of images representing the initial and the goal states (planning inputs) is given, Latplan finds a plan to the goal state in a symbolic latent space and returns a visualized plan execution. We evaluate Latplan using image-based versions of 6 planning domains: 8-puzzle, 15-Puzzle, Blocksworld, Sokoban and Two variations of LightsOut.


title: A Logic for Reasoning About LF Specifications

abstract: We present a logic named L_{LF} whose intended use is to formalize properties of specifications developed in the dependently typed lambda calculus LF. The logic is parameterized by the LF signature that constitutes the specification. Atomic formulas correspond to typing derivations relative to this signature. The logic includes a collection of propositional connectives and quantifiers. Quantification ranges over expressions that denote LF terms and LF contexts. Quantifiers of the first variety are qualified by simple types that describe the functional structure associated with the variables they bind; deeper, dependency related properties are expressed by the body of the formula. Context-level quantifiers are qualified by context schemas that identify patterns of declarations out of which actual contexts may be constructed. The semantics of variable-free atomic formulas is articulated via the derivability in LF of the judgements they encode. Propositional constants and connectives are understood in the usual manner and the meaning of quantifiers is explicated through substitutions of expressions that adhere to the type qualifications. The logic is complemented by a proof system that enables reasoning that is sound with respect to the described semantics. The main novelties of the proof system are the provision for case-analysis style reasoning about LF judgements, support for inductive reasoning over the heights of LF derivations and the encoding of LF meta-theorems. The logic is motivated by the paradigmatic example of type assignment in the simply-typed lambda calculus and the proof system is illustrated through the formalization of a proof of type uniqueness for this calculus.


title: Using Self-Supervised Feature Extractors with Attention for Automatic COVID-19 Detection from Speech

abstract: The ComParE 2021 COVID-19 Speech Sub-challenge provides a test-bed for the evaluation of automatic detectors of COVID-19 from speech. Such models can be of value by providing test triaging capabilities to health authorities, working alongside traditional testing methods. Herein, we leverage the usage of pre-trained, problem agnostic, speech representations and evaluate their use for this task. We compare the obtained results against a CNN architecture trained from scratch and traditional frequency-domain representations. We also evaluate the usage of Self-Attention Pooling as an utterance-level information aggregation method. Experimental results demonstrate that models trained on features extracted from self-supervised models perform similarly or outperform fully-supervised models and models based on handcrafted features. Our best model improves the Unweighted Average Recall (UAR) from 69.0\% to 72.3\% on a development set comprised of only full-band examples and achieves 64.4\% on the test set. Furthermore, we study where the network is attending, attempting to draw some conclusions regarding its explainability. In this relatively small dataset, we find the network attends especially to vowels and aspirates.


title: Computable criteria for ballisticity of random walks in elliptic random environment

abstract: We consider random walks in i.i.d. elliptic random environments which are not uniformly elliptic. We introduce a computable condition in dimension $d=2$ and a general condition valid for dimensions $d\ge 2$ expressed in terms of the exit time from a box, which ensure that local trapping would not inhibit a ballistic behavior of the random walk. An important technical innovation related to our computable condition, is the introduction of a geometrical point of view to classify the way in which the random walk can become trapped, either in an edge, a wedge or a square. Furthermore, we prove that the general condition we introduce is sharp.


title: QuickFlex: a Fast Algorithm for Flexible Region Construction for the TSO-DSO Coordination

abstract: Most of the new technological changes in power systems are expected to take place in distribution grids. The enormous potential for distribution flexibility could meet the transmission system's needs, changing the paradigm of generator-centric energy and ancillary services provided to a demand-centric one, by placing more importance on smaller resources, such as flexible demands and electric vehicles. For unlocking such capabilities, it is essential to understand the aggregated flexibility that can be harvested from the large population of new technologies located in distribution grids. Distribution grids, therefore, could provide aggregated flexibility at the transmission level. To date, most computational methods for estimating the aggregated flexibility at the interface between distribution grids and transmission grids have the drawback of requiring significant computational time, which hinders their applicability. This paper presents a new algorithm, coined as QuickFlex} for constructing the flexibility domain of distribution grids. Contrary to previous methods, a priory flexibility domain accuracy can be selected. Our method requires few iterations for constructing the flexibility region. The number of iterations needed is mainly independent of the distribution grid's input size and flexible elements. Numerical experiments are performed in four grids ranging from 5 nodes to 123 nodes. It is shown that QuickFlex outperforms existing proposals in the literature in both speed and accuracy.


title: Automated Detection and Diagnosis of Diabetic Retinopathy: A Comprehensive Survey

abstract: Diabetic Retinopathy (DR) is a leading cause of vision loss in the world,. In the past few Diabetic Retinopathy (DR) is a leading cause of vision loss in the world. In the past few years, Artificial Intelligence (AI) based approaches have been used to detect and grade DR. Early detection enables appropriate treatment and thus prevents vision loss, Both fundus and optical coherence tomography (OCT) images are used to image the retina. With deep learning/machine learning apprroaches it is possible to extract features from the images and detect the presence of DR. Multiple strategies are implemented to detect and grade the presence of DR using classification, segmentation, and hybrid techniques. This review covers the literature dealing with AI approaches to DR that have been published in the open literature over a five year span (2016-2021). In addition a comprehensive list of available DR datasets is reported. Both the PICO (P-patient, I-intervention, C-control O-outcome) and Preferred Reporting Items for Systematic Review and Meta-Analysis (PRISMA)2009 search strategies were employed. We summarize a total of 114 published articles which conformed to the scope of the review. In addition a list of 43 major datasets is presented.


title: On the Benefits of Inducing Local Lipschitzness for Robust Generative Adversarial Imitation Learning

abstract: We explore methodologies to improve the robustness of generative adversarial imitation learning (GAIL) algorithms to observation noise. Towards this objective, we study the effect of local Lipschitzness of the discriminator and the generator on the robustness of policies learned by GAIL. In many robotics applications, the learned policies by GAIL typically suffer from a degraded performance at test time since the observations from the environment might be corrupted by noise. Hence, robustifying the learned policies against the observation noise is of critical importance. To this end, we propose a regularization method to induce local Lipschitzness in the generator and the discriminator of adversarial imitation learning methods. We show that the modified objective leads to learning significantly more robust policies. Moreover, we demonstrate -- both theoretically and experimentally -- that training a locally Lipschitz discriminator leads to a locally Lipschitz generator, thereby improving the robustness of the resultant policy. We perform extensive experiments on simulated robot locomotion environments from the MuJoCo suite that demonstrate the proposed method learns policies that significantly outperform the state-of-the-art generative adversarial imitation learning algorithm when applied to test scenarios with noise-corrupted observations.


title: A note on the K-epigraph

abstract: We study the question as to when the closed convex hull of a K-convex map equals its K-epigraph. In particular, we shed light onto the smallest cone K such that a given map has convex and closed K-epigraph, respectively. We apply our findings to several examples in matrix space as well as to convex composite functions.


title: Do we need to estimate the variance in robust mean estimation?

abstract: In this paper, we propose self-tuned robust estimators for estimating the mean of heavy-tailed distributions, which refer to distributions with only finite variances. Our approach introduces a new loss function that considers both the mean parameter and a robustification parameter. By jointly optimizing the empirical loss function with respect to both parameters, the robustification parameter estimator can automatically adapt to the unknown data variance, and thus the self-tuned mean estimator can achieve optimal finite-sample performance. Our method outperforms previous approaches in terms of both computational and asymptotic efficiency. Specifically, it does not require cross-validation or Lepski's method to tune the robustification parameter, and the variance of our estimator achieves the Cram\'er-Rao lower bound. Project source code is available at \url{https://github.com/statsle/automean}.


title: Analytical Solution to Electron Beam Envelope Evolution in a Plasma Wakefield

abstract: Beam-induced ionization injection (B-III) is currently being explored as a method for injecting an electron beam with a controlled density profile into a plasma wakefield accelerator (PWFA). This process is initiated by the fields of an unmatched drive beam where the slice envelope reaches its minimum value, the 'pinch'. To control the injected beam's qualities, it is crucial to study the beam-slice envelope oscillations, especially size and the location of the pinch. In this proceeding, an ansatz based on the harmonic motion is proposed to find the analytical solution to beam-slice envelope evolution in the nonlinear regime. The size of the pinch is then found through the application of energy conservation in the transverse direction. The resulting analytical expressions are shown to be in good agreement with numerical solutions.


title: Prototype Superfluid Gravitational Wave Detector

abstract: We study a cross-shaped cavity filled with superfluid $^4$He as a prototype resonant-mass gravitational wave detector. Using a membrane and a re-entrant microwave cavity as a sensitive optomechanical transducer, we were able to observe the thermally excited high-$Q$ acoustic modes of the helium at 20 mK temperature and achieved a strain sensitivity of $8 \times 10^{-19}$ Hz$^{-1/2}$ to gravitational waves. To facilitate the broadband detection of continuous gravitational waves, we tune the kilohertz-scale mechanical resonance frequencies up to 173 Hz/bar by pressurizing the helium. With reasonable improvements, this architecture will enable the search for GWs in the 1-30 kHz range, relevant for a number of astrophysical sources both within and beyond the Standard Model.

categories: gr-qc astro-ph.IM cond-mat.other quant-ph


title: Self-consistent state and measurement tomography with fewer measurements

abstract: We describe a technique for self consistently characterizing both the quantum state of a single qubit system, and the positive-operator-valued measure (POVM) that describes measurements on the system. The method works with only ten measurements. We assume that a series of unitary transformations performed on the quantum state are fully known, while making minimal assumptions about both the density operator of the state and the POVM. The technique returns maximum-likely estimates of both the density operator and the POVM. To experimentally demonstrate the method, we perform reconstructions of over 300 state-measurement pairs and compare them to their expected density operators and POVMs. We find that 95% of the reconstructed POVMs have fidelities of 0.98 or greater, and 92% of the density operators have fidelities that are 0.98 or greater.


title: Assignment-Control Plots: A Visual Companion for Causal Inference Study Design

abstract: An important step for any causal inference study design is understanding the distribution of the treated and control subjects in terms of measured baseline covariates. However, not all baseline variation is equally important. In the observational context, balancing on baseline variation summarized in a propensity score can help reduce bias due to self-selection. In both observational and experimental studies, controlling baseline variation associated with the expected outcomes can help increase the precision of causal effect estimates. We propose a set of visualizations which decompose the space of measured covariates into the different types of baseline variation important to the study design. These ``assignment-control plots'' and variations thereof visually illustrate core concepts of causal inference and suggest new directions for methodological research on study design. As a practical demonstration, we illustrate one application of assignment-control plots to a study of cardiothoracic surgery. While the family of visualization tools for studies of causality is relatively sparse, simple visual tools can be an asset to education, application, and methods development.


title: If you Cheat, I Cheat: Cheating on a Collaborative Task with a Social Robot

abstract: Robots may soon play a role in higher education by augmenting learning environments and managing interactions between instructors and learners. Little, however, is known about how the presence of robots in the learning environment will influence academic integrity. This study therefore investigates if and how college students cheat while engaged in a collaborative sorting task with a robot. We employed a 2x2 factorial design to examine the effects of cheating exposure (exposure to cheating or no exposure) and task clarity (clear or vague rules) on college student cheating behaviors while interacting with a robot. Our study finds that prior exposure to cheating on the task significantly increases the likelihood of cheating. Yet, the tendency to cheat was not impacted by the clarity of the task rules. These results suggest that normative behavior by classmates may strongly influence the decision to cheat while engaged in an instructional experience with a robot.


title: Learning a Reversible Embedding Mapping using Bi-Directional Manifold Alignment

abstract: We propose a Bi-Directional Manifold Alignment (BDMA) that learns a non-linear mapping between two manifolds by explicitly training it to be bijective. We demonstrate BDMA by training a model for a pair of languages rather than individual, directed source and target combinations, reducing the number of models by 50%. We show that models trained with BDMA in the "forward" (source to target) direction can successfully map words in the "reverse" (target to source) direction, yielding equivalent (or better) performance to standard unidirectional translation models where the source and target language is flipped. We also show how BDMA reduces the overall size of the model.


title: Multileaf Collimator for Real-Time Beam Shaping using Emittance Exchange

abstract: Emittance exchange beamlines employ transverse masks to create drive and witness beams of variable longitudinal profile and bunch spacing. Recently, this approach has been used to create advanced driver profiles and demonstrate record-breaking plasma wakefield transformer ratios [Roussel, R., et al., Phys. Rev. Lett. 124, 044802 (2020)], a crucial advancement for efficient witness acceleration. However, since the transverse masks are individually laser cut and installed into the UHV beamline, refinement of the beam profiles is not possible without replacing masks. Instead, this work proposes the use of a UHV compatible multileaf collimator as a beam mask. Such a device permits real-time adjustment of the electron distribution, permitting greater refinement in a manner highly synergistic with machine learning. Beam dynamics simulations have shown that a practically realizable multileaf collimator can offer resolution that is functionally equivalent to that offered by laser cut masks.


title: Global Systems Performance Analysis For Mobile Communications (GSM) using Cellular Network CODECS

abstract: Global System for Mobile Communications (GSM) is a cellular network that is popular and has been growing in recent years. It was developed to solve fragmentation issues of the first cellular system, and it addresses digital modulation methods, level of the network structure, and services. It is fundamental for organizations to become learning organizations to keep up with the technology changes for network services to be at a competitive level. A simulation analysis using the NetSim tool in this paper is presented for comparing different cellular network codecs for GSM network performance. These parameters such as throughput, delay, and jitter are analyzed for the quality of service provided by each network codec. Unicast application for the cellular network is modeled for different network scenarios. Depending on the evaluation and simulation, it was discovered that G.711, GSM_FR, and GSM-EFR performed better than the other codecs, and they are considered to be the best codecs for cellular networks. These codecs will be of best use to better the performance of the network in the near future.


title: SQRP: Sensing Quality-aware Robot Programming System for Non-expert Programmers

abstract: Robot programming typically makes use of a set of mechanical skills that is acquired by machine learning. Because there is in general no guarantee that machine learning produces robot programs that are free of surprising behavior, the safe execution of a robot program must utilize monitoring modules that take sensor data as inputs in real time to ensure the correctness of the skill execution. Owing to the fact that sensors and monitoring algorithms are usually subject to physical restrictions and that effective robot programming is sensitive to the selection of skill parameters, these considerations may lead to different sensor input qualities such as the view coverage of a vision system that determines whether a skill can be successfully deployed in performing a task. Choosing improper skill parameters may cause the monitoring modules to delay or miss the detection of important events such as a mechanical failure. These failures may reduce the throughput in robotic manufacturing and could even cause a destructive system crash. To address above issues, we propose a sensing quality-aware robot programming system that automatically computes the sensing qualities as a function of the robot's environment and uses the information to guide non-expert users to select proper skill parameters in the programming phase. We demonstrate our system framework on a 6DOF robot arm for an object pick-up task.


title: Strong-Field Photoemission Experiment using Diamond Field Emitter Arrays

abstract: In this paper, we present the results of experimental observation of strong-field photoemission from a diamond field-emitter array (DFEA) illuminated by a focused laser beam with 1035 nm wavelength. Having the advantage of high emission current and low beam emittance, DFEAs can emit ultra-short high charge electron bunches required for multiple accelerator applications. We have performed strong-field photoemission experiment at a newly commissioned test stand at Los Alamos National Laboratory (LANL). We triggered a diamond tip with a typical apex of 10-20 nm with 300 femtosecond (fs) laser pulses to produce electron beam emission. The profile of the emitted beam was determined by the analysis of an image formed on the fluorescent screen after a microchannel plate (MCP) intensifier; beamlets corresponding to emission from the pyramid sides and nano-tip were identified. Image analysis of the beamlet associated with emission from the nano-tip was conducted to understand dependencies of intensities of the emission on polarization of the laser's light and its peak intensity.


title: Characterization of systematic error in Advanced LIGO calibration in the second half of O3

abstract: We present the probability distribution of the systematic errors in the most accurate, high-latency version of the reconstructed dimensionless strain $h$, at the Hanford and Livingston LIGO detectors, used for gravitational-wave astrophysical analysis, including parameter estimation, in the last five months of the third observing run (O3B). This work extends the results presented in Sun et. al (2020) [1] for the first six months of the third observing run (O3A). The complex-valued, frequency-dependent, and slowly time-varying systematic error (excursion from unity magnitude and zero phase) in O3B generally remains at a consistent level as in O3A, yet changes of detector configurations in O3B have introduced a non-negligible change in the frequency dependence of the error, leading to larger excursions from unity at some frequencies and/or during some observational periods; in some other periods the excursions are smaller than those in O3A. For O3B, the upper limit on the systematic error and associated uncertainty is 11.29% in magnitude and 9.18 deg in phase (68% confidence interval) in the most sensitive frequency band 20-2000 Hz. The systematic error alone is estimated at levels of < 2% in magnitude and $\lesssim 4$ deg in phase. These errors and uncertainties are dominated by the imperfect modeling of the frequency dependence of the detector response functions rather than the uncertainty in the absolute reference, the photon calibrators.


title: Thermodynamic and transport properties of semiconducting two-dimensional metal-organic kagom\'e lattices with disorder

abstract: The kagom\'e lattice is a fruitful source of novel physical states of matter, including the quantum spin liquid and Dirac fermions. Here we report a structural, thermodynamic, and transport study of the two-dimensional kagom\'e metal-organic frameworks Ni_3(HIB)v2 and Cu_3(HIB)_2 (HIB = hexaiminobenzene). Magnetization measurements yield Curie constants of 1.12 and 0.352 emu K mol f.u.-1 Oe-1 respectively, close to the values expected for ideal S=1 and S=1/2 moments. Weiss temperatures of -20.3 K and -6.52 K, respectively, indicate moderate to weak magnetic interactions. Electrical transport measurements reveal that both materials are semiconducting, with gaps of Eg = 22.2 and 103 meV, respectively. Specific heat measurements reveal a large T-linear contribution of {\gamma} = 148(4) mJ mol-f.u.-1 K-2 in Ni_3(HIB)_2 with only a gradual upturn below T ~ 5 K and no evidence of a phase transition to an ordered state down to T = 0.1 K. Cu_3(HIB)_2 also lacks evidence of a phase transition above T = 0.1 K, with a substantial, field-dependent, magnetic contribution below T ~ 5 K. Despite being superficially in agreement with expectations of magnetic frustration and spin liquid physics, we are able to explain these observations as arising due to known stacking disorder in these materials. Our results further state the art of kagom\'e lattice physics, especially in the rarely explored regime of semiconducting but not metallic behavior.


title: Study of ($^6$Li, $d$) and ($^6$Li, $t$) reactions on $^{22}$Ne and implications for $s$-process nucleosynthesis

abstract: We studied $\alpha$ cluster states in $^{26}$Mg via the $^{22}$Ne($^{6}$Li,$d\gamma$)$^{26}$Mg reaction in inverse kinematics at an energy of $7$ MeV/nucleon. States between $E_x$ = 4 - 12 MeV in $^{26}$Mg were populated and relative $\alpha$ spectroscopic factors were determined. Some of these states correspond to resonances in the Gamow window of the $^{22}$Ne($\alpha$,n)$^{25}$Mg reaction, which is one of the main neutron sources in the astrophysical $s$-process. We show that $\alpha$-cluster strength of the states analyzed in this work have critical impact on s-process abundances. Using our new $^{22}$Ne($\alpha$,n)$^{25}$Mg and $^{22}$Ne($\alpha$,$\gamma$)$^{26}$Mg reaction rates, we performed new s-process calculations for massive stars and Asymptotic Giant Branch stars and compared the resulting yields with the yields obtained using other $^{22}$Ne+$\alpha$ rates from the literature. We observe an impact on the s-process abundances up to a factor of three for intermediate-mass AGB stars and up to a factor of ten for massive stars. Additionally, states in $^{25}$Mg at $E_x$ $<$ 5 MeV are identified via the $^{22}$Ne($^{6}$Li,$t$)$^{25}$Mg reaction for the first time. We present the ($^6$Li, $t$) spectroscopic factors of these states and note similarities to the $(d,p$) reaction in terms of reaction selectivity.


title: Compact Spectral Characterization of 5-500 MeV X-rays from the Texas Petawatt Laser-Driven Plasma Accelerator

abstract: We reconstruct spectra of secondary x-rays generated from a 500 MeV - 2 GeV laser plasma electron accelerator. A compact (7.5 $\times$ 7.5 $\times$ 15 cm), modular x-ray calorimeter made of alternating layers of absorbing materials and imaging plates records the single-shot x-ray depth-energy distribution. X-rays range from few-MeV inverse Compton scattered x-rays to $\sim$100 MeV average bremsstrahlung energies and are characterized individually by the same calorimeter detector. Geant4 simulations of energy deposition from mono-energetic x-rays in the stack generate an energy-vs-depth response matrix for the given stack configuration. A fast, iterative reconstruction algorithm based on analytic models of inverse Compton scattering and bremsstrahlung photon energy distributions then unfolds x-ray spectra in $\sim10$ seconds.


title: On electrical gates on fungal colony

abstract: Mycelium networks are promising substrates for designing unconventional computing devices providing rich topologies and geometries where signals propagate and interact. Fulfilling our long-term objectives of prototyping electrical analog computers from living mycelium networks, including networks hybridised with nanoparticles, we explore the possibility of implementing Boolean logical gates based on electrical properties of fungal colonies. We converted a 3D image-data stack of \emph{Aspergillus niger} fungal colony to an Euclidean graph and modelled the colony as resistive and capacitive (RC) networks, where electrical parameters of edges were functions of the edges' lengths. We found that {\sc and}, {\sc or} and {\sc and-not} gates are implementable in RC networks derived from the geometrical structure of the real fungal colony.


title: The geometry of Gaussian double Markovian distributions

abstract: Gaussian double Markovian models consist of covariance matrices constrained by a pair of graphs specifying zeros simultaneously in the covariance matrix and its inverse. We study the semi-algebraic geometry of these models, in particular their dimension, smoothness and connectedness as well as algebraic and combinatorial properties.


title: Attention Bottlenecks for Multimodal Fusion

abstract: Humans perceive the world by concurrently processing and fusing high-dimensional inputs from multiple modalities such as vision and audio. Machine perception models, in stark contrast, are typically modality-specific and optimised for unimodal benchmarks, and hence late-stage fusion of final representations or predictions from each modality (`late-fusion') is still a dominant paradigm for multimodal video classification. Instead, we introduce a novel transformer based architecture that uses `fusion bottlenecks' for modality fusion at multiple layers. Compared to traditional pairwise self-attention, our model forces information between different modalities to pass through a small number of bottleneck latents, requiring the model to collate and condense the most relevant information in each modality and only share what is necessary. We find that such a strategy improves fusion performance, at the same time reducing computational cost. We conduct thorough ablation studies, and achieve state-of-the-art results on multiple audio-visual classification benchmarks including Audioset, Epic-Kitchens and VGGSound. All code and models will be released.


title: The three-year shear catalog of the Subaru Hyper Suprime-Cam SSP Survey

abstract: We present the galaxy shear catalog that will be used for the three-year cosmological weak gravitational lensing analyses using data from the Wide layer of the Hyper Suprime-Cam (HSC) Subaru Strategic Program (SSP) Survey. The galaxy shapes are measured from the $i$-band imaging data acquired from 2014 to 2019 and calibrated with image simulations that resemble the observing conditions of the survey based on training galaxy images from the Hubble Space Telescope in the COSMOS region. The catalog covers an area of 433.48 deg$^2$ of the northern sky, split into six fields. The mean $i$-band seeing is 0.59 arcsec. With conservative galaxy selection criteria (e.g., $i$-band magnitude brighter than 24.5), the observed raw galaxy number density is 22.9 arcmin$^{-2}$, and the effective galaxy number density is 19.9 arcmin$^{-2}$. The calibration removes the galaxy property-dependent shear estimation bias to a level: $|\delta m|<9\times 10^{-3}$. The bias residual $\delta m$ shows no dependence on redshift in the range $0<z\leq 3$. We define the requirements for cosmological weak lensing science for this shear catalog, and quantify potential systematics in the catalog using a series of internal null tests for systematics related to point-spread function modelling and shear estimation. A variety of the null tests are statistically consistent with zero or within requirements, but (i) there is evidence for PSF model shape residual correlations; and (ii) star-galaxy shape correlations reveal additive systematics. Both effects become significant on $>1$ degree scales and will require mitigation during the inference of cosmological parameters using cosmic shear measurements.


title: Ward-Fonten\'e Differential Universal Algebras

abstract: In this paper a Ward-Fonten\'e differential universal algebra is constructed. In this algebra it is possible to obtain a product $\psi$-rule and a general $\psi$-rule of Leibniz for any calculus on sequences. In particular, the simplicial polytopic calculus and the calculus on Bell numbers are introduced.


title: Effects of non-vanishing dark matter pressure in the Milky Way galaxy

abstract: We consider the possibility that the Milky Way's dark matter halo possesses a non vanishing equation of state. Consequently, we evaluate the contribution due to the speed of sound, assuming that the dark matter content of the galaxy behaves like a fluid with pressure. In particular, we model the dark matter distribution via an exponential sphere profile in the galactic core, and inner parts of the galaxy whereas we compare the exponential sphere with three widely-used profiles for the halo, i.e. the Einasto, Burkert and Isothermal profile. For the galactic core we also compare the effects due to a dark matter distribution without black hole with the case of a supermassive black hole in vacuum and show that present observations are unable to distinguish them. Finally we investigate the expected experimental signature provided by gravitational lensing due to the presence of dark matter in the core.


title: Nonlinear Inverse Compton Scattering from a Laser Wakefield Accelerator and Plasma Mirror

abstract: We generate inverse Compton scattered X-rays in both linear and nonlinear regimes with a 250 MeV laser wakefield electron accelerator and plasma mirror by retro-reflecting the unused drive laser light to scatter from the accelerated electrons. We characterize the X-rays using a CsI(Tl) voxelated scintillator that measures their total energy and divergence as a function of plasma mirror distance from the accelerator exit. At each plasma mirror position, these X-ray properties are correlated with the measured fluence and inferred intensity of the laser pulse after driving the accelerator to determine the laser strength parameter $a_0$. The results show that ICS X-rays are generated at $a_0$ ranging from $0.3\pm0.1$ to $1.65\pm0.25$, and exceed the strength of co-propagating bremsstrahlung and betatron X-rays at least ten-fold throughout this range of $a_0$.