title: Coupled stochastic systems of Skorokhod type: well-posedness of a mathematical model and its applications

abstract: Population dynamics with complex biological interactions, accounting for uncertainty quantification, is critical for many application areas. However, due to the complexity of biological systems, the mathematical formulation of the corresponding problems faces the challenge that the corresponding stochastic processes should, in most cases, be considered in bounded domains. We propose a model based on a coupled system of reflecting Skorokhod-type stochastic differential equations with jump-like exit from a boundary. The setting describes the population dynamics of active and passive populations. As main working techniques, we use compactness methods and Skorokhod's representation of solutions to SDEs posed in bounded domains to prove the well-posedness of the system. This functional setting is a new point of view in the field of modelling and simulation of population dynamics. We provide the details of the model, as well as representative numerical examples, and discuss the applications of a Wilson-Cowan-type system, modelling the dynamics of two interacting populations of excitatory and inhibitory neurons. Furthermore, the presence of random input current, reflecting factors together with Poisson jumps, increases firing activity in neuronal systems.


title: Consensus Formation Tracking for Multiple AUV Systems Using Distributed Bioinspired Sliding Mode Control

abstract: Consensus formation tracking of multiple autonomous underwater vehicles (AUVs) subject to nonlinear and uncertain dynamics is a challenging problem in robotics. To tackle this challenge, a distributed bioinspired sliding mode controller is proposed in this paper. First, the conventional sliding mode controller (SMC) is presented, and the consensus problem is addressed on the basis of graph theory. Next, to tackle the high frequency chattering issue in SMC scheme and meanwhile improve the robustness to the noises, a bioinspired approach is introduced, in which a neural dynamic model is employed to replace the nonlinear sign or saturation function in the synthesis of conventional sliding mode controllers. Furthermore, the input-to-state stability of the resulting closed-loop system is proved in the presence of bounded lumped disturbance by the Lyapunov stability theory. Finally, simulation experiments are conducted to demonstrate the effectiveness of the proposed distributed formation control protocol.


title: Recursion does not always help

abstract: We show that adding recursion does not increase the total functions definable in the typed $\lambda\beta\eta$-calculus or the partial functions definable in the $\lambda\Omega$-calculus. As a consequence, adding recursion does not increase the class of partial or total definable functions on free algebras and so, in particular, on the natural numbers.


title: A data management system for machine learning research of tokamak

abstract: In recent years, machine learning (ML) research methods have received increasing attention in the tokamak community. The conventional database (i.e., MDSplus for tokamak) of experimental data has been designed for small group consumption and is mainly aimed at simultaneous visualization of a small amount of data. The ML data access patterns fundamentally differ from traditional data access patterns. The typical MDSplus database is increasingly showing its limitations. We developed a new data management system suitable for tokamak machine learning research based on Experimental Advanced Superconducting Tokamak (EAST) data. The data management system is based on MongoDB and Hierarchical Data Format version 5 (HDF5). Currently, the entire data management has more than 3000 channels of data. The system can provide highly reliable concurrent access. The system includes error correction, MDSplus original data conversion, and high-performance sequence data output. Further, some valuable functions are implemented to accelerate ML model training of fusion, such as bucketing generator, the concatenating buffer, and distributed sequence generation. This data management system is more suitable for fusion machine learning model R\&D than MDSplus, but it can not replace the MDSplus database. The MDSplus database is still the backend for EAST tokamak data acquisition and storage.


title: CS-UM6P at SemEval-2022 Task 6: Transformer-based Models for Intended Sarcasm Detection in English and Arabic

abstract: Sarcasm is a form of figurative language where the intended meaning of a sentence differs from its literal meaning. This poses a serious challenge to several Natural Language Processing (NLP) applications such as Sentiment Analysis, Opinion Mining, and Author Profiling. In this paper, we present our participating system to the intended sarcasm detection task in English and Arabic languages. Our system\footnote{The source code of our system is available at \url{https://github.com/AbdelkaderMH/iSarcasmEval}} consists of three deep learning-based models leveraging two existing pre-trained language models for Arabic and English. We have participated in all sub-tasks. Our official submissions achieve the best performance on sub-task A for Arabic language and rank second in sub-task B. For sub-task C, our system is ranked 7th and 11th on Arabic and English datasets, respectively.


title: A IETI-DP method for discontinuous Galerkin discretizations in Isogeometric Analysis with inexact local solvers

abstract: We construct solvers for an isogeometric multi-patch discretization, where the patches are coupled via a discontinuous Galerkin approach, which allows the consideration of discretizations that do not match on the interfaces. We solve the resulting linear system using a Dual-Primal IsogEometric Tearing and Interconnecting (IETI-DP) method. We are interested in solving the arising patch-local problems using iterative solvers since this allows the reduction of the memory footprint. We solve the patch-local problems approximately using the Fast Diagonalization method, which is known to be robust in the grid size and the spline degree. To obtain the tensor structure needed for the application of the Fast Diagonalization method, we introduce an orthogonal splitting of the local function spaces. We present a convergence theory that confirms that the condition number of the preconditioned system only grows poly-logarithmically with the grid size. The numerical experiments confirm this finding. Moreover, they show that the convergence of the overall solver only mildly depends on the spline degree. We observe a mild reduction of the computational times and a significant reduction of the memory requirements in comparison to standard IETI-DP solvers using sparse direct solvers for the local subproblems. Furthermore, the experiments indicate good scaling behavior on distributed memory machines.


title: Direct construction of stellarator-symmetric quasi-isodynamic magnetic configurations

abstract: We develop the formalism of the first order near-axis expansion of the MHD equilibrium equations described in Garren & Boozer (1991), Plunk et al. (2019) and Plunk et al. (2021), for the case of a quasi-isodynamic, N-field period, stellarator symmetric, single-well magnetic field equilibrium. The importance of the magnetic axis shape is investigated, and we conclude that control of the curvature and torsion is crucial to obtain omnigenous configurations with finite aspect ratio and low effective ripple, especially for a higher number of field periods. For this reason a method is derived to construct classes of axis shapes with favourable curvature and torsion. Solutions are presented, including a three-field-period configuration constructed at an aspect ratio of A=20, with a maximum elongation of e=3.2 and an effective ripple under 1%, which demonstrates that high elongation is not a necessary feature of QI stellarators.


title: Uncertainty Quantification and the Marginal MDP Model

abstract: The paper presents a new perspective on the mixture of Dirichlet process model which allows the recovery of full and correct uncertainty quantification associated with the full model, even after having integrated out the random distribution function. The implication is that we can run a simple Markov chain Monte Carlo algorithm and subsequently return the original uncertainty which was removed from the integration. This also has the benefit of avoiding more complicated algorithms which do not perform the integration step. Numerous illustrations are presented.


title: Time Reversal for 6G Spatiotemporal Focusing: Recent Experiments, Opportunities, and Challenges

abstract: Late visions and trends for the future sixth Generation (6G) of wireless communications advocate, among other technologies, towards the deployment of network nodes with extreme numbers of antennas and up to terahertz frequencies, as means to enable various immersive applications. However, these technologies impose several challenges in the design of radio-frequency front-ends and beamforming architectures, as well as of ultra-wideband waveforms and computationally efficient transceiver signal processing. In this article, we revisit the Time Reversal (TR) technique, which was initially experimented in acoustics, in the context of large-bandwidth 6G wireless communications, capitalizing on its high resolution spatiotemporal focusing realized with low complexity transceivers. We first overview representative state-of-the-art in TR-based wireless communications, identifying the key competencies and requirements of TR for efficient operation. Recent and novel experimental setups and results for the spatiotemporal focusing capability of TR at the carrier frequencies $2.5$, $36$, and $273$ GHz are then presented, demonstrating in quantitative ways the technique's effectiveness in these very different frequency bands, as well as the roles of the available bandwidth and the number of transmit antennas. We also showcase the TR potential for realizing low complexity multi-user communications. The opportunities arising from TR-based wireless communications as well as the challenges for finding their place in 6G networks, also in conjunction with other complementary candidate technologies, are highlighted.


title: Generalised Bayesian Inference for Discrete Intractable Likelihood

abstract: Discrete state spaces represent a major computational challenge to statistical inference, since the computation of normalisation constants requires summation over large or possibly infinite sets, which can be impractical. This paper addresses this computational challenge through the development of a novel generalised Bayesian inference procedure suitable for discrete intractable likelihood. Inspired by recent methodological advances for continuous data, the main idea is to update beliefs about model parameters using a discrete Fisher divergence, in lieu of the problematic intractable likelihood. The result is a generalised posterior that can be sampled from using standard computational tools, such as Markov chain Monte Carlo, circumventing the intractable normalising constant. The statistical properties of the generalised posterior are analysed, with sufficient conditions for posterior consistency and asymptotic normality established. In addition, a novel and general approach to calibration of generalised posteriors is proposed. Applications are presented on lattice models for discrete spatial data and on multivariate models for count data, where in each case the methodology facilitates generalised Bayesian inference at low computational cost.


title: Lapse singularities, caustics and entanglement

abstract: We study diffraction catastrophes of wave functions in diffeomorphism invariant quantum theories, for which $\hat H\Psi=0$. These wave functions can be represented in terms of integrations over cycles in a complexified lapse variable $N$. The integrand $\exp(i{\mathbb S}(N))$ may have multiple essential singularities at finite values of $N$ and at infinity. A basis set for Greens functions and solutions of the wave equation is represented by Lefschetz thimbles connecting these singularities. The finite $N$ singularities are shown to be directly related to $A_{n\ge 3}$ caustics. We give an example similar to a minisuperspace cosmological model constructed by Halliwell and Myers, to which we add a scalar field. We show that caustics with codimension $d\ge 2$ exhibit strong entanglement with respect to partitions of their unfolding degrees of freedom. If an unfolding direction corresponds to a physical clock in a solution of the Wheeler-DeWitt equation, the caustic bears some resemblance to a quantum measurement. The R\'enyi entanglement entropy ${\cal R}_n$ is expressed in terms of integrals over $2n$ lapse variables $N_i$. Writing the integrand as $\exp(i\Gamma)$, we find that the finite $N$ essential singularities of $\exp(i{\mathbb S})$ are replaced with non-essential singularities of $\exp(i\Gamma)$ at cyclically related $N_i = N_j$ , which the Lefschetz thimbles evade. The relative homology classes to which the integration cycles belong are higher dimensional variants of links.


title: Real-time motion amplification on mobile devices

abstract: A simple motion amplification algorithm suitable for real-time applications on mobile devices, including smartphones, is presented. It is based on motion enhancement by moving average differencing (MEMAD), a temporal high-pass filter for video streams. MEMAD can amplify small moving objects or subtle motion in larger objects. It is computationally sufficiently simple to be implemented in real time on smartphones. In the specific implementation as an Android phone app, MEMAD is demonstrated on examples chosen such as to motivate applications in the engineering, biological, and medical sciences.


title: IRISformer: Dense Vision Transformers for Single-Image Inverse Rendering in Indoor Scenes

abstract: Indoor scenes exhibit significant appearance variations due to myriad interactions between arbitrarily diverse object shapes, spatially-changing materials, and complex lighting. Shadows, highlights, and inter-reflections caused by visible and invisible light sources require reasoning about long-range interactions for inverse rendering, which seeks to recover the components of image formation, namely, shape, material, and lighting. In this work, our intuition is that the long-range attention learned by transformer architectures is ideally suited to solve longstanding challenges in single-image inverse rendering. We demonstrate with a specific instantiation of a dense vision transformer, IRISformer, that excels at both single-task and multi-task reasoning required for inverse rendering. Specifically, we propose a transformer architecture to simultaneously estimate depths, normals, spatially-varying albedo, roughness and lighting from a single image of an indoor scene. Our extensive evaluations on benchmark datasets demonstrate state-of-the-art results on each of the above tasks, enabling applications like object insertion and material editing in a single unconstrained real image, with greater photorealism than prior works. Code and data are publicly released at https://github.com/ViLab-UCSD/IRISformer.


title: Intercell Moir\'e Exciton Complexes in Electron Lattices

abstract: Excitons, Coulomb-bound electron-hole pairs, play a fundamental role in both optical excitation and correlated phenomena in solids. When an exciton interacts with other quasi-particles, few- and many-body excited states, such as trions, exciton Fermi-polarons, Mahan excitons can appear. Here, we report a new interaction between exciton and charges enabled by unusual quantum confinement in 2D moir\'e superlattices, which results in novel exciton many-body ground states composed of moir\'e excitons and correlated electron lattices. Unique to H-stacked (or 60o-twisted) WS2/WSe2 heterobilayer, we found that the interlayer atomic registry and moir\'e structural reconstruction leads to an interlayer moir\'e exciton (IME) whose hole in one layer is surrounded by its partner electron's wavefunction spread among three adjacent moir\'e traps in the other layer. This 3D excitonic structure can enable large in-plane electrical quadrupole moments in addition to the vertical dipole. Upon doping, the electric quadrupole facilitates the binding of IME to the charges in neighboring moir\'e cells, forming an intercell charged exciton complex. The exciton complex is unveiled by the IME photoluminescence energy jumps when the electron lattices form at both fractional and integer-filled moir\'e minibands, with replica-like spectral features between successive integer moir\'e fillings. Our work provides the framework in understanding and engineering emergent exciton many-body states in correlated moir\'e charge orders.


title: DialogueScript: Using Dialogue Agents to Produce a Script

abstract: We present a novel approach to generating scripts by using agents with different personality types. To manage character interaction in the script, we employ simulated dramatic networks. Automatic and human evaluation on multiple criteria shows that our approach outperforms a vanilla-GPT2-based baseline. We further introduce a new metric to evaluate dialogue consistency based on natural language inference and demonstrate its validity.


title: Descriptive Combinatorics, Computable Combinatorics, and ASI Algorithms

abstract: We introduce new types of local algorithms, which we call "ASI Algorithms", and use them to demonstrate a link between descriptive and computable combinatorics. This allows us to unify arguments from the two fields, and also sometimes to port arguments from one field to the other. As an example, we generalize a computable combinatorics result of Kierstead and use it to get within one color of the Baire measurable analogue of Vizing's Theorem. We also improve Kierstead's result for multigraphs along the way.


title: SATBench: Benchmarking the speed-accuracy tradeoff in object recognition by humans and dynamic neural networks

abstract: The core of everyday tasks like reading and driving is active object recognition. Attempts to model such tasks are currently stymied by the inability to incorporate time. People show a flexible tradeoff between speed and accuracy and this tradeoff is a crucial human skill. Deep neural networks have emerged as promising candidates for predicting peak human object recognition performance and neural activity. However, modeling the temporal dimension i.e., the speed-accuracy tradeoff (SAT), is essential for them to serve as useful computational models for how humans recognize objects. To this end, we here present the first large-scale (148 observers, 4 neural networks, 8 tasks) dataset of the speed-accuracy tradeoff (SAT) in recognizing ImageNet images. In each human trial, a beep, indicating the desired reaction time, sounds at a fixed delay after the image is presented, and observer's response counts only if it occurs near the time of the beep. In a series of blocks, we test many beep latencies, i.e., reaction times. We observe that human accuracy increases with reaction time and proceed to compare its characteristics with the behavior of several dynamic neural networks that are capable of inference-time adaptive computation. Using FLOPs as an analog for reaction time, we compare networks with humans on curve-fit error, category-wise correlation, and curve steepness, and conclude that cascaded dynamic neural networks are a promising model of human reaction time in object recognition tasks.


title: EyeNeRF: A Hybrid Representation for Photorealistic Synthesis, Animation and Relighting of Human Eyes

abstract: A unique challenge in creating high-quality animatable and relightable 3D avatars of people is modeling human eyes. The challenge of synthesizing eyes is multifold as it requires 1) appropriate representations for the various components of the eye and the periocular region for coherent viewpoint synthesis, capable of representing diffuse, refractive and highly reflective surfaces, 2) disentangling skin and eye appearance from environmental illumination such that it may be rendered under novel lighting conditions, and 3) capturing eyeball motion and the deformation of the surrounding skin to enable re-gazing. These challenges have traditionally necessitated the use of expensive and cumbersome capture setups to obtain high-quality results, and even then, modeling of the eye region holistically has remained elusive. We present a novel geometry and appearance representation that enables high-fidelity capture and photorealistic animation, view synthesis and relighting of the eye region using only a sparse set of lights and cameras. Our hybrid representation combines an explicit parametric surface model for the eyeball with implicit deformable volumetric representations for the periocular region and the interior of the eye. This novel hybrid model has been designed to address the various parts of that challenging facial area - the explicit eyeball surface allows modeling refraction and high-frequency specular reflection at the cornea, whereas the implicit representation is well suited to model lower-frequency skin reflection via spherical harmonics and can represent non-surface structures such as hair or diffuse volumetric bodies, both of which are a challenge for explicit surface models. We show that for high-resolution close-ups of the eye, our model can synthesize high-fidelity animated gaze from novel views under unseen illumination conditions.


title: Scalable Temporal Localization of Sensitive Activities in Movies and TV Episodes

abstract: To help customers make better-informed viewing choices, video-streaming services try to moderate their content and provide more visibility into which portions of their movies and TV episodes contain age-appropriate material (e.g., nudity, sex, violence, or drug-use). Supervised models to localize these sensitive activities require large amounts of clip-level labeled data which is hard to obtain, while weakly-supervised models to this end usually do not offer competitive accuracy. To address this challenge, we propose a novel Coarse2Fine network designed to make use of readily obtainable video-level weak labels in conjunction with sparse clip-level labels of age-appropriate activities. Our model aggregates frame-level predictions to make video-level classifications and is therefore able to leverage sparse clip-level labels along with video-level labels. Furthermore, by performing frame-level predictions in a hierarchical manner, our approach is able to overcome the label-imbalance problem caused due to the rare-occurrence nature of age-appropriate content. We present comparative results of our approach using 41,234 movies and TV episodes (~3 years of video-content) from 521 sub-genres and 250 countries making it by far the largest-scale empirical analysis of age-appropriate activity localization in long-form videos ever published. Our approach offers 107.2% relative mAP improvement (from 5.5% to 11.4%) over existing state-of-the-art activity-localization approaches.


title: Suzaku Observations of the Cluster Outskirts and Intercluster Filament in the Triple Merger Cluster Abell 98

abstract: We present Suzaku observations of the Abell 98 (A98) triple galaxy cluster system and the purported intercluster filament. The three subclusters are expected to lie along a large scale cosmic filament. With partial azimuthal coverage of the northernmost cluster, we find that the inferred entropy profile of this relatively low mass cluster ($kT \approx 2.8$ keV) adheres to expectations from models of self-similar pure gravitational collapse in the region of the virial radius. There is evidence of extended structure beyond $r_{200}$ to the north of the northernmost cluster, along the merger axis, with properties consistent with what is expected for the warm-hot intergalacitc medium (WHIM; $kT = 0.11_{-0.02}^{+0.01}$ keV, $n_e = {7.6 \times 10^{-5}}^{+3.6 \times 10^{-5}}_{-3.6 \times 10^{-5}}$~cm$^{-3}$). No such emission is detected at the same radius in regions away from the merger axis, consistent with the expectation that the merger axis of this triple system lies along a large scale cosmic filament. In the bridge region between A98N and A98S, there is evidence of filamentary emission at the $2.2\sigma$ level, as well as a tentative detection of cool gas ($kT \sim 1$ keV). The entropy profile of this intercluster filament suggests that the A98 system is most likely aligned closer to the plane of the sky rather than along the line of sight. The structure to the north of the system, as well as in between A98N and A98S is indicative that the clusters are connected to a larger-scale structure spanning at least 4 Mpc.


title: Poincar\'e metric of holomorphic foliations with non-degenerate singularities

abstract: Consider a Brody hyperbolic foliation $\mathscr{F}$ with non-degenerate singularities on a compact complex manifold. We show that its leafwise Poincar\'{e} metric is transversally H\"{o}lder continuous with a logarithmic slope towards the singular set of $\mathscr{F}$.


title: GraphScale: Scalable Bandwidth-Efficient Graph Processing on FPGAs

abstract: Recent advances in graph processing on FPGAs promise to alleviate performance bottlenecks with irregular memory access patterns. Such bottlenecks challenge performance for a growing number of important application areas like machine learning and data analytics. While FPGAs denote a promising solution through flexible memory hierarchies and massive parallelism, we argue that current graph processing accelerators either use the off-chip memory bandwidth inefficiently or do not scale well across memory channels. In this work, we propose GraphScale, a scalable graph processing framework for FPGAs. For the first time, GraphScale combines multi-channel memory with asynchronous graph processing (i.e., for fast convergence on results) and a compressed graph representation (i.e., for efficient usage of memory bandwidth and reduced memory footprint). GraphScale solves common graph problems like breadth-first search, PageRank, and weakly-connected components through modular user-defined functions, a novel two-dimensional partitioning scheme, and a high-performance two-level crossbar design.


title: Precise ground state of multi-orbital Mott systems via the variational discrete action theory

abstract: Determining the ground state of multi-orbital Hubbard models is critical for understanding strongly correlated electron materials, yet existing methods struggle to simultaneously reach zero temperature and infinite system size. The \textit{de facto} standard is to approximate a finite dimension multi-orbital Hubbard model with a $d=\infty$ version, which can then be formally solved via the dynamical mean-field theory (DMFT), though the DMFT solution is limited by the state of unbiased impurity solvers for zero temperature and multiple orbitals. The recently developed variational discrete action theory (VDAT) offers a new approach to solve the $d=\infty$ Hubbard model, with a variational ansatz that is controlled by an integer $\mathcal{N}$, and monotonically approaches the exact solution at an increasing computational cost. Here we propose a decoupled minimization algorithm to implement VDAT for the multi-orbital Hubbard model in $d=\infty$ and study $\mathcal{N}=2-4$ . At $\mathcal{N}=2$, VDAT rigorously recovers the multi-orbital Gutzwiller approximation, reproducing known results. At $\mathcal{N}=3$, VDAT precisely captures the competition between the Hubbard $U$, Hund $J$, and crystal field $\Delta$ in the two orbital Hubbard model over all parameter space, with a negligible computational cost. For sufficiently large $U/t$ and $J/U$, we show that $\Delta$ drives a first-order transition within the Mott insulating regime. In the large orbital polarization limit with finite $J/U$, we find that interactions have a nontrivial effect even for small $U/t$. VDAT will have far ranging implications for understanding multi-orbital model Hamiltonians and strongly correlated electron materials.


title: The Case for a Wholistic Serverless Programming Paradigm and Full Stack Automation for AI and Beyond -- The Philosophy of Jaseci and Jac

abstract: In this work, the case is made for a wholistic top-down re-envisioning of the system stack from the programming language level down through the system architecture to bridge this complexity gap. The key goal of our design is to address the critical need for the programmer to articulate solutions with higher level abstractions at the problem level while having the runtime system stack subsume and hide a broad scope of diffuse sub-applications and inter-machine resources. This work also presents the design of a production-grade realization of such a system stack architecture called Jaseci, and corresponding programming language Jac. Jac and Jaseci has been released as open source and has been leveraged by real product teams to accelerate developing and deploying sophisticated AI products and other applications at scale. Jac has been utilized in commercial production environments to accelerate AI development timelines by ~10x, with the Jaseci runtime automating the decisions and optimizations typically falling in the scope of manual engineering roles on a team such as what should and should not be a microservice and changing those dynamically.


title: Optimal Parallel Sequential Change Detection under Generalized Performance Measures

abstract: This paper considers the detection of change points in parallel data streams, a problem widely encountered when analyzing large-scale real-time streaming data. Each stream may have its own change point, at which its data has a distributional change. With sequentially observed data, a decision maker needs to declare whether changes have already occurred to the streams at each time point.Once a stream is declared to have changed, it is deactivated permanently so that its future data will no longer be collected. This is a compound decision problem in the sense that the decision maker may want to optimize certain compound performance metrics that concern all the streams as a whole. Thus, the decisions are not independent for different streams. Our contribution is three-fold. First, we propose a general framework for compound performance metrics that includes the ones considered in the existing works as special cases and introduces new ones that connect closely with the performance metrics for single-stream sequential change detection and large-scale hypothesis testing. Second, data-driven decision procedures are developed under this framework. Finally, optimality results are established for the proposed decision procedures. The proposed methods and theory are evaluated by simulation studies and a case study.


title: Phase Identification of Distribution System Users Through a MILP Extension of State Estimation

abstract: To address the challenges and exploit the opportunities that the decarbonization of the energy sector is bringing about, advanced distribution network management and operation strategies are being developed. Many of these require accurate network models to work effectively, including user phase connectivity. However, such information is often not available. This paper proposes a novel method to identify the phase connectivity of single- and three-phase distribution consumers using smart meter measurements. The method is based on state estimation and mixed-integer linear programming, and requires shorter measurement collection times compared to statistical and machine learning-based techniques, for the same level of accuracy. Consequently, the duration of measurement efforts/campaigns aimed at obtaining this type of information reduces, accelerating the system knowledge acquisition process and potentially reducing the campaigns' costs. A technique is illustrated that allows to solve large networks in acceptable time despite the considerable number of integer variables. Extensive computational results are presented for publicly available low voltage feeders.


title: On Existence of Berk-Nash Equilibria in Misspecified Markov Decision Processes with Infinite Spaces

abstract: Model misspecification is a critical issue in many areas of theoretical and empirical economics. In the specific context of misspecified Markov Decision Processes, Esponda and Pouzo (2021) defined the notion of Berk-Nash equilibrium and established its existence in the setting of finite state and action spaces. However, many substantive applications (including two of the three motivating examples presented by Esponda and Pouzo, as well as Gaussian and log-normal distributions, and CARA, CRRA and mean-variance preferences) involve continuous state or action spaces, and are thus not covered by the Esponda-Pouzo existence theorem. We extend the existence of Berk-Nash equilibrium to compact action spaces and sigma-compact state spaces, with possibly unbounded payoff functions. A complication arises because the Berk-Nash equilibrium notion depends critically on Radon-Nikodym derivatives, which are necessarily bounded in the finite case but typically unbounded in misspecified continuous models. The proofs rely on nonstandard analysis and, relative to previous applications of nonstandard analysis in economic theory, draw on novel argumentation traceable to work of the second author on nonstandard representations of Markov processes.


title: Fast and Accurate Variational Inference for Large Bayesian VARs with Stochastic Volatility

abstract: We propose a new variational approximation of the joint posterior distribution of the log-volatility in the context of large Bayesian VARs. In contrast to existing approaches that are based on local approximations, the new proposal provides a global approximation that takes into account the entire support of the joint distribution. In a Monte Carlo study we show that the new global approximation is over an order of magnitude more accurate than existing alternatives. We illustrate the proposed methodology with an application of a 96-variable VAR with stochastic volatility to measure global bank network connectedness.


title: OpenSRH: optimizing brain tumor surgery using intraoperative stimulated Raman histology

abstract: Accurate intraoperative diagnosis is essential for providing safe and effective care during brain tumor surgery. Our standard-of-care diagnostic methods are time, resource, and labor intensive, which restricts access to optimal surgical treatments. To address these limitations, we propose an alternative workflow that combines stimulated Raman histology (SRH), a rapid optical imaging method, with deep learning-based automated interpretation of SRH images for intraoperative brain tumor diagnosis and real-time surgical decision support. Here, we present OpenSRH, the first public dataset of clinical SRH images from 300+ brain tumors patients and 1300+ unique whole slide optical images. OpenSRH contains data from the most common brain tumors diagnoses, full pathologic annotations, whole slide tumor segmentations, raw and processed optical imaging data for end-to-end model development and validation. We provide a framework for patch-based whole slide SRH classification and inference using weak (i.e. patient-level) diagnostic labels. Finally, we benchmark two computer vision tasks: multiclass histologic brain tumor classification and patch-based contrastive representation learning. We hope OpenSRH will facilitate the clinical translation of rapid optical imaging and real-time ML-based surgical decision support in order to improve the access, safety, and efficacy of cancer surgery in the era of precision medicine. Dataset access, code, and benchmarks are available at opensrh.mlins.org.


title: Ruling Out New Physics at Low Redshift as a solution to the $H_0$ Tension

abstract: We make the case that there can be no low-redshift solution to the $H_0$ tension. To robustly answer this question, we use a very flexible parameterization for the dark energy equation of state such that every cosmological distance still allowed by data exists within this prior volume. To then answer whether there exists a satisfactory solution to the $H_0$ tension within this comprehensive parameterization, we constrained the parametric form using different partitions of the Planck cosmic microwave background, SDSS-IV/eBOSS DR16 baryon acoustic oscillation, and Pantheon supernova datasets. When constrained by just the cosmic microwave background dataset, there exists a set of equations of state which yields high $H_0$ values, but these equations of state are ruled out by the combination of the supernova and baryon acoustic oscillation datasets. In other words, the constraint from the cosmic microwave background, baryon acoustic oscillation, and supernova datasets together does not allow for high $H_0$ values and converges around an equation of state consistent with a cosmological constant. Thus, since this very flexible parameterization does not offer a solution to the $H_0$ tension, there can be no solution to the $H_0$ tension that adds physics at only low redshifts. This is directly related to the expansion history of the Universe and its geometrical properties and would include models beyond those parametrized by $w(z)$.


title: GAAMA 2.0: An Integrated System that Answers Boolean and Extractive Questions

abstract: Recent machine reading comprehension datasets include extractive and boolean questions but current approaches do not offer integrated support for answering both question types. We present a multilingual machine reading comprehension system and front-end demo that handles boolean questions by providing both a YES/NO answer and highlighting supporting evidence, and handles extractive questions by highlighting the answer in the passage. Our system, GAAMA 2.0, is ranked first on the Tydi QA leaderboard at the time of this writing. We contrast two different implementations of our approach. The first includes several independent stacks of transformers allowing easy deployment of each component. The second is a single stack of transformers utilizing adapters to reduce GPU memory footprint in a resource-constrained environment.


title: Understanding Decision-Time vs. Background Planning in Model-Based Reinforcement Learning

abstract: In model-based reinforcement learning, an agent can leverage a learned model to improve its way of behaving in different ways. Two prevalent approaches are decision-time planning and background planning. In this study, we are interested in understanding under what conditions and in which settings one of these two planning styles will perform better than the other in domains that require fast responses. After viewing them through the lens of dynamic programming, we first consider the classical instantiations of these planning styles and provide theoretical results and hypotheses on which one will perform better in the pure planning, planning & learning, and transfer learning settings. We then consider the modern instantiations of these planning styles and provide hypotheses on which one will perform better in the last two of the considered settings. Lastly, we perform several illustrative experiments to empirically validate both our theoretical results and hypotheses. Overall, our findings suggest that even though decision-time planning does not perform as well as background planning in their classical instantiations, in their modern instantiations, it can perform on par or better than background planning in both the planning & learning and transfer learning settings.


title: Coherent orientations in symplectic field theory revisited

abstract: In symplectic field theory (SFT), the moduli spaces of $J$-holomorphic curves can be oriented coherently (compatible with gluing). In this note, we correct the signs involved in the generating function $\mathbf H$ in SFT so that the master equation $\mathbf H \cdot \mathbf H = 0$ holds assuming transversality. The orientation convention that we use is consistent with that of Hutchings-Taubes from [HT09].


title: Evaluating Approximate Flavor Instability Metrics in Neutron Star Mergers

abstract: Neutrinos can rapidly change flavor in the inner dense regions of core-collapse supernovae and neutron star mergers due to the neutrino fast flavor instability. If the amount of flavor transformation is significant, the FFI could significantly affect how supernovae explode and how supernovae and mergers enrich the universe with heavy elements. Since many state of the art supernova and merger simulations rely on neutrino transport algorithms based on angular moments of the radiation field, there is incomplete information with which to determine if the distributions are unstable to the FFI. In this work we test the performance of several proposed moment-based instability tests in the literature. We perform time-independent general relativistic neutrino transport on a snapshot of a 3D neutron star merger simulation to generate reasonable neutrino distributions and check where each of these criteria correctly predict instability. In addition, we offer a new ``maximum entropy'' instability test that is somewhat more complex, but offers more detailed (though still approximate) estimates of ELN crossing width and depth. We find that this maximum entropy test and the resonant trajectory test are particularly accurate at predicting instability in this snapshot, though all tests predict instability where significant flavor transformation is most likely.


title: Enriching Abusive Language Detection with Community Context

abstract: Uses of pejorative expressions can be benign or actively empowering. When models for abuse detection misclassify these expressions as derogatory, they inadvertently censor productive conversations held by marginalized groups. One way to engage with non-dominant perspectives is to add context around conversations. Previous research has leveraged user- and thread-level features, but it often neglects the spaces within which productive conversations take place. Our paper highlights how community context can improve classification outcomes in abusive language detection. We make two main contributions to this end. First, we demonstrate that online communities cluster by the nature of their support towards victims of abuse. Second, we establish how community context improves accuracy and reduces the false positive rates of state-of-the-art abusive language classifiers. These findings suggest a promising direction for context-aware models in abusive language research.


title: Methods for Estimating and Improving Robustness of Language Models

abstract: Despite their outstanding performance, large language models (LLMs) suffer notorious flaws related to their preference for simple, surface-level textual relations over full semantic complexity of the problem. This proposal investigates a common denominator of this problem in their weak ability to generalise outside of the training domain. We survey diverse research directions providing estimations of model generalisation ability and find that incorporating some of these measures in the training objectives leads to enhanced distributional robustness of neural models. Based on these findings, we present future research directions towards enhancing the robustness of LLMs.


title: Inferring pulsar periods from synchro-curvature spectra

abstract: The period and the period derivative of a pulsar are critical magnitudes for defining the properties of the magnetospheric size and plasma dynamics. The pulsar light cylinder, the magnetic field intensity nearby it, and the curvature radius all depend on these timing properties, and shape the observed high-energy synchro-curvature emission. Therefore, the radiative properties of pulsars are inextricably linked to them. This fact poses the question of how well does a given pulsar's spectral energy distribution embeds information of the timing parameters, and if so, whether we can deduce them if they have not been measured directly. This is relevant to possibly constrain the timing properties of potential pulsar candidates among unidentified $\gamma$-ray sources. We consider well-measured pulsar spectra blinding us from the knowledge of their timing properties, and address this question by using our radiative synchro-curvature model that was proven able to fit the observed spectra of the pulsar population. We find that in the majority of the cases studied (8/13), the spin period is constrained within a range of about one order of magnitude, within which the real period lies. In the other cases, there is degeneracy and no period range can be constrained. This can be used to facilitate the blind search of pulsed signals.


title: Empirical Bayesian Approaches for Robust Constraint-based Causal Discovery under Insufficient Data

abstract: Causal discovery is to learn cause-effect relationships among variables given observational data and is important for many applications. Existing causal discovery methods assume data sufficiency, which may not be the case in many real world datasets. As a result, many existing causal discovery methods can fail under limited data. In this work, we propose Bayesian-augmented frequentist independence tests to improve the performance of constraint-based causal discovery methods under insufficient data: 1) We firstly introduce a Bayesian method to estimate mutual information (MI), based on which we propose a robust MI based independence test; 2) Secondly, we consider the Bayesian estimation of hypothesis likelihood and incorporate it into a well-defined statistical test, resulting in a robust statistical testing based independence test. We apply proposed independence tests to constraint-based causal discovery methods and evaluate the performance on benchmark datasets with insufficient samples. Experiments show significant performance improvement in terms of both accuracy and efficiency over SOTA methods.


title: Adaptive Algorithm for Quantum Amplitude Estimation

abstract: Quantum amplitude estimation is a key sub-routine of a number of quantum algorithms with various applications. We propose an adaptive algorithm for interval estimation of amplitudes. The quantum part of the algorithm is based only on Grover's algorithm. The key ingredient is the introduction of an adjustment factor, which adjusts the amplitude of good states such that the amplitude after the adjustment, and the original amplitude, can be estimated without ambiguity in the subsequent step. We show with numerical studies that the proposed algorithm uses a similar number of quantum queries to achieve the same level of precision $\epsilon$ compared to state-of-the-art algorithms, but the classical part, i.e., the non-quantum part, has substantially lower computational complexity. We rigorously prove that the number of oracle queries achieves $O(1/\epsilon)$, i.e., a quadratic speedup over classical Monte Carlo sampling, and the computational complexity of the classical part achieves $O(\log(1/\epsilon))$, both up to a double-logarithmic factor.


title: Active Fairness Auditing

abstract: The fast spreading adoption of machine learning (ML) by companies across industries poses significant regulatory challenges. One such challenge is scalability: how can regulatory bodies efficiently audit these ML models, ensuring that they are fair? In this paper, we initiate the study of query-based auditing algorithms that can estimate the demographic parity of ML models in a query-efficient manner. We propose an optimal deterministic algorithm, as well as a practical randomized, oracle-efficient algorithm with comparable guarantees. Furthermore, we make inroads into understanding the optimal query complexity of randomized active fairness estimation algorithms. Our first exploration of active fairness estimation aims to put AI governance on firmer theoretical foundations.


title: I Know What You Trained Last Summer: A Survey on Stealing Machine Learning Models and Defences

abstract: Machine Learning-as-a-Service (MLaaS) has become a widespread paradigm, making even the most complex machine learning models available for clients via e.g. a pay-per-query principle. This allows users to avoid time-consuming processes of data collection, hyperparameter tuning, and model training. However, by giving their customers access to the (predictions of their) models, MLaaS providers endanger their intellectual property, such as sensitive training data, optimised hyperparameters, or learned model parameters. Adversaries can create a copy of the model with (almost) identical behavior using the the prediction labels only. While many variants of this attack have been described, only scattered defence strategies have been proposed, addressing isolated threats. This raises the necessity for a thorough systematisation of the field of model stealing, to arrive at a comprehensive understanding why these attacks are successful, and how they could be holistically defended against. We address this by categorising and comparing model stealing attacks, assessing their performance, and exploring corresponding defence techniques in different settings. We propose a taxonomy for attack and defence approaches, and provide guidelines on how to select the right attack or defence strategy based on the goal and available resources. Finally, we analyse which defences are rendered less effective by current attack strategies.


title: GOOD: A Graph Out-of-Distribution Benchmark

abstract: Out-of-distribution (OOD) learning deals with scenarios in which training and test data follow different distributions. Although general OOD problems have been intensively studied in machine learning, graph OOD is only an emerging area of research. Currently, there lacks a systematic benchmark tailored to graph OOD method evaluation. In this work, we aim at developing an OOD benchmark, known as GOOD, for graphs specifically. We explicitly make distinctions between covariate and concept shifts and design data splits that accurately reflect different shifts. We consider both graph and node prediction tasks as there are key differences in designing shifts. Overall, GOOD contains 11 datasets with 17 domain selections. When combined with covariate, concept, and no shifts, we obtain 51 different splits. We provide performance results on 10 commonly used baseline methods with 10 random runs. This results in 510 dataset-model combinations in total. Our results show significant performance gaps between in-distribution and OOD settings. Our results also shed light on different performance trends between covariate and concept shifts by different methods. Our GOOD benchmark is a growing project and expects to expand in both quantity and variety of resources as the area develops. The GOOD benchmark can be accessed via https://github.com/divelab/GOOD/.


title: Online Score Statistics for Detecting Clustered Change in Network Point Processes

abstract: We consider online monitoring of the network event data to detect local changes in a cluster when the affected data stream distribution shifts from one point process to another with different parameters. Specifically, we are interested in detecting a change point that causes a shift of the underlying data distribution that follows a multivariate Hawkes process with exponential decay temporal kernel, whereby the Hawkes process is considered to account for spatio-temporal correlation between observations. The proposed detection procedure is based on scan score statistics. We derive the asymptotic distribution of the statistic, which enables the self-normalizing property and facilitates the approximation of the instantaneous false alarm probability and the average run length. When detecting a change in the Hawkes process with non-vanishing self-excitation, the procedure does not require estimating the post-change network parameter while assuming the temporal decay parameter, which enjoys computational efficiency. We further present an efficient procedure to accurately determine the false discovery rate via importance sampling, as validated by numerical examples. Using simulated and real stock exchange data, we show the effectiveness of the proposed method in detecting change while enjoying computational efficiency.


title: Quantifying Feature Contributions to Overall Disparity Using Information Theory

abstract: When a machine-learning algorithm makes biased decisions, it can be helpful to understand the sources of disparity to explain why the bias exists. Towards this, we examine the problem of quantifying the contribution of each individual feature to the observed disparity. If we have access to the decision-making model, one potential approach (inspired from intervention-based approaches in explainability literature) is to vary each individual feature (while keeping the others fixed) and use the resulting change in disparity to quantify its contribution. However, we may not have access to the model or be able to test/audit its outputs for individually varying features. Furthermore, the decision may not always be a deterministic function of the input features (e.g., with human-in-the-loop). For these situations, we might need to explain contributions using purely distributional (i.e., observational) techniques, rather than interventional. We ask the question: what is the "potential" contribution of each individual feature to the observed disparity in the decisions when the exact decision-making mechanism is not accessible? We first provide canonical examples (thought experiments) that help illustrate the difference between distributional and interventional approaches to explaining contributions, and when either is better suited. When unable to intervene on the inputs, we quantify the "redundant" statistical dependency about the protected attribute that is present in both the final decision and an individual feature, by leveraging a body of work in information theory called Partial Information Decomposition. We also perform a simple case study to show how this technique could be applied to quantify contributions.


title: Local overlap reduction procedure for dynamic ensemble selection

abstract: Class imbalance is a characteristic known for making learning more challenging for classification models as they may end up biased towards the majority class. A promising approach among the ensemble-based methods in the context of imbalance learning is Dynamic Selection (DS). DS techniques single out a subset of the classifiers in the ensemble to label each given unknown sample according to their estimated competence in the area surrounding the query. Because only a small region is taken into account in the selection scheme, the global class disproportion may have less impact over the system's performance. However, the presence of local class overlap may severely hinder the DS techniques' performance over imbalanced distributions as it not only exacerbates the effects of the under-representation but also introduces ambiguous and possibly unreliable samples to the competence estimation process. Thus, in this work, we propose a DS technique which attempts to minimize the effects of the local class overlap during the classifier selection procedure. The proposed method iteratively removes from the target region the instance perceived as the hardest to classify until a classifier is deemed competent to label the query sample. The known samples are characterized using instance hardness measures that quantify the local class overlap. Experimental results show that the proposed technique can significantly outperform the baseline as well as several other DS techniques, suggesting its suitability for dealing with class under-representation and overlap. Furthermore, the proposed technique still yielded competitive results when using an under-sampled, less overlapped version of the labelled sets, specially over the problems with a high proportion of minority class samples in overlap areas. Code available at https://github.com/marianaasouza/lords.


title: Polaritonic Chern insulators in monolayer semiconductors

abstract: Systems with strong light-matter interaction opens up new avenues for studying topological phases of matter. Examples include exciton-polaritons, mixed light-matter quasiparticles, where the topology of the polaritonic band structure arises from the collective coupling between matter wave and optical fields strongly confined in periodic dielectric structures. Distinct from light-matter interaction in a uniform environment, the spatially varying nature of the optical fields leads to a fundamental modification of the well-known optical selection rules, which were derived under the plane wave approximation. Here we identify polaritonic Chern insulators by coupling valley excitons in transition metal dichalcogenides (TMDs) to photonic Bloch modes in a dielectric photonic crystal (PhC) slab. We show that polaritonic Dirac points (DPs), which are markers for topological phase transition points, can be constructed from the collective coupling between valley excitons and photonic Dirac cones in the presence of both time-reversal and inversion symmetries. Lifting exciton valley degeneracy by breaking time-reversal symmetry leads to gapped polaritonic bands with non-zero Chern numbers. Through numerical simulations, we predict polaritonic chiral edge states residing inside the topological gaps. Our work paves the way to further explore polaritonic topological phases and their practical applications in polaritonic devices.


title: Wireless Picosecond Time Synchronization for Distributed Antenna Arrays

abstract: Distributed antenna arrays have been proposed for many applications ranging from space-based observatories to automated vehicles. Achieving good performance in distributed antenna systems requires stringent synchronization at the wavelength and information level to ensure that the transmitted signals arrive coherently at the target, or that scattered and received signals can be appropriately processed via distributed algorithms. In this paper we address the challenge of high precision time synchronization to align the operations of elements in a distributed antenna array and to overcome time-varying bias between platforms due to oscillator drift. We use a spectrally sparse two-tone waveform, which obtains approximately optimal time estimation accuracy, in a two-way time transfer process. We also describe a technique for determining the true time delay using the ambiguous two-tone matched filter output, and we compare the time synchronization precision of the two-tone waveform with the more common linear frequency modulation (LFM) waveform. We experimentally demonstrate wireless time synchronization using a single pulse 40$\,$MHz two-tone waveform over a 90$\,$cm 5.8$\,$GHz wireless link in a laboratory setting, obtaining a timing precision of 2.26$\,$ps.


title: Development of an interactive code for quick data analyses between STOR-M tokamak experimental plasma discharges

abstract: Saskatchewan Torus-Modified (STOR-M) is a small tokamak, well known for various fusion related basic experimental studies such as edge turbulent heating, different instabilities, AC (alternating current) tokamak operation, Ohmic H-mode triggering by the electrode biasing, fueling and momentum injection by Compact Torus (CT) injection, and effects of Resonance Magnetic Perturbations (RMP), among others. Some of those experiments require real time visualization of magnetic surface reconstructions either through EFIT or quick analyses and visualization of experimental data during experiments. Recently experimental studies of Geodesic Acoustic Mode (GAM) and zonal flows had been performed in STOR-M tokamak. The GAM experiments strongly require collection of fluctuations data from different Langmuir probes installed at different poloidal locations, but on the same magnetic surfaces. This is need of the adjustment of radial locations between discharges. It is therefore important to analyze and visualize the features of all probe data quickly during discharges. For this purpose, a Python code has been developed and used for quick analyze of data. This article will describe the development of the code using Python and its use in detail.


title: The Atari Disk, a Metal-Poor Stellar Population in the Disk System of the Milky Way

abstract: We have developed a chemo-dynamical approach to assign 36,010 metal-poor SkyMapper stars to various Galactic stellar populations. Using two independent techniques (velocity and action space behavior), $Gaia$ EDR3 astrometry, and photometric metallicities, we selected stars with the characteristics of the "metal-weak" thick disk population by minimizing contamination by the canonical thick disk or other Galactic structures. This sample comprises 7,127 stars, spans a metallicity range of $-3.50<${\metal}~$<-0.8$, and has a systematic rotational velocity of $\langle V_\phi\rangle=154$\,km\,s$^{-1}$ that lags that of the thick disk. Orbital eccentricities have intermediate values between typical thick disk and halo values. The scale length is $h_{R}=2.48^{+0.05}_{-0.05}$\,kpc and the scale height is $h_{Z}=1.68^{+0.19}_{-0.15}$\,kpc. The metallicity distribution function is well fit by an exponential with a slope of $\Delta\log{\rm N}/\Delta\metal=1.13\pm0.06$. Overall, we find a significant metal-poor component consisting of 261 SkyMapper stars with \metal$<-2.0$. While our sample contains only eleven stars with {\metal}~$\lesssim-3.0$, investigating the JINAbase compilation of metal-poor stars reveals another 18 such stars (five have {\metal}$<-4.0$) that kinematically belong to our sample. These distinct spatial, kinematic and chemical characteristics strongly suggest this metal-poor, phase-mixed kinematic sample to represent an independent disk component with an accretion origin in which a massive dwarf galaxy radially plunged into the early Galactic disk. Going forward, we propose to call the metal-weak thick disk population as the Atari disk, given its likely accretion origin, and in reference to it sharing space with the Galactic thin and thick disks.


title: TUSK: Task-Agnostic Unsupervised Keypoints

abstract: Existing unsupervised methods for keypoint learning rely heavily on the assumption that a specific keypoint type (e.g. elbow, digit, abstract geometric shape) appears only once in an image. This greatly limits their applicability, as each instance must be isolated before applying the method-an issue that is never discussed or evaluated. We thus propose a novel method to learn Task-agnostic, UnSupervised Keypoints (TUSK) which can deal with multiple instances. To achieve this, instead of the commonly-used strategy of detecting multiple heatmaps, each dedicated to a specific keypoint type, we use a single heatmap for detection, and enable unsupervised learning of keypoint types through clustering. Specifically, we encode semantics into the keypoints by teaching them to reconstruct images from a sparse set of keypoints and their descriptors, where the descriptors are forced to form distinct clusters in feature space around learned prototypes. This makes our approach amenable to a wider range of tasks than any previous unsupervised keypoint method: we show experiments on multiple-instance detection and classification, object discovery, and landmark detection-all unsupervised-with performance on par with the state of the art, while also being able to deal with multiple instances.


title: On Tournaments and Negative Dependence

abstract: Negative dependence of sequences of random variables is often an interesting characteristic of their distribution, as well as a useful tool for studying various asymptotic results, including central limit theorems, Poisson approximations, the rate of increase of the maximum, and more. In the study of probability models of tournaments, negative dependence of participants' outcomes arises naturally with application to various asymptotic results. In particular, the property of negative orthant dependence was proved in several articles for different tournament models, with a special proof for each model. In this note we unify these results by proving a stronger property, negative association, a generalization leading to a very simple proof. We also present a natural example of a knockout tournament where the scores are negatively orthant dependent but not negatively associated. The proof requires a new result on a preservation property of negative orthant dependence that is of independent interest.


title: Recursive Neural Programs: Variational Learning of Image Grammars and Part-Whole Hierarchies

abstract: Human vision involves parsing and representing objects and scenes using structured representations based on part-whole hierarchies. Computer vision and machine learning researchers have recently sought to emulate this capability using capsule networks, reference frames and active predictive coding, but a generative model formulation has been lacking. We introduce Recursive Neural Programs (RNPs), which, to our knowledge, is the first neural generative model to address the part-whole hierarchy learning problem. RNPs model images as hierarchical trees of probabilistic sensory-motor programs that recursively reuse learned sensory-motor primitives to model an image within different reference frames, forming recursive image grammars. We express RNPs as structured variational autoencoders (sVAEs) for inference and sampling, and demonstrate parts-based parsing, sampling and one-shot transfer learning for MNIST, Omniglot and Fashion-MNIST datasets, demonstrating the model's expressive power. Our results show that RNPs provide an intuitive and explainable way of composing objects and scenes, allowing rich compositionality and intuitive interpretations of objects in terms of part-whole hierarchies.


title: Estimating the lifetime risk of a false positive screening test result

abstract: False positive results in screening tests have potentially severe psychological, medical, and financial consequences for the recipient. However, there have been few efforts to quantify how the risk of a false positive accumulates over time. We seek to fill this gap by estimating the probability that an individual who adheres to the U.S. Preventive Services Task Force (USPSTF) screening guidelines will receive at least one false positive in a lifetime. To do so, we assembled a data set of 116 studies cited by the USPSTF that report the number of true positives, false negatives, true negatives, and false positives for the primary screening procedure for one of five cancers or six sexually transmitted diseases. We use these data to estimate the probability that an individual in one of 14 demographic subpopulations will receive at least one false positive for one of these eleven diseases in a lifetime. We specify a suitable statistical model to account for the hierarchical structure of the data, and we use the parametric bootstrap to quantify the uncertainty surrounding our estimates. The estimated probability of receiving at least one false positive in a lifetime is 85.5% ($\pm$0.9%) and 38.9% ($\pm$3.6%) for baseline groups of women and men, respectively. It is higher for subpopulations recommended to screen more frequently than the baseline, including more vulnerable groups such as pregnant women and men who have sex with men. Since screening technology is imperfect, false positives remain inevitable. The high lifetime risk of a false positive reveals the importance of educating patients about this phenomenon.


title: PRANC: Pseudo RAndom Networks for Compacting deep models

abstract: We demonstrate that a deep model can be reparametrized as a linear combination of several randomly initialized and frozen deep models in the weight space. During training, we seek local minima that reside within the subspace spanned by these random models (i.e., `basis' networks). Our framework, PRANC, enables significant compaction of a deep model. The model can be reconstructed using a single scalar `seed,' employed to generate the pseudo-random `basis' networks, together with the learned linear mixture coefficients. In practical applications, PRANC addresses the challenge of efficiently storing and communicating deep models, a common bottleneck in several scenarios, including multi-agent learning, continual learners, federated systems, and edge devices, among others. In this study, we employ PRANC to condense image classification models and compress images by compacting their associated implicit neural networks. PRANC outperforms baselines with a large margin on image classification when compressing a deep model almost $100$ times. Moreover, we show that PRANC enables memory-efficient inference by generating layer-wise weights on the fly. The source code of PRANC is here: \url{https://github.com/UCDvision/PRANC}


title: Variational Estimators of the Degree-corrected Latent Block Model for Bipartite Networks

abstract: Bipartite graphs are ubiquitous across various scientific and engineering fields. Simultaneously grouping the two types of nodes in a bipartite graph via biclustering represents a fundamental challenge in network analysis for such graphs. The latent block model (LBM) is a commonly used model-based tool for biclustering. However, the effectiveness of the LBM is often limited by the influence of row and column sums in the data matrix. To address this limitation, we introduce the degree-corrected latent block model (DC-LBM), which accounts for the varying degrees in row and column clusters, significantly enhancing performance on real-world data sets and simulated data. We develop an efficient variational expectation-maximization algorithm by creating closed-form solutions for parameter estimates in the M steps. Furthermore, we prove the label consistency and the rate of convergence of the variational estimator under the DC-LBM, allowing the expected graph density to approach zero as long as the average expected degrees of rows and columns approach infinity when the size of the graph increases.


title: Evolution of black holes through a nonsingular cosmological bounce

abstract: We study the classical dynamics of black holes during a nonsingular cosmological bounce. Taking a simple model of a nonsingular bouncing cosmology driven by the combination of a ghost and ordinary scalar field, we use nonlinear evolutions of the Einstein equations to follow rotating and non-rotating black holes of different sizes through the bounce. The violation of the null energy condition allows for a shrinking black hole event horizon and we find that for sufficiently large black holes (relative to the minimum Hubble radius) the black hole apparent horizon can disappear during the contraction phase. Despite this, we show that most of the local cosmological evolution remains largely unaffected by the presence of the black hole. We find that, independently of the black hole's initial mass, the black hole's event horizon persists throughout the bounce, and the late time dynamics consists of an expanding universe with a black hole of mass comparable to its initial value.


title: The Axiom of Choice and the No-Signaling Principle

abstract: We show that the axiom of choice, a basic yet controversial postulate of set theory, leads to revise the standard understanding of one of the pillars of our best physical theories, namely the no-signaling principle. While it is well known that probabilistic no-signaling resources (such as quantum non-locality) are stronger than deterministic ones, we show-by invoking the axiom of choice-the opposite: Functional (deterministic) no-signaling resources can be stronger than probabilistic ones. To prove this, we devise a Bell-like game that shows a systematic advantage of functional no-signaling with respect to any probabilistic no-signaling resource.


title: Belief-Desire-Intention (BDI) Multi-agent System for Cloud Marketplace Negotiation

abstract: With the evolution of cloud computing, there has been a rise of large enterprises extending their infrastructure and workloads into the public cloud. This paper proposes a full-fledged framework for a Belief-Desire-Intention (BDI) multi-agent-based cloud marketplace system for cloud resources. Each party in the cloud marketplace system supports a BDI agent for autonomous decision making and negotiation to facilitate automated buying and selling of resources. Additionally, multiple BDI agents from an enterprise competing for the same cloud resource can consult with each other via Master Negotiation Clearing House to minimize the overall cost function for the enterprise while negotiating for a cloud resource. The cloud marketplace system is further augmented with assignments of behavior norm and reputation index to the agents to facilitate trust among them.


title: Rapidly rotating neutron stars in $f(R,T)$ gravity

abstract: In this work, we study the influence of $f(R,T)$ gravity on rapidly rotating neutron stars. First we discuss the main aspects of this modified theory of gravity where the gravitational Lagrangian is an arbitrary function of the Ricci scalar $R$ and of the trace of the energy-momentum tensor $T$. Then we present the basic equations for neutron stars including the equations of state used in the present work to describe the hadronic matter. Some physical quantities of interest are calculated such as mass-radius relations, moments of inertia, angular momentum, and compactness. By considering four different rotation regimes, we obtain results that indicate substantial modifications in the physical properties of neutron stars in $f(R,T)$ gravity when compared to those in the context of general relativity. In particular, the mass-radius relation for sequences of stars indicates that $f(R,T)$ gravity increases the mass and the equatorial radius of the neutron stars for stars rotating with an angular velocity smaller than Kepler limit.


title: Non-Perturbative Groundstate of High Temperature Yang-Mills Theory

abstract: The effective potential of Yang-Mills theory at high temperature derived by Gross, Pisarski, Yaffe and Weiss is critically reexamined and it is argued that the groundstate of the potential at <A0>=0 is invalid, due to the infrared divergence of the Matsubara zero mode. This suggests that the thermal groundstate is dominated by infrared non-perturbative effects. Lattice simulations are carried out and the field A0 in the static gauge is observed to acquire nonzero, non-perturbative expectation values at high temperatures. A consequence is that thermal perturbation theory is inconsistent with the non-perturbative groundstate and it cannot account for all of the contributions to a thermodynamic quantity at any temperature. Related issues, including dimensional reduction and confinement, are also discussed.


title: Gate-tunable Superconducting Diode Effect in a Three-terminal Josephson Device

abstract: The phenomenon of non-reciprocal critical current in a Josephson device, termed the Josephson diode effect, has garnered much recent interest. Realization of the diode effect requires inversion symmetry breaking, typically obtained by spin-orbit interactions. Here we report observation of the Josephson diode effect in a three-terminal Josephson device based upon an InAs quantum well two-dimensional electron gas proximitized by an epitaxial aluminum superconducting layer. We demonstrate that the diode efficiency in our devices can be tuned by a small out-of-plane magnetic field or by electrostatic gating. We show that the Josephson diode effect in these devices is a consequence of the artificial realization of a current-phase relation that contains higher harmonics. We also show nonlinear DC intermodulation and simultaneous two-signal rectification, enabled by the multi-terminal nature of the devices. Furthermore, we show that the diode effect is an inherent property of multi-terminal Josephson devices, establishing an immediately scalable approach by which potential applications of the Josephson diode effect can be realized, agnostic to the underlying material platform. These Josephson devices may also serve as gate-tunable building blocks in designing topologically protected qubits.


title: Combined Plant and Controller Optimization of an Underwater Energy Harvesting Kite System

abstract: This paper presents the formulation and results for a control-aware optimization of the combined geometric and structural design of an energy-harvesting underwater kite. Because kite-based energy-harvesting systems, both airborne and underwater, possess strong coupling between closed-loop flight control, geometric design, and structural design, consideration of all three facets of the design within a single co-design framework is highly desirable. However, while prior literature has addressed one or two attributes of the design at a time, the present work constitutes the first comprehensive effort aimed at addressing all three. In particular, focusing on the goals of power maximization and mass minimization, we present a co-design formulation that fuses a geometric optimization tool, structural optimization tool, and closed-loop flight efficiency map. The resulting integrated co-design tool is used to address two mathematical optimization formulations that exhibit subtle differences: a Pareto optimal formulation and a dual-objective formulation that focuses on a weighted power-to-mass ratio as the techno-economic metric of merit. Based on the resulting geometric and structural designs, using a medium-fidelity closed-loop simulation tool, the proposed formulation is shown to achieve more than three times the power-to-mass ratio of a previously published, un-optimized benchmark design.


title: A Robust Stacking Framework for Training Deep Graph Models with Multifaceted Node Features

abstract: Graph Neural Networks (GNNs) with numerical node features and graph structure as inputs have demonstrated superior performance on various supervised learning tasks with graph data. However the numerical node features utilized by GNNs are commonly extracted from raw data which is of text or tabular (numeric/categorical) type in most real-world applications. The best models for such data types in most standard supervised learning settings with IID (non-graph) data are not simple neural network layers and thus are not easily incorporated into a GNN. Here we propose a robust stacking framework that fuses graph-aware propagation with arbitrary models intended for IID data, which are ensembled and stacked in multiple layers. Our layer-wise framework leverages bagging and stacking strategies to enjoy strong generalization, in a manner which effectively mitigates label leakage and overfitting. Across a variety of graph datasets with tabular/text node features, our method achieves comparable or superior performance relative to both tabular/text and graph neural network models, as well as existing state-of-the-art hybrid strategies that combine the two.


title: XLCoST: A Benchmark Dataset for Cross-lingual Code Intelligence

abstract: Recent advances in machine learning have significantly improved the understanding of source code data and achieved good performance on a number of downstream tasks. Open source repositories like GitHub enable this process with rich unlabeled code data. However, the lack of high quality labeled data has largely hindered the progress of several code related tasks, such as program translation, summarization, synthesis, and code search. This paper introduces XLCoST, Cross-Lingual Code SnippeT dataset, a new benchmark dataset for cross-lingual code intelligence. Our dataset contains fine-grained parallel data from 8 languages (7 commonly used programming languages and English), and supports 10 cross-lingual code tasks. To the best of our knowledge, it is the largest parallel dataset for source code both in terms of size and the number of languages. We also provide the performance of several state-of-the-art baseline models for each task. We believe this new dataset can be a valuable asset for the research community and facilitate the development and validation of new methods for cross-lingual code intelligence.


title: Exploring Jupiter's Polar Deformation Lengths with High Resolution Shallow Water Modeling

abstract: The polar regions of Jupiter host a myriad of dynamically interesting phenomena including vortex configurations, folded-filamentary regions (FFRs), and chaotic flows. Juno observations have provided unprecedented views of the high latitudes, allowing for more constraints to be placed upon the troposphere and the overall atmospheric energy cycle. Moist convective events are believed to be the primary drivers of energetic storm behavior as observed on the planet. Here, we introduce a novel single layer shallow water model to investigate the effects of polar moist convective events at high resolution, the presence of dynamical instabilities over long timescales, and the emergence of FFRs at high latitudes. We use a flexible, highly parallelizable, finite-difference hydrodynamic code to explore the parameter space set up by previous models. We study the long term effects of deformation length (Ld), injected pulse size, and injected geopotential. We find that models with Ld beyond 1500 km (planetary Burger number, Bu$=4.4\times10^{-4}$) tend to homogenize their potential vorticity (PV) in the form of dominant stable polar cyclones, while lower Ld cases tend to show less stability with regards to Arnol'd-type flows. We also find that large turbulent forcing scales consistently lead to the formation of high latitude FFRs. Our findings support the idea that moist convection, occurring at high latitudes, may be sufficient to produce the dynamical variety seen at the Jovian poles. Additionally, derived values of localized horizontal shear and Ld may constrain FFR formation and evolution.


title: Zero-Shot AutoML with Pretrained Models

abstract: Given a new dataset D and a low compute budget, how should we choose a pre-trained model to fine-tune to D, and set the fine-tuning hyperparameters without risking overfitting, particularly if D is small? Here, we extend automated machine learning (AutoML) to best make these choices. Our domain-independent meta-learning approach learns a zero-shot surrogate model which, at test time, allows to select the right deep learning (DL) pipeline (including the pre-trained model and fine-tuning hyperparameters) for a new dataset D given only trivial meta-features describing D such as image resolution or the number of classes. To train this zero-shot model, we collect performance data for many DL pipelines on a large collection of datasets and meta-train on this data to minimize a pairwise ranking objective. We evaluate our approach under the strict time limit of the vision track of the ChaLearn AutoDL challenge benchmark, clearly outperforming all challenge contenders.


title: Backdoor Attacks on Vision Transformers

abstract: Vision Transformers (ViT) have recently demonstrated exemplary performance on a variety of vision tasks and are being used as an alternative to CNNs. Their design is based on a self-attention mechanism that processes images as a sequence of patches, which is quite different compared to CNNs. Hence it is interesting to study if ViTs are vulnerable to backdoor attacks. Backdoor attacks happen when an attacker poisons a small part of the training data for malicious purposes. The model performance is good on clean test images, but the attacker can manipulate the decision of the model by showing the trigger at test time. To the best of our knowledge, we are the first to show that ViTs are vulnerable to backdoor attacks. We also find an intriguing difference between ViTs and CNNs - interpretation algorithms effectively highlight the trigger on test images for ViTs but not for CNNs. Based on this observation, we propose a test-time image blocking defense for ViTs which reduces the attack success rate by a large margin. Code is available here: https://github.com/UCDvision/backdoor_transformer.git


title: Classification of datasets with imputed missing values: does imputation quality matter?

abstract: Classifying samples in incomplete datasets is a common aim for machine learning practitioners, but is non-trivial. Missing data is found in most real-world datasets and these missing values are typically imputed using established methods, followed by classification of the now complete, imputed, samples. The focus of the machine learning researcher is then to optimise the downstream classification performance. In this study, we highlight that it is imperative to consider the quality of the imputation. We demonstrate how the commonly used measures for assessing quality are flawed and propose a new class of discrepancy scores which focus on how well the method recreates the overall distribution of the data. To conclude, we highlight the compromised interpretability of classifier models trained using poorly imputed data.


title: Modifying the Asynchronous Jacobi Method for Data Corruption Resilience

abstract: Moving scientific computation from high-performance computing (HPC) and cloud computing (CC) environments to devices on the edge, i.e., physically near instruments of interest, has received tremendous interest in recent years. Such edge computing environments can operate on data in-situ, offering enticing benefits over data aggregation to HPC and CC facilities that include avoiding costs of transmission, increased data privacy, and real-time data analysis. Because of the inherent unreliability of edge computing environments, new fault tolerant approaches must be developed before the benefits of edge computing can be realized. Motivated by algorithm-based fault tolerance, a variant of the asynchronous Jacobi (ASJ) method is developed that achieves resilience to data corruption by rejecting solution approximations from neighbor devices according to a bound derived from convergence theory. Numerical results on a two-dimensional Poisson problem show the new rejection criterion, along with a novel approximation to the shortest path length on which the criterion depends, restores convergence for the ASJ variant in the presence of certain types data corruption. Numerical results are obtained for when the singular values in the analytic bound are approximated. A linear system with a more dense sparsity pattern is also explored. All results indicate that successful resilience to data corruption depends on whether the bound tightens fast enough to reject corrupted data before the iteration evolution deviates significantly from that predicted by the convergence theory defining the bound. This observation generalizes to future work on algorithm-based fault tolerance for other asynchronous algorithms, including upcoming approaches that leverage Krylov subspaces.


title: Polarization and variability of compact sources measured in Planck time-ordered data

abstract: This paper introduces a new Planck Catalog of Polarized and Variable Compact Sources (PCCS-PV) comprising 153 sources, the majority of which are extragalactic. The data include both the total flux density and linear polarization measured by Planck with frequency coverage from 30 to 353 GHz, and temporal spacing ranging from days to years. We classify most sources as beamed, extragalactic radio sources; the catalog also includes several radio galaxies, Seyfert galaxies, and Galactic and Magellanic Cloud sources, including H IIi regions and planetary nebulae. An advanced extraction method applied directly to the multifrequency Planck time-ordered data, rather than the mission sky maps, was developed to allow an assessment of the variability of polarized sources. Our analysis of the time-ordered data from the Planck mission, tod2flux, allowed us to catalog the time-varying emission and polarization properties for these sources at the full range of polarized frequencies employed by Planck, 30 to 353 GHz. PCCS-PV provides the time- and frequency-dependent, polarized flux densities for all 153 sources. To illustrate some potential applications of the PCCS- PV, we conducted preliminary comparisons of our measurements of selected sources with published data from other astronomical instruments. In summary, we find general agreement between the Planck and the Institut de Radioastronomie Millim\'etrique (IRAM) polarization measurements as well as with the Mets\"ahovi 37 GHz values at closely similar epochs. These combined measurements also show the value of PCCS-PV results and the PCCS2 catalog for filling in missing spectral (or temporal) coverage and helping to define the spectral energy distributions of extragalactic sources. In turn, these results provide useful clues as to the physical properties of the sources.


title: Orientation-guided Graph Convolutional Network for Bone Surface Segmentation

abstract: Due to imaging artifacts and low signal-to-noise ratio in ultrasound images, automatic bone surface segmentation networks often produce fragmented predictions that can hinder the success of ultrasound-guided computer-assisted surgical procedures. Existing pixel-wise predictions often fail to capture the accurate topology of bone tissues due to a lack of supervision to enforce connectivity. In this work, we propose an orientation-guided graph convolutional network to improve connectivity while segmenting the bone surface. We also propose an additional supervision on the orientation of the bone surface to further impose connectivity. We validated our approach on 1042 vivo US scans of femur, knee, spine, and distal radius. Our approach improves over the state-of-the-art methods by 5.01% in connectivity metric.


title: GMI-DRL: Empowering Multi-GPU Deep Reinforcement Learning with GPU Spatial Multiplexing

abstract: With the increasing popularity of robotics in industrial control and autonomous driving, deep reinforcement learning (DRL) raises the attention of various fields. However, DRL computation on the modern powerful GPU platform is still inefficient due to its heterogeneous workloads and interleaved execution paradigm. To this end, we propose GMI-DRL, a systematic design to accelerate multi-GPU DRL via GPU spatial multiplexing. We introduce a novel design of resource-adjustable GPU multiplexing instances (GMIs) to match the actual needs of DRL tasks, an adaptive GMI management strategy to simultaneously achieve high GPU utilization and computation throughput, and a highly efficient inter-GMI communication support to meet the demands of various DRL communication patterns. Comprehensive experiments reveal that GMI-DRL outperforms state-of-the-art NVIDIA Isaac Gym with NCCL (up to 2.81X) and Horovod (up to 2.34X) support in training throughput on the latest DGX-A100 platform. Our work provides an initial user experience with GPU spatial multiplexing in processing heterogeneous workloads with a mixture of computation and communication.


title: Nonresonant scattering of relativistic electrons by electromagnetic ion cyclotron waves in Earth's radiation belts

abstract: Electromagnetic ion cyclotron waves are expected to pitch-angle scatter and cause atmospheric precipitation of relativistic ($> 1$ MeV) electrons under typical conditions in Earth's radiation belts. However, it has been a longstanding mystery how relativistic electrons in the hundreds of keV range (but $<1$ MeV), which are not resonant with these waves, precipitate simultaneously with those $>1$ MeV. We demonstrate that, when the wave packets are short, nonresonant interactions enable such scattering of $100$s of keV electrons by introducing a spread in wavenumber space. We generalize the quasi-linear diffusion model to include nonresonant effects. The resultant model exhibits an exponential decay of the scattering rates extending below the minimum resonant energy depending on the shortness of the wave packets. This generalized model naturally explains observed nonresonant electron precipitation in the hundreds of keV concurrent with $>1$ MeV precipitation.


title: Magic square and three-zero textures for Dirac neutrinos

abstract: We show a matrix decomposition of flavor mass matrix for Dirac neutrinos $M$ by sum as $M=M'+M^0$ where $M'$ obeys the feature of the magic square and $M^0$ is three-zero texture. The favorable three-zero textures in the context of magic square are explored. It turned out that so-called the normal ordering of neutrino masses is favored over the inverted ordering in the context of magic square.


title: Modeling Gender Differences in Membership Change in Open Source Software Projects

abstract: Gender diversity in open source software development continues to be a topic of growing interest among researchers, practitioners, and organizations. To date, research has revealed disparities in participation between developers on the basis of gender, with women being significantly underrepresented in open source development. Using a large data set curated for studies of diversity in open source projects, we contribute to this body of work by characterizing the relationship between gender-based participation differences and group composition in GitHub. We found that contributors identified as women and contributors of unknown gender have a shorter tenure in open source projects compared to those identified as men. Additionally, at the team level, we found that project teams with mixed-gender composition were associated with lower turnover and teams with greater disparity in the distribution of platform tenure were associated with higher turnover. Finally, our case study reveals that when looking at the entire team, GitHub users were more likely to remain in a project rather than leave after contributing but when looking at women specifically, users were more likely to leave rather than remain after contributing to a project.


title: Interpretable AMR-Based Question Decomposition for Multi-hop Question Answering

abstract: Effective multi-hop question answering (QA) requires reasoning over multiple scattered paragraphs and providing explanations for answers. Most existing approaches cannot provide an interpretable reasoning process to illustrate how these models arrive at an answer. In this paper, we propose a Question Decomposition method based on Abstract Meaning Representation (QDAMR) for multi-hop QA, which achieves interpretable reasoning by decomposing a multi-hop question into simpler sub-questions and answering them in order. Since annotating the decomposition is expensive, we first delegate the complexity of understanding the multi-hop question to an AMR parser. We then achieve the decomposition of a multi-hop question via segmentation of the corresponding AMR graph based on the required reasoning type. Finally, we generate sub-questions using an AMR-to-Text generation model and answer them with an off-the-shelf QA model. Experimental results on HotpotQA demonstrate that our approach is competitive for interpretable reasoning and that the sub-questions generated by QDAMR are well-formed, outperforming existing question-decomposition-based multi-hop QA approaches.


title: High-Speed Accurate Robot Control using Learned Forward Kinodynamics and Non-linear Least Squares Optimization

abstract: Accurate control of robots at high speeds requires a control system that can take into account the kinodynamic interactions of the robot with the environment. Prior works on learning inverse kinodynamic (IKD) models of robots have shown success in capturing the complex kinodynamic effects. However, the types of control problems these approaches can be applied to are limited only to that of following pre-computed kinodynamically feasible trajectories. In this paper we present Optim-FKD, a new formulation for accurate, high-speed robot control that makes use of a learned forward kinodynamic (FKD) model and non-linear least squares optimization. Optim-FKD can be used for accurate, high speed control on any control task specifiable by a non-linear least squares objective. Optim-FKD can solve for control objectives such as path following and time-optimal control in real time, without needing access to pre-computed kinodynamically feasible trajectories. We empirically demonstrate these abilities of our approach through experiments on a scale one-tenth autonomous car. Our results show that Optim-FKD can follow desired trajectories more accurately and can find better solutions to optimal control problems than baseline approaches.


title: Controllable Image Enhancement

abstract: Editing flat-looking images into stunning photographs requires skill and time. Automated image enhancement algorithms have attracted increased interest by generating high-quality images without user interaction. However, the quality assessment of a photograph is subjective. Even in tone and color adjustments, a single photograph of auto-enhancement is challenging to fit user preferences which are subtle and even changeable. To address this problem, we present a semiautomatic image enhancement algorithm that can generate high-quality images with multiple styles by controlling a few parameters. We first disentangle photo retouching skills from high-quality images and build an efficient enhancement system for each skill. Specifically, an encoder-decoder framework encodes the retouching skills into latent codes and decodes them into the parameters of image signal processing (ISP) functions. The ISP functions are computationally efficient and consist of only 19 parameters. Despite our approach requiring multiple inferences to obtain the desired result, experimental results present that the proposed method achieves state-of-the-art performances on the benchmark dataset for image quality and model efficiency.


title: Debugging using Orthogonal Gradient Descent

abstract: In this report we consider the following problem: Given a trained model that is partially faulty, can we correct its behaviour without having to train the model from scratch? In other words, can we ``debug" neural networks similar to how we address bugs in our mathematical models and standard computer code. We base our approach on the hypothesis that debugging can be treated as a two-task continual learning problem. In particular, we employ a modified version of a continual learning algorithm called Orthogonal Gradient Descent (OGD) to demonstrate, via two simple experiments on the MNIST dataset, that we can in-fact \textit{unlearn} the undesirable behaviour while retaining the general performance of the model, and we can additionally \textit{relearn} the appropriate behaviour, both without having to train the model from scratch.