title: TRiPOD: Human Trajectory and Pose Dynamics Forecasting in the Wild

abstract: Joint forecasting of human trajectory and pose dynamics is a fundamental building block of various applications ranging from robotics and autonomous driving to surveillance systems. Predicting body dynamics requires capturing subtle information embedded in the humans' interactions with each other and with the objects present in the scene. In this paper, we propose a novel TRajectory and POse Dynamics (nicknamed TRiPOD) method based on graph attentional networks to model the human-human and human-object interactions both in the input space and the output space (decoded future output). The model is supplemented by a message passing interface over the graphs to fuse these different levels of interactions efficiently. Furthermore, to incorporate a real-world challenge, we propound to learn an indicator representing whether an estimated body joint is visible/invisible at each frame, e.g. due to occlusion or being outside the sensor field of view. Finally, we introduce a new benchmark for this joint task based on two challenging datasets (PoseTrack and 3DPW) and propose evaluation metrics to measure the effectiveness of predictions in the global space, even when there are invisible cases of joints. Our evaluation shows that TRiPOD outperforms all prior work and state-of-the-art specifically designed for each of the trajectory and pose forecasting tasks.


title: A Mixed-method Study on Security and Privacy Practices in Danish Companies

abstract: Increased levels of digitalization in society expose companies to new security threats, requiring them to establish adequate security and privacy measures. Additionally, the presence of exogenous forces like new regulations, e.g., GDPR and the global COVID-19 pandemic, pose new challenges for companies that should preserve an adequate level of security while having to adapt to change. In this paper, we investigate such challenges through a two-phase study in companies located in Denmark -- a country characterized by a high level of digitalization and trust -- focusing on software development and tech-related companies. Our results show a number of issues, most notably i) a misalignment between software developers and management when it comes to the implementation of security and privacy measures, ii) difficulties in adapting company practices in light of implementing GDPR compliance, and iii) different views on the need to adapt security measures to cope with the COVID-19 pandemic.


title: Optical Absorption and Photocurrent Spectroscopy for Investigating Important Length Scales in Molecular Electronics

abstract: We report the optical absorption characteristics and the photocurrent spectra for large-area molecular junctions containing different molecular structures and thicknesses. Through experimental assessment of the optical absorption of molecules in solution and chemisorbed onto transparent, conductive carbon films, the energy ranges and intensity of absorption for a variety of molecular layers as a function of thickness were determined. Our findings show that optical absorption is red-shifted for a chemisorbed molecular layer relative to the molecule in solution, indicating electronic coupling between the molecule and the surface. However, we also find that from 2-22 nm in thickness, the absorption characteristics follow Beers law, with no further shifts in the wavelength of maximum absorption or low-energy absorption onset. For energies where no absorption occurs, an internal photoemission process takes place resulting in photocurrent that can be sustained over a limited range. For energies at which the molecular component absorbs light, photocurrent can proceed over longer distances, and the trends in photocurrent yield versus thickness shows interesting trends that may be related to the distance scale over which charge carriers can communicate with the conductive contacts. This method is particularly relevant for strongly coupled systems that rely on molecular properties to mediate charge transport, since excitation takes place directly within the molecular layer, and provides a direct probe of energetics in systems that show bulk-limited transport.


title: 2D IR spectroscopy of catalytic monolayers

abstract: Two dimensional spectroscopy is a powerful dynamical study method that has been developed in the last two decades. In 2D IR there are three experimental time periods during which the system vibrational modes of interest are excited, evolved to different frequencies and finally emit a non linear signal that is heterodyne detected by temporal and spatial overlapping with a local oscillator. With this approach we are able to determine vibrational coupling, mode anharmonicities and relative orientation of transition dipole moments which help us to obtain the structural kinetics and molecular dynamics of the system.We can study interaction between functional groups which can be indicators of bond formation or dissociation using 2D IR.[3] In this work we aim to use 2D IR to compare the molecular dynamic in a monolayer interface of an immobilized catalyst in the presence and absence of solvent. Homogenous catalysts have the advantage of higher interaction with the reactants and thus showing high efficiency. However, because of difficulties in separation of such catalysts from the products and non-reusability, immobilization of homogeneous catalysts has been considered. Although immobilization decreases the expenses of separation and purifying the products which is especially important in pharmaceutical industries, it does not always maintain the high activity of the homogeneous catalysts. Solvent addition to immobilized catalysts can affect its efficiency because of changing the molecular dynamic of the system.[4] 2D IR approach help us to understand the structural evolution rate of such systems through spectral diffusion analysis and vibrational relaxation lifetime.


title: A Hierarchical Bayesian Model for Stochastic Spatiotemporal SIR Modeling and Prediction of COVID-19 Cases and Hospitalizations

abstract: Most COVID-19 predictive modeling efforts use statistical or mathematical models to predict national- and state-level COVID-19 cases or deaths in the future. These approaches assume parameters such as reproduction time, test positivity rate, hospitalization rate, and social intervention effectiveness (masking, distancing, and mobility) are constant. However, the one certainty with the COVID-19 pandemic is that these parameters change over time, as well as vary across counties and states. In fact, the rate of spread over region, hospitalization rate, hospital length of stay and mortality rate, the proportion of the population that is susceptible, test positivity rate, and social behaviors can all change significantly over time. Thus, the quantification of uncertainty becomes critical in making meaningful and accurate forecasts of the future. Bayesian approaches are a natural way to fully represent this uncertainty in mathematical models and have become particularly popular in physics and engineering models. The explicit integration time varying parameters and uncertainty quantification into a hierarchical Bayesian forecast model differentiates the Mayo COVID-19 model from other forecasting models. By accounting for all sources of uncertainty in both parameter estimation as well as future trends with a Bayesian approach, the Mayo COVID-19 model accurately forecasts future cases and hospitalizations, as well as the degree of uncertainty. This approach has been remarkably accurate and a linchpin in Mayo Clinic's response to managing the COVID-19 pandemic. The model accurately predicted timing and extent of the summer and fall surges at Mayo Clinic sites, allowing hospital leadership to manage resources effectively to provide a successful pandemic response. This model has also proven to be very useful to the state of Minnesota to help guide difficult policy decisions.


title: Results and Insights from Diagnostic Questions: The NeurIPS 2020 Education Challenge

abstract: This competition concerns educational diagnostic questions, which are pedagogically effective, multiple-choice questions (MCQs) whose distractors embody misconceptions. With a large and ever-increasing number of such questions, it becomes overwhelming for teachers to know which questions are the best ones to use for their students. We thus seek to answer the following question: how can we use data on hundreds of millions of answers to MCQs to drive automatic personalized learning in large-scale learning scenarios where manual personalization is infeasible? Success in using MCQ data at scale helps build more intelligent, personalized learning platforms that ultimately improve the quality of education en masse. To this end, we introduce a new, large-scale, real-world dataset and formulate 4 data mining tasks on MCQs that mimic real learning scenarios and target various aspects of the above question in a competition setting at NeurIPS 2020. We report on our NeurIPS competition in which nearly 400 teams submitted approximately 4000 submissions, with encouragingly diverse and effective approaches to each of our tasks.


title: Fast optimization of viscosities for frequency-weighted damping of second-order systems

abstract: We consider frequency-weighted damping optimization for vibrating systems described by a second-order differential equation. The goal is to determine viscosity values such that eigenvalues are kept away from certain undesirable areas on the imaginary axis. To this end, we present two complementary techniques. First, we propose new frameworks using nonsmooth constrained optimization problems, whose solutions both damp undesirable frequency bands and maintain stability of the system. These frameworks also allow us to weight which frequency bands are the most important to damp. Second, we also propose a fast new eigensolver for the structured quadratic eigenvalue problems that appear in such vibrating systems. In order to be efficient, our new eigensolver exploits special properties of diagonal-plus-rank-one complex symmetric matrices, which we leverage by showing how each quadratic eigenvalue problem can be transformed into a short sequence of such linear eigenvalue problems. The result is an eigensolver that is substantially faster than standard techniques. By combining this new solver with our new optimization frameworks, we obtain our overall algorithm for fast computation of optimal viscosities. The efficiency and performance of our new methods are verified and illustrated on several numerical examples.


title: Optimal Market Making by Reinforcement Learning

abstract: We apply Reinforcement Learning algorithms to solve the classic quantitative finance Market Making problem, in which an agent provides liquidity to the market by placing buy and sell orders while maximizing a utility function. The optimal agent has to find a delicate balance between the price risk of her inventory and the profits obtained by capturing the bid-ask spread. We design an environment with a reward function that determines an order relation between policies equivalent to the original utility function. When comparing our agents with the optimal solution and a benchmark symmetric agent, we find that the Deep Q-Learning algorithm manages to recover the optimal agent.


title: Computing the sequence of $k$-cardinality assignments

abstract: The $k$-cardinality assignment problem asks for finding a maximal (minimal) weight of a matching of cardinality $k$ in a weighted bipartite graph $K_{n,n}$, $k \leq n$. The algorithm of Gassner and Klinz from 2010 for the parametric assignment problem computes in time $O(n^3)$ the set of $k$-cardinality assignments for those integers $k \leq n$ which refer to "essential" terms of a corresponding maxpolynomial. We show here that one can extend this algorithm and compute in a second stage the other "semi-essential" terms in time $O(n^2)$, which results in a time complexity of $O(n^3)$ for the whole sequence of $k=1,...,n$-cardinality assignments. The more there are assignments left to be computed at the second stage the faster the two-stage algorithm runs. In general, however, there is no benefit for this two-stage algorithm on the existing algorithms, e.g. the simpler network flow algorithm based on the successive shortest path algorithm which also computes all the $k$-cardinality assignments in time $O(n^3)$.


title: Equivalence of Milnor and Milnor-L\^e fibrations for real analytic maps

abstract: In [22] Milnor proved that a real analytic map $f\colon (R^n,0) \to (R^p,0)$, where $n \geq p$, with an isolated critical point at the origin has a fibration on the tube $f|\colon B_\epsilon^n \cap f^{-1}(S_\delta^{p-1}) \to S_\delta^{p-1}$. Constructing a vector field such that, (1) it is transverse to the spheres, and (2) it is transverse to the tubes, he "inflates" the tube to the sphere, to get a fibration $\varphi\colon S_\epsilon^{n-1} \setminus f^{-1}(0) \to S^{p-1}$, but the projection is not necessarily given by $f/ \|f\|$ as in the complex case. In the case $f$ has isolated critical value, in [9] it was proved that if the fibres inside a small tube are transverse to the sphere $S_\epsilon$, then it has a fibration on the tube. Also in [9], the concept of $d$-regularity was defined, it turns out that $f$ is $d$-regular if and only if the map $f/|f\|\colon S_\epsilon^{n-1} \setminus f^{-1}(0) \to S^{p-1}$ is a fibre bundle equivalent to the one on the tube. In this article, we prove the corresponding facts in a more general setting: if a locally surjective map $f$ has a linear discriminant $\Delta$ and a fibration on the tube $f|\colon B_\epsilon^n \cap f^{-1}(S_\delta^{p-1} \setminus \Delta) \to S_\delta^{p-1} \setminus \Delta$, then $f$ is $d$-regular if and only if the map $f/ \|f\|\colon S_\epsilon^{n-1} \setminus f^{-1}(\Delta) \to S^{p-1} \setminus \mathcal{A}$ (with $\mathcal{A}$ the radial projection of $\Delta$ on $S^{p-1}$) is a fibre bundle equivalent to the one on the tube. We do this by constructing a vector field $\tilde{w}$ which inflates the tube to the sphere in a controlled way, it satisfies properties analogous to the vector field constructed by Milnor in the complex setting: besides satisfying (1) and (2) above, it also satisfies that $f/ \|f\|$ is constant on the integral curves of $\tilde{w}$.


title: Plug-and-Blend: A Framework for Controllable Story Generation with Blended Control Codes

abstract: Large pre-trained neural language models (LM) have very powerful text generation capabilities. However, in practice, they are hard to control for creative purposes. We describe a Plug-and-Play controllable language generation framework, Plug-and-Blend, that allows a human user to input multiple control codes (topics). In the context of automated story generation, this allows a human user loose or fine-grained control of the topics and transitions between them that will appear in the generated story, and can even allow for overlapping, blended topics. Automated evaluations show our framework, working with different generative LMs, controls the generation towards given continuous-weighted control codes while keeping the generated sentences fluent, demonstrating strong blending capability. A human participant evaluation shows that the generated stories are observably transitioning between two topics.


title: Scaling up graph homomorphism for classification via sampling

abstract: Feature generation is an open topic of investigation in graph machine learning. In this paper, we study the use of graph homomorphism density features as a scalable alternative to homomorphism numbers which retain similar theoretical properties and ability to take into account inductive bias. For this, we propose a high-performance implementation of a simple sampling algorithm which computes additive approximations of homomorphism densities. In the context of graph machine learning, we demonstrate in experiments that simple linear models trained on sample homomorphism densities can achieve performance comparable to graph neural networks on standard graph classification datasets. Finally, we show in experiments on synthetic data that this algorithm scales to very large graphs when implemented with Bloom filters.


title: CLVSA: A Convolutional LSTM Based Variational Sequence-to-Sequence Model with Attention for Predicting Trends of Financial Markets

abstract: Financial markets are a complex dynamical system. The complexity comes from the interaction between a market and its participants, in other words, the integrated outcome of activities of the entire participants determines the markets trend, while the markets trend affects activities of participants. These interwoven interactions make financial markets keep evolving. Inspired by stochastic recurrent models that successfully capture variability observed in natural sequential data such as speech and video, we propose CLVSA, a hybrid model that consists of stochastic recurrent networks, the sequence-to-sequence architecture, the self- and inter-attention mechanism, and convolutional LSTM units to capture variationally underlying features in raw financial trading data. Our model outperforms basic models, such as convolutional neural network, vanilla LSTM network, and sequence-to-sequence model with attention, based on backtesting results of six futures from January 2010 to December 2017. Our experimental results show that, by introducing an approximate posterior, CLVSA takes advantage of an extra regularizer based on the Kullback-Leibler divergence to prevent itself from overfitting traps.


title: What are Table Cartograms Good for Anyway? An Algebraic Analysis

abstract: Unfamiliar or esoteric visual forms arise in many areas of visualization. While such forms can be intriguing, it can be unclear how to make effective use of them without long periods of practice or costly user studies. In this work we analyze the table cartogram-a graphic which visualizes tabular data by bringing the areas of a grid of quadrilaterals into correspondence with the input data, like a heat map that has been "area-ed" rather than colored. Despite having existed for several years, little is known about its appropriate usage. We mend this gap by using Algebraic Visualization Design to show that they are best suited to relatively small tables with ordinal axes for some comparison and outlier identification tasks. In doing so we demonstrate a discount theory-based analysis that can be used to cheaply determine best practices for unknown visualizations.


title: RLIBM-32: High Performance Correctly Rounded Math Libraries for 32-bit Floating Point Representations

abstract: This paper proposes a set of techniques to develop correctly rounded math libraries for 32-bit float and posit types. It enhances our RLibm approach that frames the problem of generating correctly rounded libraries as a linear programming problem in the context of 16-bit types to scale to 32-bit types. Specifically, this paper proposes new algorithms to (1) generate polynomials that produce correctly rounded outputs for all inputs using counterexample guided polynomial generation, (2) generate efficient piecewise polynomials with bit-pattern based domain splitting, and (3) deduce the amount of freedom available to produce correct results when range reduction involves multiple elementary functions. The resultant math library for the 32-bit float type is faster than state-of-the-art math libraries while producing the correct output for all inputs. We have also developed a set of correctly rounded elementary functions for 32-bit posits.


title: Spatio-Temporal Differential Dynamic Programming for Control of Fields

abstract: We consider the optimal control problem of a general nonlinear spatio-temporal system described by Partial Differential Equations (PDEs). Theory and algorithms for control of spatio-temporal systems are of rising interest among the automatic control community and exhibit numerous challenging characteristic from a control standpoint. Recent methods focus on finite-dimensional optimization techniques of a discretized finite dimensional ODE approximation of the infinite dimensional PDE system. In this paper, we derive a differential dynamic programming (DDP) framework for distributed and boundary control of spatio-temporal systems in infinite dimensions that is shown to generalize both the spatio-temporal LQR solution, and modern finite dimensional DDP frameworks. We analyze the convergence behavior and provide a proof of global convergence for the resulting system of continuous-time forward-backward equations. We explore and develop numerical approaches to handle sensitivities that arise during implementation, and apply the resulting STDDP algorithm to a linear and nonlinear spatio-temporal PDE system. Our framework is derived in infinite dimensional Hilbert spaces, and represents a discretization-agnostic framework for control of nonlinear spatio-temporal PDE systems.


title: End-to-end speaker segmentation for overlap-aware resegmentation

abstract: Speaker segmentation consists in partitioning a conversation between one or more speakers into speaker turns. Usually addressed as the late combination of three sub-tasks (voice activity detection, speaker change detection, and overlapped speech detection), we propose to train an end-to-end segmentation model that does it directly. Inspired by the original end-to-end neural speaker diarization approach (EEND), the task is modeled as a multi-label classification problem using permutation-invariant training. The main difference is that our model operates on short audio chunks (5 seconds) but at a much higher temporal resolution (every 16ms). Experiments on multiple speaker diarization datasets conclude that our model can be used with great success on both voice activity detection and overlapped speech detection. Our proposed model can also be used as a post-processing step, to detect and correctly assign overlapped speech regions. Relative diarization error rate improvement over the best considered baseline (VBx) reaches 17% on AMI, 13% on DIHARD 3, and 13% on VoxConverse.


title: Semi-Supervised Learning of Classifiers from a Statistical Perspective: A Brief Review

abstract: There has been increasing attention to semi-supervised learning (SSL) approaches in machine learning to forming a classifier in situations where the training data for a classifier consists of a limited number of classified observations but a much larger number of unclassified observations. This is because the procurement of classified data can be quite costly due to high acquisition costs and subsequent financial, time, and ethical issues that can arise in attempts to provide the true class labels for the unclassified data that have been acquired. We provide here a review of statistical SSL approaches to this problem, focussing on the recent result that a classifier formed from a partially classified sample can actually have smaller expected error rate than that if the sample were completely classified.


title: Heterogeneous Dense Subhypergraph Detection

abstract: We study the problem of testing the existence of a heterogeneous dense subhypergraph. The null hypothesis corresponds to a heterogeneous Erd\"{o}s-R\'{e}nyi uniform random hypergraph and the alternative hypothesis corresponds to a heterogeneous uniform random hypergraph that contains a dense subhypergraph. We establish detection boundaries when the edge probabilities are known and construct an asymptotically powerful test for distinguishing the hypotheses. We also construct an adaptive test which does not involve edge probabilities, and hence, is more practically useful.


title: Axial Anomaly in the $SU(N)$ Gauge Matrix Model

abstract: The $SU(N)$ Yang-Mills matrix model admits self-dual and anti-self-dual instantons. When coupled to $N_f$ flavors of massless quarks, the Euclidean Dirac equation in an instanton background has $n_+$ positive and $n_-$ negative chirality zero modes. We show that the index $(n_+ - n_-)$ is equal to a suitably defined instanton charge. Further, we show that the path integral measure is not invariant under a chiral rotation, and relate the non-invariance of the measure to the index of the Dirac operator. Axial symmetry is broken anomalously, with the residual symmetry being a finite group. For $N_f$ fundamental fermions, this residual symmetry is $\mathbb{Z}_{2N_f}$, whereas for adjoint quarks it is $\mathbb{Z}_{4N_f}$.


title: Quantum-Assisted Feature Selection for Vehicle Price Prediction Modeling

abstract: Within machine learning model evaluation regimes, feature selection is a technique to reduce model complexity and improve model performance in regards to generalization, model fit, and accuracy of prediction. However, the search over the space of features to find the subset of $k$ optimal features is a known NP-Hard problem. In this work, we study metrics for encoding the combinatorial search as a binary quadratic model, such as Generalized Mean Information Coefficient and Pearson Correlation Coefficient in application to the underlying regression problem of price prediction. We investigate trade-offs in the form of run-times and model performance, of leveraging quantum-assisted vs. classical subroutines for the combinatorial search, using minimum redundancy maximal relevancy as the heuristic for our approach. We achieve accuracy scores of 0.9 (in the range of [0,1]) for finding optimal subsets on synthetic data using a new metric that we define. We test and cross-validate predictive models on a real-world problem of price prediction, and show a performance improvement of mean absolute error scores for our quantum-assisted method $(1471.02 \pm{135.6})$, vs. similar methodologies such as recursive feature elimination $(1678.3 \pm{143.7})$. Our findings show that by leveraging quantum-assisted routines we find solutions that increase the quality of predictive model output while reducing the input dimensionality to the learning algorithm on synthetic and real-world data.


title: Flavored Tacotron: Conditional Learning for Prosodic-linguistic Features

abstract: Neural sequence-to-sequence text-to-speech synthesis (TTS), such as Tacotron-2, transforms text into high-quality speech. However, generating speech with natural prosody still remains a challenge. Yasuda et. al. show that unlike natural speech, Tacotron-2's encoder doesn't fully represent prosodic features (e.g. syllable stress in English) from characters, and result in flat fundamental frequency variations. In this work, we propose a novel carefully designed strategy for conditioning Tacotron-2 on two fundamental prosodic features in English -- stress syllable and pitch accent, that help achieve more natural prosody. To this end, we use of a classifier to learn these features in an end-to-end fashion, and apply feature conditioning at three parts of Tacotron-2's Text-To-Mel Spectrogram: pre-encoder, post-encoder, and intra-decoder. Further, we show that jointly conditioned features at pre-encoder and intra-decoder stages result in prosodically natural synthesized speech (vs. Tacotron-2), and allows the model to produce speech with more accurate pitch accent and stress patterns. Quantitative evaluations show that our formulation achieves higher fundamental frequency contour correlation, and lower Mel Cepstral Distortion measure between synthesized and natural speech. And subjective evaluation shows that the proposed method's Mean Opinion Score of 4.14 fairs higher than baseline Tacotron-2, 3.91, when compared against natural speech (LJSpeech corpus), 4.28.


title: Precision Calculation of Dark Radiation from Spinning Primordial Black Holes and Early Matter Dominated Eras

abstract: We present precision calculations of dark radiation in the form of gravitons coming from Hawking evaporation of spinning primordial black holes (PBHs) in the early Universe. Our calculation incorporates a careful treatment of extended spin distributions of a population of PBHs, the PBH reheating temperature, and the number of relativistic degrees of freedom. We compare our precision results with those existing in the literature, and show constraints on PBHs from current bounds on dark radiation from BBN and the CMB, as well as the projected sensitivity of CMB Stage 4 experiments. As an application, we consider the case of PBHs formed during an early matter-dominated era (EMDE). We calculate graviton production from various PBH spin distributions pertinent to EMDEs, and find that PBHs in the entire mass range up to $10^9\,$g will be constrained by measurements from CMB Stage 4 experiments, assuming PBHs come to dominate the Universe prior to Hawking evaporation. We also find that for PBHs with monochromatic spins $a^*>0.81$, all PBH masses in the range $10^{-1}\,{\rm g} < M_{\rm BH} <10^9\,$g will be probed by CMB Stage 4 experiments.


title: AlephBERT:A Hebrew Large Pre-Trained Language Model to Start-off your Hebrew NLP Application With

abstract: Large Pre-trained Language Models (PLMs) have become ubiquitous in the development of language understanding technology and lie at the heart of many artificial intelligence advances. While advances reported for English using PLMs are unprecedented, reported advances using PLMs in Hebrew are few and far between. The problem is twofold. First, Hebrew resources available for training NLP models are not at the same order of magnitude as their English counterparts. Second, there are no accepted tasks and benchmarks to evaluate the progress of Hebrew PLMs on. In this work we aim to remedy both aspects. First, we present AlephBERT, a large pre-trained language model for Modern Hebrew, which is trained on larger vocabulary and a larger dataset than any Hebrew PLM before. Second, using AlephBERT we present new state-of-the-art results on multiple Hebrew tasks and benchmarks, including: Segmentation, Part-of-Speech Tagging, full Morphological Tagging, Named-Entity Recognition and Sentiment Analysis. We make our AlephBERT model publicly available, providing a single point of entry for the development of Hebrew NLP applications.


title: Opening band gaps of low-dimensional materials at the meta-GGA level of density functional approximations

abstract: The recent TASK meta-GGA density functional [Phys. Rev. Research, 1, 033082 (2019)] is constructed with an enhanced nonlocality in the generalized Kohn-Sham scheme, and therefore harbors great opportunities for band gap prediction. Although this approximation was found to yield excellent band gaps of bulk solids, this accuracy cannot be straightforwardly transferred to low-dimensional materials. The reduced screening of these materials results in larger band gaps compared to their bulk counterparts, as an additional barrier to overcome. In this work, we demonstrate how the alteration of exact physical constraints in this functional affects the band gaps of monolayers and nanoribbons, and present accurate band gaps competing with the HSE06 approximation. In order to achieve this goal, we have modified the TASK functional (a) by changing the tight upper-bound for one or two-electron systems ($h_X^0$) from 1.174 to 1.29 (b) by changing the limit of interpolation function $f_X (\alpha \rightarrow \infty$) of the TASK functional that interpolates the exchange enhancement factor $F_X (s,\alpha)$ from $\alpha=$ 0 to 1. The resulting modified TASK (mTASK) was tested for various materials from 3D to 2D to 1D (nanoribbons), and was compared with the results of the higher-level hybrid functional HSE06 or with the G$_0$W$_0$ approximation within many-body perturbation theory. We find that mTASK greatly improves the band gaps and band structures of 2D and 1D systems, without significantly affecting the accuracy of the original TASK for the bulk 3D materials, when compared to the PBE-GGA and SCAN meta-GGA. We further demonstrate the applicability of mTASK by assessing the band structures of TMD nanoribbons with respect to various bending curvatures.


title: Adversarial Learning Inspired Emerging Side-Channel Attacks and Defenses

abstract: Evolving attacks on the vulnerabilities of the computing systems demand novel defense strategies to keep pace with newer attacks. This report discusses previous works on side-channel attacks (SCAs) and defenses for cache-targeted and physical proximity attacks. We then discuss the proposed Entropy-Shield as a defense against timing SCAs, and explain how we can extend the same to hardware-based implementations of crypto applications as "Entropy-Shield for FPGA". We then discuss why we want to build newer attacks with the hope of coming up with better defense strategies.


title: Generative Landmarks

abstract: We propose a general purpose approach to detect landmarks with improved temporal consistency, and personalization. Most sparse landmark detection methods rely on laborious, manually labelled landmarks, where inconsistency in annotations over a temporal volume leads to sub-optimal landmark learning. Further, high-quality landmarks with personalization is often hard to achieve. We pose landmark detection as an image translation problem. We capture two sets of unpaired marked (with paint) and unmarked videos. We then use a generative adversarial network and cyclic consistency to predict deformations of landmark templates that simulate markers on unmarked images until these images are indistinguishable from ground-truth marked images. Our novel method does not rely on manually labelled priors, is temporally consistent, and image class agnostic -- face, and hand landmarks detection examples are shown.


title: Exceptional Degeneracy in a Waveguide Periodically Loaded with Discrete Gain and Radiation Loss Elements

abstract: We demonstrate that a periodic waveguide comprising of uniform lossless segments together with discrete gain and radiating elements supports exceptional points of degeneracy (EPDs). We provide analytical expressions for all possible conditions that guarantee the occurrence of an EPD, i.e., the coalescence of eigenvalues and eigenvectors. We show that EPDs are not only achieved using symmetric gain and radiation periodic loading, but they are also obtained using asymmetric gain and radiation loss conditions. We illustrate the characteristics of the degenerate electromagnetic modes, showing the dispersion diagram and discussing the tunability of the EPD frequency. We show a special condition, we refer to it as parity-time (PT)-glide symmetry, which leads to a degeneracy that is occurring at all frequencies of operation. The class of EPDs proposed in this work is very promising for many applications that incorporate discrete-distributed coherent sources and radiation-loss elements; operating in the vicinity of such special degeneracy conditions leads to potential performance enhancement in a variety of microwave and optical resonators, antennas, and devices and can be extended to a new class of active integrated antenna arrays and radiating laser arrays.


title: Out-of-plane magnetization oscillation in spin Hall device assisted by field-like torque

abstract: An excitation of a large-amplitude out-of-plane magnetization oscillation in a ferromagnet by the spin Hall effect is of great interest for practical applications such as microwave generator and neuromorphic computing. However, both experimental and theoretical works have revealed that only small-amplitude oscillation around an in-plane easy axis can be excited via the spin Hall effect. Here, we propose that an out-of-plane oscillation can be excited due to an assistance of field-like torque. We focus on an in-plane magnetized ferromagnet with an easy axis parallel to current direction. We notice that the field-like torque with an appropriate sign provides an additional field modifying the dynamic trajectory of the magnetization and drives the auto-oscillation. The condition on the sign of the field-like torque is satisfied for typical nonmagnet used in spin Hall devices such as tungsten.


title: A Data Science Approach to Analyze the Association of Socioeconomic and Environmental Conditions With Disparities in Pediatric Surgery

abstract: Scientific evidence confirm that significant racial disparities exist in healthcare, including surgery outcomes. However, the causal pathway underlying disparities at preoperative physical condition of children is not well-understood. This research aims to uncover the role of socioeconomic and environmental factors in racial disparities at the preoperative physical condition of children through multidimensional integration of several data sources at the patient and population level. After the data integration process an unsupervised k-means algorithm on neighborhood quality metrics was developed to split 29 zip-codes from Memphis, TN into good and poor-quality neighborhoods. An unadjusted comparison of African Americans and white children showed that the prevalence of poor preoperative condition is significantly higher among African Americans compared to whites. No statistically significant difference in surgery outcome was present when adjusted by surgical severity and neighborhood quality. The socioenvironmental factors affect the preoperative clinical condition of children and their surgical outcomes.


title: Machine Learning on the COVID-19 Pandemic, Human Mobility and Air Quality: A Review

abstract: The ongoing COVID-19 global pandemic is affecting every facet of human lives (e.g., public health, education, economy, transportation, and the environment). This novel pandemic and citywide implemented lockdown measures are affecting virus transmission, people's travel patterns, and air quality. Many studies have been conducted to predict the COVID-19 diffusion, assess the impacts of the pandemic on human mobility and air quality, and assess the impacts of lockdown measures on viral spread with a range of Machine Learning (ML) techniques. This review study aims to analyze results from past research to understand the interactions among the COVID-19 pandemic, lockdown measures, human mobility, and air quality. The critical review of prior studies indicates that urban form, people's socioeconomic and physical conditions, social cohesion, and social distancing measures significantly affect human mobility and COVID-19 transmission. during the COVID-19 pandemic, many people are inclined to use private transportation for necessary travel purposes to mitigate coronavirus-related health problems. This review study also noticed that COVID-19 related lockdown measures significantly improve air quality by reducing the concentration of air pollutants, which in turn improves the COVID-19 situation by reducing respiratory-related sickness and deaths of people. It is argued that ML is a powerful, effective, and robust analytic paradigm to handle complex and wicked problems such as a global pandemic. This study also discusses policy implications, which will be helpful for policymakers to take prompt actions to moderate the severity of the pandemic and improve urban environments by adopting data-driven analytic methods.


title: Network in Disaggregated Datacenters

abstract: Nowadays, datacenters lean on a computer-centric approach based on monolithic servers which include all necessary hardware resources (mainly CPU, RAM, network and disks) to run applications. Such an architecture comes with two main limitations: (1) difficulty to achieve full resource utilization and (2) coarse granularity for hardware maintenance. Recently, many works investigated a resource-centric approach called disaggregated architecture where the datacenter is composed of self-content resource boards interconnected using fast interconnection technologies, each resource board including instances of one resource type. The resource-centric architecture allows each resource to be managed (maintenance, allocation) independently. LegoOS is the first work which studied the implications of disaggregation on the operating system, proposing to disaggregate the operating system itself. They demonstrated the suitability of this approach, considering mainly CPU and RAM resources. However, they didn't study the implication of disaggregation on network resources. We reproduced a LegoOS infrastructure and extended it to support disaggregated networking. We show that networking can be disaggregated following the same principles, and that classical networking optimizations such as DMA, DDIO or loopback can be reproduced in such an environment. Our evaluations show the viability of the approach and the potential of future disaggregated infrastructures.


title: Transition from physical to online shopping alternatives due to the COVID-19 pandemic

abstract: By using 530 responses from an online questionnaire, this study aims to investigate the transition from physical to online shopping alternatives during the first wave of the COVID-19 pandemic period at the individual level. The focus areas of the study are Sweden and Italy, two European countries that implemented contrasting prevention measures. This study analyses the impacts of the pandemic to the shopping behaviour and identifies, among the respondents, who have changed the behaviour the most, how respondents have adopted different shopping strategies, what the main differences between Italian and Swedish responses are and the influence of population density on the behavioural change. Multivariate statistical analyses, including linear and binary logistic regressions and multinomial logit models were used to analyse the dataset. The results confirm the differences between Italy and Sweden in terms of social distancing measures, social structures and technology readiness. Moreover, the socio-demographic and household structures of the respondents were found instrumental in influencing the amount and the direction of change in shopping behaviour during the first wave of the pandemic period. The output of this study highlights the impact that contrasting policies have on citizens, and also the importance of having policies that are adaptable to different situations.


title: Interdisciplinary Research Methodologies in Engineering Education Research

abstract: As Engineering Education Research (EER) develops as a discipline it is necessary for EER scholars to contribute to the development of learning theory rather than simply being informed by it. It has been suggested that to do this effectively will require partnerships between Engineering scholars and psychologists, education researchers, including other social scientists. The formation of such partnerships is particularly important when considering the introduction of business-related skills into engineering curriculum designed to prepare 21st Century Engineering Students for workplace challenges. In order to encourage scholars beyond Engineering to engage with EER, it is necessary to provide an introduction to the complexities of EER. With this aim in mind, this paper provides an outline review of what is considered rigorous research from an EER perspective as well as highlighting some of the core methodological traditions of EER. The paper aims to facilitate further discussion between EER scholars and researchers from other disciplines, ultimately leading to future collaboration on innovative and rigorous EER.


title: Co-Creating Educational Project Management Board Games to Enhance Student Engagement

abstract: Management education scholarship has long outlined the need to enhance student engagement and participation in business schools, using more innovative teaching practices. This is increasingly motivating scholars to strive for more collaborative pedagogic dynamics between teachers and students. At the same time, research into co-creation of Game Based Learning material such as board games has largely focused on the value added to games when educators involve students in the design process. However there has been scant research examining the qualities of co-creational game design exercises as teaching experiences themselves, thus overlooking the opportunity to conceptualise such activities as an innovative teaching tool that can help educators facilitate student engagement and participation. To address this research gap, this paper presents a case study where Project Management students participated in two co-creation workshops designing educational Project Management games. Data were collected conducting focus groups at the end of the two workshops. Throughout the paper we have sought to present some positive outcomes of such processes as well as some critical points that emerged through the data that were collected. Mentionable outcomes include a series of positive characteristics of co-creative Game Based Learning activities like enhanced engagement as well as a list of challenges when facilitating such activities. The main findings of this research have been organised in two frameworks, one outlining five positive characteristics of co-creative Game Based Learning activities: engagement with knowledge, knowledge assessment, creativity, communication and the second outlining challenges in facilitating such activities: lack of focus, lack of structure and the need for more practice-oriented games.


title: Many-Joint Robot Arm Control with Recurrent Spiking Neural Networks

abstract: In the paper, we show how scalable, low-cost trunk-like robotic arms can be constructed using only basic 3D-printing equipment and simple electronics. The design is based on uniform, stackable joint modules with three degrees of freedom each. Moreover, we present an approach for controlling these robots with recurrent spiking neural networks. At first, a spiking forward model learns motor-pose correlations from movement observations. After training, intentions can be projected back through unrolled spike trains of the forward model essentially routing the intention-driven motor gradients towards the respective joints, which unfolds goal-direction navigation. We demonstrate that spiking neural networks can thus effectively control trunk-like robotic arms with up to 75 articulated degrees of freedom with near millimeter accuracy.


title: Quantitative Assessment of Solution Innovation in Engineering Education

abstract: The article discusses the quantitative assessment approach to the innovation of engineering system components. The validity of the approach is based on the expert appraisal of the university's electronic information educational environment components and the measurement of engineering solution innovation in engineering education. The implementation of batch processing of object innovation assessments is justified and described.


title: Synchronization in Electric Power Networks with Inherent Heterogeneity Up to 100% Inverter-Based Renewable Generation

abstract: The synchronized operation of power generators is the foundation of electric power network stability and a key to the prevention of undesired power outages and blackouts. Here, we derive the conditions that guarantee synchronization in power networks with inherent generator heterogeneity when subjected to small perturbations, and perform a parametric sensitivity analysis to understand synchronization with varied types of generators. As inverter-based resources, which are the primary interfacing technology for many renewable sources of energy, have supplanted synchronous generators in ever growing numbers, the center of attention on associated integration challenges have resided primarily on the role of declining system inertia. Our results instead highlight the critical role of generator damping in achieving a stable state of synchronization. Additionally, we report the feasibility of operating interconnected electric grids with up to 100% power contribution from inverter-based renewable generation technologies. Our study has important implications as it sets the basis for the development of advanced control architectures and grid optimization methods that ensure synchronization and further pave the path towards the decarbonization of the electric power sector.


title: Transient Information Adaptation of Artificial Intelligence: Towards Sustainable Data Processes in Complex Projects

abstract: Large scale projects increasingly operate in complicated settings whilst drawing on an array of complex data-points, which require precise analysis for accurate control and interventions to mitigate possible project failure. Coupled with a growing tendency to rely on new information systems and processes in change projects, 90% of megaprojects globally fail to achieve their planned objectives. Renewed interest in the concept of Artificial Intelligence (AI) against a backdrop of disruptive technological innovations, seeks to enhance project managers cognitive capacity through the project lifecycle and enhance project excellence. However, despite growing interest there remains limited empirical insights on project managers ability to leverage AI for cognitive load enhancement in complex settings. As such this research adopts an exploratory sequential linear mixed methods approach to address unresolved empirical issues on transient adaptations of AI in complex projects, and the impact on cognitive load enhancement. Initial thematic findings from semi-structured interviews with domain experts, suggest that in order to leverage AI technologies and processes for sustainable cognitive load enhancement with complex data over time, project managers require improved knowledge and access to relevant technologies that mediate data processes in complex projects, but equally reflect application across different project phases. These initial findings support further hypothesis testing through a larger quantitative study incorporating structural equation modelling to examine the relationship between artificial intelligence and project managers cognitive load with project data in complex contexts.


title: Embedding Sustainability in Complex Projects: A Pedagogic Practice Simulation Approach

abstract: Sustainability is focussed on avoiding the long-term depletion of natural resources. Under the terms of a government plan to tackle climate change, a driver for improved sustainability is the cut of greenhouse gas emissions in the UK to almost zero by 2050. With this type of change, new themes are continuously being developed which drive complex projects, such as the development of new power generation methods, which encompass challenging lead times and demanding requirements. Consideration of the implementation of strategies and key concepts, which may engender sustainability within complex projects therefore presents an opportunity for further critical debate, review, and application through a project management lens. Sustainability incorporation in project management has been documented in academic literature, with this emerging field providing new challenges. For example, project management education can provide a holistic base for the inculcation of sustainability factors to a range of industries, including complex projects. Likewise, practitioner interest and approaches to sustainability in project management are being driven by the recently Chartered Association for Project Management (APM). Whilst this body makes a significant contribution to the UK economy across many sectors, it also addresses ongoing sustainability challenges. Therefore, by drawing on research and practitioner developments, the authors argue that by connecting with the next generation through practice simulation approaches, and embedding sustainability issues within project management tools and methods, improved focus on sustainability in complex project management may be achieved.


title: A survey on extremism analysis using Natural Language Processing

abstract: Extremism research has grown as an open problem for several countries during recent years, especially due to the apparition of movements such as jihadism. This and other extremist groups have taken advantage of different approaches, such as the use of Social Media, to spread their ideology, promote their acts and recruit followers. Natural Language Processing (NLP) represents a way of detecting this type of content, and several authors make use of it to describe and discriminate the discourse held by this groups, with the final objective of detecting and preventing its spread. This survey aims to review the contributions of NLP to the field of extremism research, providing the reader with a comprehensive picture of the state of the art of this research area. The content includes a description and comparison of the frequently used NLP techniques, how they were applied, the insights they provided, the most frequently used NLP software tools and the availability of datasets and data sources for research. Finally, research questions are approached and answered with highlights from the review, while future trends, challenges and directions derived from these highlights are suggested.


title: A Strategy for Advancing Research and Impact in New Computing Paradigms

abstract: In the world of Information Technology, new computing paradigms, driven by requirements of different classes of problems and applications, emerge rapidly. These new computing paradigms pose many new research challenges. Researchers from different disciplines are working together to develop innovative solutions addressing them. In newer research areas with many unknowns, creating roadmaps, enabling tools, inspiring technological and application demonstrators offer confidence and prove feasibility and effectiveness of new paradigm. Drawing on our experience, we share strategy for advancing the field and community building in new and emerging computing research areas. We discuss how the development simulators can be cost-effective in accelerating design of real systems. We highlight strategic role played by different types of publications, conferences, and educational programs. We illustrate effectiveness of elements of our strategy with a case study on progression of cloud computing paradigm.


title: Expanding Cybersecurity Knowledge Through an Indigenous Lens: A First Look

abstract: Decolonization and Indigenous education are at the forefront of Canadian content currently in Academia. Over the last few decades, we have seen some major changes in the way in which we share information. In particular, we have moved into an age of electronically-shared content, and there is an increasing expectation in Canada that this content is both culturally significant and relevant. In this paper, we discuss an ongoing community engagement initiative with First Nations communities in the Western Manitoba region. The initiative involves knowledge-sharing activities that focus on the topic of cybersecurity, and are aimed at a public audience. This initial look into our educational project focuses on the conceptual analysis and planning stage. We are developing a "Cybersecurity 101" mini-curriculum, to be implemented over several one-hour long workshops aimed at diverse groups (these public workshops may include a wide range of participants, from tech-adverse to tech-savvy). Learning assessment tools have been built in to the workshop program. We have created informational and promotional pamphlets, posters, lesson plans, and feedback questionnaires which we believe instill relevance and personal connection to this topic, helping to bridge gaps in accessibility for Indigenous communities while striving to build positive, reciprocal relationships. Our methodology is to approach the subject from a community needs and priorities perspective. Activities are therefore being tailored to fit each community.


title: Towards a New Participatory Approach for Designing Artificial Intelligence and Data-Driven Technologies

abstract: With there being many technical and ethical issues with artificial intelligence (AI) that involve marginalized communities, there is a growing interest for design methods used with marginalized people that may be transferable to the design of AI technologies. Participatory design (PD) is a design method that is often used with marginalized communities for the design of social development, policy, IT and other matters and solutions. However, there are issues with the current PD, raising concerns when it is applied to the design of technologies, including AI technologies. This paper argues for the use of PD for the design of AI technologies, and introduces and proposes a new PD, which we call agile participatory design, that not only can could be used for the design of AI and data-driven technologies, but also overcomes issues surrounding current PD and its use in the design of such technologies.


title: Direct-PoseNet: Absolute Pose Regression with Photometric Consistency

abstract: We present a relocalization pipeline, which combines an absolute pose regression (APR) network with a novel view synthesis based direct matching module, offering superior accuracy while maintaining low inference time. Our contribution is twofold: i) we design a direct matching module that supplies a photometric supervision signal to refine the pose regression network via differentiable rendering; ii) we modify the rotation representation from the classical quaternion to SO(3) in pose regression, removing the need for balancing rotation and translation loss terms. As a result, our network Direct-PoseNet achieves state-of-the-art performance among all other single-image APR methods on the 7-Scenes benchmark and the LLFF dataset.


title: The Kaleidoscope of Privacy: Differences across French, German, UK, and US GDPR Media Discourse

abstract: Conceptions of privacy differ by culture. In the Internet age, digital tools continuously challenge the way users, technologists, and governments define, value, and protect privacy. National and supranational entities attempt to regulate privacy and protect data managed online. The European Union passed the General Data Protection Regulation (GDPR), which took effect on 25 May 2018. The research presented here draws on two years of media reporting on GDPR from French, German, UK, and US sources. We use the unsupervised machine learning method of topic modelling to compare the thematic structure of the news articles across time and geographic regions. Our work emphasises the relevance of regional differences regarding valuations of privacy and potential obstacles to the implementation of unilateral data protection regulation such as GDPR. We find that the topics and trends over time in GDPR media coverage of the four countries reflect the differences found across their traditional privacy cultures.


title: Towards a Rigorous Evaluation of Explainability for Multivariate Time Series

abstract: Machine learning-based systems are rapidly gaining popularity and in-line with that there has been a huge research surge in the field of explainability to ensure that machine learning models are reliable, fair, and can be held liable for their decision-making process. Explainable Artificial Intelligence (XAI) methods are typically deployed to debug black-box machine learning models but in comparison to tabular, text, and image data, explainability in time series is still relatively unexplored. The aim of this study was to achieve and evaluate model agnostic explainability in a time series forecasting problem. This work focused on proving a solution for a digital consultancy company aiming to find a data-driven approach in order to understand the effect of their sales related activities on the sales deals closed. The solution involved framing the problem as a time series forecasting problem to predict the sales deals and the explainability was achieved using two novel model agnostic explainability techniques, Local explainable model-agnostic explanations (LIME) and Shapley additive explanations (SHAP) which were evaluated using human evaluation of explainability. The results clearly indicate that the explanations produced by LIME and SHAP greatly helped lay humans in understanding the predictions made by the machine learning model. The presented work can easily be extended to any time


title: An artificial intelligence and Internet of things based automated irrigation system

abstract: It is not hard to see that the need for clean water is growing by considering the decrease of the water sources day by day in the world. Potable fresh water is also used for irrigation, so it should be planned to decrease freshwater wastage. With the development of technology and the availability of cheaper and more effective solutions, the efficiency of irrigation increased and the water loss can be reduced. In particular, Internet of things (IoT) devices has begun to be used in all areas. We can easily and precisely collect temperature, humidity and mineral values from the irrigation field with the IoT devices and sensors. Most of the operations and decisions about irrigation are carried out by people. For people, it is hard to have all the real-time data such as temperature, moisture and mineral levels in the decision-making process and make decisions by considering them. People usually make decisions with their experience. In this study, a wide range of information from the irrigation field was obtained by using IoT devices and sensors. Data collected from IoT devices and sensors sent via communication channels and stored on MongoDB. With the help of Weka software, the data was normalized and the normalized data was used as a learning set. As a result of the examinations, a decision tree (J48) algorithm with the highest accuracy was chosen and an artificial intelligence model was created. Decisions are used to manage operations such as starting, maintaining and stopping the irrigation. The accuracy of the decisions was evaluated and the irrigation system was tested with the results. There are options to manage, view the system remotely and manually and also see the system s decisions with the created mobile application.


title: Two Truths and a Lie: Exploring Soft Moderation of COVID-19 Misinformation with Amazon Alexa

abstract: In this paper, we analyzed the perceived accuracy of COVID-19 vaccine Tweets when they were spoken back by a third-party Amazon Alexa skill. We mimicked the soft moderation that Twitter applies to COVID-19 misinformation content in both forms of warning covers and warning tags to investigate whether the third-party skill could affect how and when users heed these warnings. The results from a 304-participant study suggest that the spoken back warning covers may not work as intended, even when converted from text to speech. We controlled for COVID-19 vaccination hesitancy and political leanings and found that the vaccination hesitant Alexa users ignored any type of warning as long as the Tweets align with their personal beliefs. The politically independent users trusted Alexa less then their politically-laden counterparts and that helped them accurately perceiving truthful COVID-19 information. We discuss soft moderation adaptations for voice assistants to achieve the intended effect of curbing COVID-19 misinformation.


title: Progressive extension of reinforcement learning action dimension for asymmetric assembly tasks

abstract: Reinforcement learning (RL) is always the preferred embodiment to construct the control strategy of complex tasks, like asymmetric assembly tasks. However, the convergence speed of reinforcement learning severely restricts its practical application. In this paper, the convergence is first accelerated by combining RL and compliance control. Then a completely innovative progressive extension of action dimension (PEAD) mechanism is proposed to optimize the convergence of RL algorithms. The PEAD method is verified in DDPG and PPO. The results demonstrate the PEAD method will enhance the data-efficiency and time-efficiency of RL algorithms as well as increase the stable reward, which provides more potential for the application of RL.


title: The Internet of People: A Survey and Tutorial

abstract: Along with the rapid development of Internet and cyber techniques, the Internet of People (IoP) has been emerging as a novel paradigm which establishes ubiquitous connections between social space and cyberspace. Unlike the Internet of Things (IoT), human nodes in IoP are not only terminal users, but also significant participants bonded with tighter relationships. Note that IoP has deeply influenced our lives. For example, the prosperity of social media enables us to build and maintain new relationships without considering physical boundaries. In this paper, we give a comprehensive overview of IoP by comparing it with IoT, introduce its enabling techniques from aspects of sensing, communication and application. In addition, we summarize and compare popular IoP-enabled platforms according to different functions, and finally envision open issues needed to be further discussed in IoP. It provides constructive suggestions, lays solid foundations, and makes a basic blueprint for the future development of IoP paradigm.


title: Design and implementation of an environment for Learning to Run a Power Network (L2RPN)

abstract: This report summarizes work performed as part of an internship at INRIA, in partial requirement for the completion of a master degree in math and informatics. The goal of the internship was to develop a software environment to simulate electricity transmission in a power grid and actions performed by operators to maintain this grid in security. Our environment lends itself to automate the control of the power grid with reinforcement learning agents, assisting human operators. It is amenable to organizing benchmarks, including a challenge in machine learning planned by INRIA and RTE for 2019. Our framework, built on top of open-source libraries, is available at https://github.com/MarvinLer/pypownet. In this report we present intermediary results and its usage in the context of a reinforcement learning game.


title: Merit functions and measurement schemes for single parameter depolarization models

abstract: Mueller polarized bi-directional scattering distribution functions (pBSDFs) are 4x4 matrix-valued functions which depend on acquisition geometry. The most popular pBSDF is a weighted sum between a Fresnel matrix and an ideal depolarizer. This work's main contribution is relating the relative weight between an ideal depolarizer and Fresnel matrix to a single depolarization parameter. Rather than a 16-dimensional matrix norm, this parameter can form a one-dimensional merit function. Then, instead of a full Mueller matrix measurement, a scheme for pBSDF fitting to only two polarimetric measurements is introduced. Depolarization can be mathematically expressed as the incoherent addition of coherent states. This work shows that, for a Mueller matrix to be in the span of a Fresnel matrix and an ideal depolarizer, the weights in the incoherent addition are triply degenerate. This triple degeneracy is observed in five different colored opaque plastics treated with nine different surface textures and measured at varying acquisition geometries and wavebands.


title: Harvest management problem in a fractional logistic equation

abstract: In this article, we study a fractional control problem that models the maximization of the profits obtained by exploiting a certain resource whose dynamics are governed by the fractional logistic equation. Due to the singularity of this problem, we develop different resolution techniques, both for the classical case and for the fractional case. In the last section we perform several numerical simulations to make a comparison between both cases.


title: Evaluation of silicon carbide as a divertor armor material in DIII-D H-mode discharges

abstract: Silicon carbide (SiC) represents a promising but largely untested plasma-facing material (PFM) for next-step fusion devices. In this work, an analytic mixed-material erosion model is developed by calculating the physical (via SDTrimSP) and chemical (via empirical scalings) sputtering yield from SiC, Si, and C. The Si content in the near-surface SiC layer is predicted to increase during D plasma bombardment due to more efficient physical and chemical sputtering of C relative to Si. Silicon erosion from SiC thereby occurs primarily from sputtering of the enriched Si layer, rather than directly from the SiC itself. SiC coatings on ATJ graphite, manufactured via chemical vapor deposition, were exposed to repeated H-mode plasma discharges in the DIII-D tokamak to test this model. The qualitative trends from analytic modeling are reproduced by the experimental measurements, obtained via spectroscopic inference using the S/XB method. Quantitatively the model slightly under-predicts measured erosion rates, which is attributed to uncertainties in the ion impact angle distribution, as well as the effect of edge-localized modes. After exposure, minimal changes to the macroscopic or microscopic surface morphology of the SiC coatings were observed. Compositional analysis reveals Si enrichment of about 10%, in line with expectations from the erosion model. Extrapolating to a DEMO-type device, an order-of-magnitude decrease in impurity sourcing, and up to a factor of 2 decrease in impurity radiation, is expected with SiC walls, relative to graphite, if low C plasma impurity content can be achieved. These favorable erosion properties motivate further investigations of SiC as a low-Z, non-metallic PFM.


title: Free boundary problem for the role of planktonic cells in biofilm formation and development

abstract: The dynamics of biofilm lifecycle are deeply influenced by the surrounding environment and the interactions between sessile and planktonic phenotypes. Bacterial biofilms typically develop in three distinct stages: attachment of cells to a surface, growth of cells into colonies, and detachment of cells from the colony into the surrounding medium. The attachment of planktonic cells plays a prominent role in the initial phase of biofilm lifecycle as it initiates the colony formation. During the maturation stage, biofilms harbor numerous microenvironments which lead to metabolic heterogeneity. Such microniches provide conditions suitable for the growth of new species, which are present in the bulk liquid as planktonic cells and can penetrate the porous biofilm matrix. We present a 1D continuum model on the interaction of sessile and planktonic phenotypes in biofilm lifestyle which considers both the initial attachment and colonization phenomena. The model is formulated as a hyperbolic-elliptic free boundary value problem with vanishing initial value. Hyperbolic equations reproduce the transport and growth of sessile species, while elliptic equations model the diffusion and conversion of planktonic cells and dissolved substrates. The attachment is modelled as a continuous, deterministic process which depends on the concentrations of the attaching species. The growth of new species is modelled through a reaction term in the hyperbolic equations which depends on the concentration of planktonic species within the biofilm. Existence and uniqueness of solutions are discussed and proved for the attachment regime. Finally, some numerical examples show that the proposed model correctly reproduces the growth of new species within the biofilm and overcomes the ecological restrictions characterizing the Wanner-Gujer type models.


title: Manchester Encoding for Non-coherent Detection of Ambient Backscatter in Time-Selective Fading

abstract: Simplifying the detection procedure and improving the bit error rate (BER) performance of a non-coherent receiver in ambient backscatter is vital for enhancing its ability to function without the channel state information (CSI). In this work, we analyze the BER performance of Manchester encoding which is implemented at the transmitter for data transmission, and demonstrate that the optimal decision rule is independent of the system parameters. Further, through extensive numerical results, it is shown that the ambient backscatter system can achieve a signal-to-noise ratio (SNR) gain with Manchester encoding compared to the commonly used uncoded direct on-off keying (OOK) modulation, when used in conjunction with a multi-antenna receiver employing the direct-link cancellation.


title: Halperin's conjecture in formal dimensions up to 20

abstract: A 1976 conjecture of Halperin on positively elliptic spaces was recently confirmed in formal dimensions up to 16. In this article, we shorten the proof and extend the result up to formal dimension 20. We work with Meier's algebraic characterization of the conjecture, so the proof is elementary in that it involves only polynomial algebras, ideals, and derivations.


title: A Sketch-Based Neural Model for Generating Commit Messages from Diffs

abstract: Commit messages have an important impact in software development, especially when working in large teams. Multiple developers who have a different style of writing may often be involved in the same project. For this reason, it may be difficult to maintain a strict pattern of writing informative commit messages, with the most frequent issue being that these messages are not descriptive enough. In this paper we apply neural machine translation (NMT) techniques to convert code diffs into commit messages and we present an improved sketch-based encoder for this task. We split the approach into three parts. Firstly, we focus on finding a more suitable NMT baseline for this problem. Secondly, we show that the performance of the NMT models can be improved by training on examples containing a specific file type. Lastly, we introduce a novel sketch-based neural model inspired by recent approaches used for code generation and we show that the sketch-based encoder significantly outperforms existing state of the art solutions. The results highlight that this improvement is relevant especially for Java source code files, by examining two different datasets introduced in recent years for this task.


title: Emergent Replica Conformal Symmetry in Non-Hermitian SYK$_2$ Chains

abstract: Recently, the steady states of non-unitary free fermion dynamics are found to exhibit novel critical phases with power-law squared correlations and a logarithmic subsystem entanglement. In this work, we theoretically understand the underlying physics by constructing solvable static/Brownian quadratic Sachdev-Ye-Kitaev chains with non-Hermitian dynamics. We find the action of the replicated system generally shows (one or infinite copies of) ${O(2)\times O(2)}$ symmetries, which is broken to ${O(2)}$ by the saddle-point solution. This leads to an emergent conformal field theory of the Goldstone modes. We derive the effective action and obtain the universal critical behaviors of squared correlators. Furthermore, the entanglement entropy of a subsystem ${A}$ with length ${L_A}$ corresponds to the energy of the half-vortex pair ${S\sim \rho_s \log L_A}$, where ${\rho_s}$ is the total stiffness of the Goldstone modes. We also discuss special limits with more than one branch of Goldstone modes and comment on interaction effects.


title: Necessary conditions to a fractional variational problem

abstract: In order to solve fractional variational problems, there exist two theorems of necessary conditions: an Euler-Lagrange equation which involves Caputo and Riemann-Liouville fractional derivatives, and other Euler-Lagrange equation that involves only Caputo derivatives. In this article, we make a comparison solving a particular fractional variational problem with both methods to obtain some conclusions about which method gives the optimal solution.


title: Real Space Analysis of Colloidal Gels: Triumphs, Challenges and Future Directions

abstract: Colloidal gels constitute an important class of materials found in many contexts and with a wide range of applications. Yet as matter far from equilibrium, gels exhibit a variety of time-dependent behaviours, which can be perplexing, such as an increase in strength prior to catastrophic failure. Remarkably, such complex phenomena are faithfully captured by an extremely simple model - "sticky spheres". Here we review progress in our understanding of colloidal gels made through the use of real space analysis and particle resolved studies. We consider the challenges of obtaining a suitable experimental system where the refractive index and density of the colloidal particles is matched to that of the solvent. We review work to obtain a particle-level mechanism for rigidity in gels and the evolution of our understanding of time-dependent behaviour, from early-time aggregation to ageing, before considering the response of colloidal gels to deformation and then move on to more complex systems of anisotropic particles and mixtures. Finally we note some more exotic materials with similar properties.


title: Grapheme-to-Phoneme Transformer Model for Transfer Learning Dialects

abstract: Grapheme-to-Phoneme (G2P) models convert words to their phonetic pronunciations. Classic G2P methods include rule-based systems and pronunciation dictionaries, while modern G2P systems incorporate learning, such as, LSTM and Transformer-based attention models. Usually, dictionary-based methods require significant manual effort to build, and have limited adaptivity on unseen words. And transformer-based models require significant training data, and do not generalize well, especially for dialects with limited data. We propose a novel use of transformer-based attention model that can adapt to unseen dialects of English language, while using a small dictionary. We show that our method has potential applications for accent transfer for text-to-speech, and for building robust G2P models for dialects with limited pronunciation dictionary size. We experiment with two English dialects: Indian and British. A model trained from scratch using 1000 words from British English dictionary, with 14211 words held out, leads to phoneme error rate (PER) of 26.877%, on a test set generated using the full dictionary. The same model pretrained on CMUDict American English dictionary, and fine-tuned on the same dataset leads to PER of 2.469% on the test set.


title: A fractional order cubic differential equation. Applications to natural resource management

abstract: An analysis of a fractional cubic differential equation is presented, which is a generalization of different versions of fractional logistic equations, in order to obtain simpler numerical methods that globalize and extend the results already obtained, and allow the comparison between several methods. The existence and uniqueness of the solution of the fractional cubic problem subject to an initial value are demonstrated, a stability analysis is performed and, based on the implementation of numerical methods, a comparison is made between the different logistic models.


title: Rheology of Wormlike Micellar Gels Formed By Long-Chained Zwitterionic Surfactants

abstract: Long-chained surfactant solutions have found widespread use in the oil and gas industry due to a host of attractive properties. In this paper, we characterize one such commercially used viscoelastic surfactant that forms a wormlike micellar gel at room temperature and a viscoelastic solution at higher temperatures. We probe both states by conducting linear and nonlinear rheological tests and analyze their behaviour under the framework of micellar rheology. Our study outlines departure from behaviour exhibited by more conventional micellar systems and uncovers interesting dynamics like shear-induced fracture and possible shear-banding in these materials. In doing so we provide a detailed understanding of a novel class of wormlike micellar solutions


title: Modules attached to extension bundles

abstract: In this article we study modules over wild canonical algebras which correspond to extension bundles [9] over weighted projective lines. We prove that all modules attached to extension bundles can be established by matrices with coefficients related to the relations of the considered algebra. Moreover, we expand the concept of extension bundles over weighted projective lines with three weights to general weight type and establish similar results in this situation. Finally, we present a method to compute matrices for all modules attached to extension bundles using cokernels of maps between direct sums of line bundles.


title: First-order natural deduction in Agda

abstract: Agda is a dependently-typed functional programming language, based on an extension of intuitionistic Martin-L\"of type theory. We implement first order natural deduction in Agda. We use Agda's type checker to verify the correctness of natural deduction proofs, and also prove properties of natural deduction, using Agda's proof assistant functionality. This implementation corresponds to a formalisation of natural deduction in constructive type theory, and the proofs are verified by Agda to be correct (under the assumption that Agda itself is correct).


title: The virtual element method for the coupled system of magneto-hydrodynamics

abstract: In this work, we review the framework of the Virtual Element Method (VEM) for a model in magneto-hydrodynamics (MHD), that incorporates a coupling between electromagnetics and fluid flow, and allows us to construct novel discretizations for simulating realistic phenomenon in MHD. First, we study two chains of spaces approximating the electromagnetic and fluid flow components of the model. Then, we show that this VEM approximation will yield divergence free discrete magnetic fields, an important property in any simulation in MHD. We present a linearization strategy to solve the VEM approximation which respects the divergence free condition on the magnetic field. This linearization will require that, at each non-linear iteration, a linear system be solved. We study these linear systems and show that they represent well-posed saddle point problems. We conclude by presenting numerical experiments exploring the performance of the VEM applied to the subsystem describing the electromagnetics. The first set of experiments provide evidence regarding the speed of convergence of the method as well as the divergence-free condition on the magnetic field. In the second set we present a model for magnetic reconnection in a mesh that includes a series of hanging nodes, which we use to calibrate the resolution of the method. The magnetic reconnection phenomenon happens near the center of the domain where the mesh resolution is finer and high resolution is achieved.


title: Bandwidth effects in stimulated Brillouin scattering driven by partially incoherent light

abstract: A generalized Wigner-Moyal statistical theory of radiation is used to obtain a general dispersion relation for Stimulated Brillouin Scattering (SBS) driven by a broadband radiation field with arbitrary statistics. The monochromatic limit is recovered from our general result, reproducing the classic monochromatic dispersion relation. The behavior of the growth rate of the instability as a simultaneous function of the bandwidth of the pump wave, the intensity of the incident field and the wave number of the scattered wave is further explored by numerically solving the dispersion relation. Our results show that the growth rate of SBS can be reduced by 1/3 for a bandwidth of 0.3 nm, for typical experimental parameters.


title: Wavelet field decomposition and UV `opaqueness'

abstract: A large body of work over several decades indicates that, in the presence of gravitational interactions, there is loss of localization resolution within a fundamental ( $\sim$ Planck) length scale $\ell$. We develop a general formalism based on wavelet decomposition of fields that takes this UV `opaqueness' into account in a natural and mathematically well-defined manner. This is done by requiring fields in a local Lagrangian to be expandable in only the scaling parts of a (complete or, in a more general version, partial) wavelet Multi-Resolution Analysis. This delocalizes the interactions, now mediated through the opaque regions, inside which they are rapidly decaying. The opaque regions themselves are capable of discrete excitations of $\sim 1/\ell$ spacing. The resulting effective Feynman rules, which give UV regulated and (perturbatively) unitary physical amplitudes, resemble those of string field theory.


title: A Cardinality Minimization Approach to Security-Constrained Economic Dispatch

abstract: We present a threshold-based cardinality minimization formulation to model the security-constrained economic dispatch problem. The model aims to minimize the operating cost of the system while simultaneously reducing the number of lines operating in emergency operating zones during contingency events. The model allows the system operator to monitor the duration for which lines operate in emergency zones and ensure that they are within the acceptable reliability standards determined by the system operators. We develop a continuous difference-of-convex approximation of the cardinality minimization problem and a solution method to solve the problem. Our numerical experiments demonstrate that the cardinality minimization approach reduces the overall system operating cost as well as avoids prolonged periods of high electricity prices during contingency events.


title: Landau Damping in the Transverse Modulational Dynamics of Co-Propagating Light and Matter Beams

abstract: The optomechanical coupling and transverse stability of a co-propagating monochromatic electromagnetic wave and mono-energetic beam of two-level atoms is investigated in the collisionless regime. The coupled dynamics are studied through a Landau stability analysis of the coupled gas- kinetic and paraxial wave equations, including the effect of the electronic nonlinearity. The resulting dispersion relation captures the interaction of kinetic and saturation effects and shows that for blue detuning the combined nonlinear interaction is unstable below a critical wavenumber which reduces to the result of Bespalov and Talanov in the limit of a negligible kinetic nonlinearity. For red detuning we find that under a saturation parameter threshold exists whereby the system stabilizes unconditionally. With negligible saturation, an optomechanical form of Landau damping stabilizes all wavenumbers above a critical wavenumber determined by the combined strength of the kinetic and refractive optomechanical feedback. The damping is mediated primarily by atoms traveling along the primary diagonals of the Talbot carpet.


title: ACCESS: An optical transmission spectrum of the high-gravity, hot Jupiter HAT-P-23b

abstract: We present a new ground-based visible transmission spectrum of the high-gravity, hot Jupiter HAT-P-23b, obtained as part of the ACCESS project. We derive the spectrum from five transits observed between 2016 and 2018, with combined wavelength coverage between 5200 {\AA} - 9269 {\AA} in 200 {\AA} bins, and with a median precision of 247 ppm per bin. HAT-P-23b's relatively high surface gravity (g ~ 30 m/s^2), combined with updated stellar and planetary parameters from Gaia DR2, gives a 5-scale-height signal of 384 ppm for a hydrogen-dominated atmosphere. Bayesian models favor a clear atmosphere for the planet with the tentative presence of TiO, after simultaneously modeling stellar contamination, using spots parameter constraints from photometry. If confirmed, HAT-P-23b would be the first example of a high-gravity gas giant with a clear atmosphere observed in transmission at optical/NIR wavelengths; therefore, we recommend expanding observations to the UV and IR to confirm our results and further characterize this planet. This result demonstrates how combining transmission spectroscopy of exoplanet atmospheres with long-term photometric monitoring of the host stars can help disentangle the exoplanet and stellar activity signals.


title: Read-Write Quorum Systems Made Practical

abstract: Quorum systems are a powerful mechanism for ensuring the consistency of replicated data. Production systems usually opt for majority quorums due to their simplicity and fault tolerance, but majority quorum systems provide poor throughput and scalability. Alternatively, researchers have invented a number of theoretically "optimal" quorum systems, but the underlying theory ignores many practical complexities such as machine heterogeneity and workload skew. In this paper, we conduct a pragmatic re-examination of quorum systems. We enrich the current theory on quorum systems with a number of practical refinements to find quorum systems that provide higher throughput, lower latency, and lower network load. We also develop a library Quoracle that precisely quantifies the available trade-offs between quorum systems to empower engineers to find optimal quorum systems, given a set of objectives for specific deployments and workloads. Our tool is available online at: https://github.com/mwhittaker/quoracle.


title: Causal Decision Making and Causal Effect Estimation Are Not the Same... and Why It Matters

abstract: Causal decision making (CDM) based on machine learning has become a routine part of business. Businesses algorithmically target offers, incentives, and recommendations to affect consumer behavior. Recently, we have seen an acceleration of research related to CDM and causal effect estimation (CEE) using machine-learned models. This article highlights an important perspective: CDM is not the same as CEE, and counterintuitively, accurate CEE is not necessary for accurate CDM. Our experience is that this is not well understood by practitioners or most researchers. Technically, the estimand of interest is different, and this has important implications both for modeling and for the use of statistical models for CDM. We draw on prior research to highlight three implications. (1) We should consider carefully the objective function of the causal machine learning, and if possible, optimize for accurate treatment assignment rather than for accurate effect-size estimation. (2) Confounding does not have the same effect on CDM as it does on CEE. The upshot is that for supporting CDM it may be just as good or even better to learn with confounded data as with unconfounded data. Finally, (3) causal statistical modeling may not be necessary to support CDM because a proxy target for statistical modeling might do as well or better. This third observation helps to explain at least one broad common CDM practice that seems wrong at first blush: the widespread use of non-causal models for targeting interventions. The last two implications are particularly important in practice, as acquiring (unconfounded) data on all counterfactuals can be costly and often impracticable. These observations open substantial research ground. We hope to facilitate research in this area by pointing to related articles from multiple contributing fields, including two dozen articles published the last three to four years.


title: Image-based Virtual Fitting Room

abstract: Virtual fitting room is a challenging task yet useful feature for e-commerce platforms and fashion designers. Existing works can only detect very few types of fashion items. Besides they did poorly in changing the texture and style of the selected fashion items. In this project, we propose a novel approach to address this problem. We firstly used Mask R-CNN to find the regions of different fashion items, and secondly used Neural Style Transfer to change the style of the selected fashion items. The dataset we used is composed of images from PaperDoll dataset and annotations provided by eBay's ModaNet. We trained 8 models and our best model massively outperformed baseline models both quantitatively and qualitatively, with 68.72% mAP, 0.2% ASDR.


title: Risk-Aware Lane Selection on Highway with Dynamic Obstacles

abstract: This paper proposes a discretionary lane selection algorithm. In particular, highway driving is considered as a targeted scenario, where each lane has a different level of traffic flow. When lane-changing is discretionary, it is advised not to change lanes unless highly beneficial, e.g., reducing travel time significantly or securing higher safety. Evaluating such "benefit" is a challenge, along with multiple surrounding vehicles in dynamic speed and heading with uncertainty. We propose a real-time lane-selection algorithm with careful cost considerations and with modularity in design. The algorithm is a search-based optimization method that evaluates uncertain dynamic positions of other vehicles under a continuous time and space domain. For demonstration, we incorporate a state-of-the-art motion planner framework (Neural Networks integrated Model Predictive Control) under a CARLA simulation environment.


title: Fast flavor instabilities and the search for neutrino angular crossings

abstract: With the recognition that fast flavor instabilities likely affect supernova and neutron-star-merger neutrinos, using simulation data to pin down when and where the instabilities occur has become a high priority. The effort faces an interesting problem. Fast instabilities are related to neutrino angular crossings, but simulations often employ moment methods, sacrificing momentum-space angular resolution in order to allocate resources elsewhere. How can limited angular information be used most productively? The main aims here are to sharpen this question and examine some of the available answers. A recently proposed method of searching for angular crossings is scrutinized, the limitations of moment closures are highlighted, and two ways of reconstructing angular distributions solely from the flux factors (based respectively on maximum-entropy and sharp-decoupling assumptions) are compared. In (semi)transparent regions, the standard closure prescriptions likely miss some crossings that should be there and introduce others that should not.


title: FACESEC: A Fine-grained Robustness Evaluation Framework for Face Recognition Systems

abstract: We present FACESEC, a framework for fine-grained robustness evaluation of face recognition systems. FACESEC evaluation is performed along four dimensions of adversarial modeling: the nature of perturbation (e.g., pixel-level or face accessories), the attacker's system knowledge (about training data and learning architecture), goals (dodging or impersonation), and capability (tailored to individual inputs or across sets of these). We use FACESEC to study five face recognition systems in both closed-set and open-set settings, and to evaluate the state-of-the-art approach for defending against physically realizable attacks on these. We find that accurate knowledge of neural architecture is significantly more important than knowledge of the training data in black-box attacks. Moreover, we observe that open-set face recognition systems are more vulnerable than closed-set systems under different types of attacks. The efficacy of attacks for other threat model variations, however, appears highly dependent on both the nature of perturbation and the neural network architecture. For example, attacks that involve adversarial face masks are usually more potent, even against adversarially trained models, and the ArcFace architecture tends to be more robust than the others.


title: XFORMAL: A Benchmark for Multilingual Formality Style Transfer

abstract: We take the first step towards multilingual style transfer by creating and releasing XFORMAL, a benchmark of multiple formal reformulations of informal text in Brazilian Portuguese, French, and Italian. Results on XFORMAL suggest that state-of-the-art style transfer approaches perform close to simple baselines, indicating that style transfer is even more challenging when moving multilingual.


title: Rapid Recovery from Robot Failures in Multi-Robot Visibility-Based Pursuit-Evasion

abstract: This paper addresses the visibility-based pursuit-evasion problem where a team of pursuer robots operating in a two-dimensional polygonal space seek to establish visibility of an arbitrarily fast evader. This is a computationally challenging task for which the best known complete algorithm takes time doubly exponential in the number of robots. However, recent advances that utilize sampling-based methods have shown progress in generating feasible solutions. An aspect of this problem that has yet to be explored concerns how to ensure that the robots can recover from catastrophic failures which leave one or more robots unexpectedly incapable of continuing to contribute to the pursuit of the evader. To address this issue, we propose an algorithm that can rapidly recover from catastrophic failures. When such failures occur, a replanning occurs, leveraging both the information retained from the previous iteration and the partial progress of the search completed before the failure to generate a new motion strategy for the reduced team of pursuers. We describe an implementation of this algorithm and provide quantitative results that show that the proposed method is able to recover from robot failures more rapidly than a baseline approach that plans from scratch.


title: A Design Space Study for LISTA and Beyond

abstract: In recent years, great success has been witnessed in building problem-specific deep networks from unrolling iterative algorithms, for solving inverse problems and beyond. Unrolling is believed to incorporate the model-based prior with the learning capacity of deep learning. This paper revisits the role of unrolling as a design approach for deep networks: to what extent its resulting special architecture is superior, and can we find better? Using LISTA for sparse recovery as a representative example, we conduct the first thorough design space study for the unrolled models. Among all possible variations, we focus on extensively varying the connectivity patterns and neuron types, leading to a gigantic design space arising from LISTA. To efficiently explore this space and identify top performers, we leverage the emerging tool of neural architecture search (NAS). We carefully examine the searched top architectures in a number of settings, and are able to discover networks that are consistently better than LISTA. We further present more visualization and analysis to "open the black box", and find that the searched top architectures demonstrate highly consistent and potentially transferable patterns. We hope our study to spark more reflections and explorations on how to better mingle model-based optimization prior and data-driven learning.